-- Logs begin at Mon 2022-06-27 14:41:23 UTC, end at Mon 2022-06-27 15:40:41 UTC. -- Jun 27 15:10:36.424487 dv-cinder-847798-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 27 15:10:36.438352 dv-cinder-847798-1-smb devstack@keystone.service[80182]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 27 15:10:36.440398 dv-cinder-847798-1-smb devstack@keystone.service[80182]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 15:10:36 2022] *** Jun 27 15:10:36.440398 dv-cinder-847798-1-smb devstack@keystone.service[80182]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 15:10:36.440398 dv-cinder-847798-1-smb devstack@keystone.service[80182]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 15:10:36.440398 dv-cinder-847798-1-smb devstack@keystone.service[80182]: nodename: dv-cinder-847798-1-smb Jun 27 15:10:36.440398 dv-cinder-847798-1-smb devstack@keystone.service[80182]: machine: x86_64 Jun 27 15:10:36.440398 dv-cinder-847798-1-smb devstack@keystone.service[80182]: clock source: unix Jun 27 15:10:36.440398 dv-cinder-847798-1-smb devstack@keystone.service[80182]: pcre jit disabled Jun 27 15:10:36.440398 dv-cinder-847798-1-smb devstack@keystone.service[80182]: detected number of CPU cores: 4 Jun 27 15:10:36.440398 dv-cinder-847798-1-smb devstack@keystone.service[80182]: current working directory: / Jun 27 15:10:36.440398 dv-cinder-847798-1-smb devstack@keystone.service[80182]: detected binary path: /usr/bin/uwsgi-core Jun 27 15:10:36.440398 dv-cinder-847798-1-smb devstack@keystone.service[80182]: your processes number limit is 47680 Jun 27 15:10:36.440398 dv-cinder-847798-1-smb devstack@keystone.service[80182]: your memory page size is 4096 bytes Jun 27 15:10:36.440398 dv-cinder-847798-1-smb devstack@keystone.service[80182]: detected max file descriptor number: 2048 Jun 27 15:10:36.440398 dv-cinder-847798-1-smb devstack@keystone.service[80182]: lock engine: pthread robust mutexes Jun 27 15:10:36.441775 dv-cinder-847798-1-smb devstack@keystone.service[80182]: thunder lock: enabled Jun 27 15:10:36.441775 dv-cinder-847798-1-smb devstack@keystone.service[80182]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 27 15:10:36.441775 dv-cinder-847798-1-smb devstack@keystone.service[80182]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 15:10:36.485155 dv-cinder-847798-1-smb devstack@keystone.service[80182]: Python main interpreter initialized at 0x55ede86949c0 Jun 27 15:10:36.485155 dv-cinder-847798-1-smb devstack@keystone.service[80182]: python threads support enabled Jun 27 15:10:36.485155 dv-cinder-847798-1-smb devstack@keystone.service[80182]: your server socket listen backlog is limited to 100 connections Jun 27 15:10:36.485155 dv-cinder-847798-1-smb devstack@keystone.service[80182]: your mercy for graceful operations on workers is 90 seconds Jun 27 15:10:36.485708 dv-cinder-847798-1-smb devstack@keystone.service[80182]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 15:10:36.485708 dv-cinder-847798-1-smb devstack@keystone.service[80182]: *** Operational MODE: preforking *** Jun 27 15:10:36.487290 dv-cinder-847798-1-smb devstack@keystone.service[80182]: *** uWSGI is running in multiple interpreter mode *** Jun 27 15:10:36.487290 dv-cinder-847798-1-smb devstack@keystone.service[80182]: spawned uWSGI master process (pid: 80182) Jun 27 15:10:36.487290 dv-cinder-847798-1-smb devstack@keystone.service[80182]: spawned uWSGI worker 1 (pid: 80192, cores: 1) Jun 27 15:10:36.487290 dv-cinder-847798-1-smb devstack@keystone.service[80182]: spawned uWSGI worker 2 (pid: 80193, cores: 1) Jun 27 15:10:36.487290 dv-cinder-847798-1-smb devstack@keystone.service[80182]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 15:10:36.486103 dv-cinder-847798-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 27 15:10:42.120697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:10:42.120697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: from cryptography.utils import int_from_bytes Jun 27 15:10:42.121733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:10:42.121733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: from cryptography.utils import int_from_bytes Jun 27 15:10:42.125391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:10:42.125391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: from cryptography.utils import int_from_bytes Jun 27 15:10:42.126177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:10:42.126177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: from cryptography.utils import int_from_bytes Jun 27 15:10:42.170038 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 15:10:42.170310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 15:10:42.170451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] command line args: [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 15:10:42.170694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 15:10:42.170856 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ================================================================================ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 15:10:42.171110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] admin_token = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.171352 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] config_dir = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.171510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.171686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] config_source = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.171863 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] debug = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.172080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.172449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.172607 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.172821 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.173064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.173289 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.173483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] log_config_append = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.173652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 15:10:42.173813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.173974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 15:10:42.174146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] log_dir = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.174429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] command line args: [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 15:10:42.174666 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] log_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.174666 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.175156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 15:10:42.175156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ================================================================================ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 15:10:42.175611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.175723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] admin_token = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.175908 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.176027 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] config_dir = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.176148 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.176275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.176409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.176529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] config_source = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.176657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.176781 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] debug = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.176913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.177044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.177200 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.177339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.177339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.177624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.177759 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.177890 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.178009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.178130 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.178269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.178404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.178540 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] log_config_append = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.178667 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.178858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.179022 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.179130 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] log_dir = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.179130 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] log_file = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.179411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.179550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.179550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.179820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.179950 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.180086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] publish_errors = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.180086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.180353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.180487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.180640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.180763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.180906 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.181013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.181125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.181281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.181396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.181518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] standard_threads = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.181627 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.181738 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.181850 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.182005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.182119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.182279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.182279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] use_journal = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.182495 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.182616 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] use_json = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.182724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.182862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] use_stderr = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.182862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] use_syslog = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.183086 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.183202 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.183325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.183496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.183496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.183701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.183701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] publish_errors = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.183930 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.184039 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.184150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.184262 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.184381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.184490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.184625 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.184733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.184845 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.184965 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.185074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.185535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] standard_threads = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.185659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.185770 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.185881 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.186040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.186040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.186294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.186420 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] use_journal = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.186529 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.186650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] use_json = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.186650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] use_stderr = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.186856 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.186977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] use_syslog = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.187103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.187210 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:10:42.187323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.187450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.187569 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.187677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.187802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.187911 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.188024 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.188145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.188256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.188369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.188502 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.188610 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.188730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.188845 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.188959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.189080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.189271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.189378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.189489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.189602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.189712 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.189824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.189957 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.190073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.190185 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.190329 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.190447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.190558 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.190687 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.190799 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.190917 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.191027 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.191147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.191264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.191383 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.191491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.191611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.191720 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.191830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.191959 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.192075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.192187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.192299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.192409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.192521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.192647 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.192754 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.192875 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.192983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.193102 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.193218 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.193340 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.193449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.193678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.193790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.193899 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.194004 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.194174 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.194304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.194431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.194539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.194652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.194762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.194957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.195065 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.195195 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.195300 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.195413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.195531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.195654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.195763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.195884 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.196000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.196110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.196231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.196361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.196468 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.196582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.196708 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.196816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.196926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.196926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.196926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.197247 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.197365 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.197473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.197593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.197720 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.197827 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.197939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.198049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.198162 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.198341 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.198469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.198577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.198737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.198899 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.199054 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.199216 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.199385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.199532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.199679 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.199828 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.199981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.200131 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.200306 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.200480 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.200611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.200779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.200904 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.201034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.201203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.201325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.201491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.201600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.201770 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.201881 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.202000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.202000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.202311 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.202487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.202598 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.202753 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.202864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.202864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.203135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.203135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.203404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.203404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.203676 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.203845 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.203958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.204127 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.204237 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.204406 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.204530 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.204658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.204788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.204917 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.205095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.205203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.205325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.205467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.205586 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.205586 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.205838 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.205954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.206066 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.206200 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.206362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.206478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.206595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.206705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.206818 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.206983 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.207152 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.207152 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.207375 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.207485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.207597 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.207787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.207896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.208014 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.208127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.208261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.208370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.208493 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.208616 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.208616 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.208853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.208853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.209070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.209070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.209263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.209380 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.209491 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.209598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.209766 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.209937 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.210110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.external = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.210383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.210588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.210772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.210893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.211017 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.211147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.211257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.211379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.password = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.211488 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.211600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.token = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.211729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.211851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.211962 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.212083 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.212194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.212313 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.212435 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.212561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.212670 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.212819 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.212940 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.213050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.213162 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.213284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.213396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.213522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.213632 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.213748 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.213861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.213973 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.214087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.external = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.214212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.214352 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.214467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.214467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.214690 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.214800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.214800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.215029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.215143 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.215143 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.215356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.password = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.215356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.token = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.215592 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.215700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.215814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.215930 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.216040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.216155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.216282 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.216398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.216512 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.216627 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.216739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.216853 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.216980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.217106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.217214 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.217328 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.217442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.217558 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.217683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.217804 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.217915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.218036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.218159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.218393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.218530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.218647 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.218769 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.218888 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.219006 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.219125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.219257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.219373 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.219493 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.219613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.219756 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.219871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.220002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.220118 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.220238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.220357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.220477 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.220477 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.220720 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.220841 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.220970 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.221091 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.221209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.221330 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.221465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.221577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.221698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.221817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.221937 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.222147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.222278 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.222399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.222517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.222636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.222759 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.222899 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.223011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.223133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.223249 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.223367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.223483 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.223611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.223725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.223843 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.223960 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.224077 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.224196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.224196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.224403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.224403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.224628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.224788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.224909 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.225039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.225153 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.225269 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.225386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.225503 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.225620 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.225756 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.225869 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.225996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.226110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.226249 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.226370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.226508 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.226625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.226745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.226867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.226987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.227107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.227239 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.227358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.227479 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.227599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.227724 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.227846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.227985 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.228108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.228228 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.228350 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.228470 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.228592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.228729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.228848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.228967 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.229088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.229207 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.229326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.229458 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.229577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.229699 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.229823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.229943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.230063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.230197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.230371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.230494 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.230494 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.230494 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.230494 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.230926 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.231037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.231153 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.231271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.231392 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.231507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.231634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.231748 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.231864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.231980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.232095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.232212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.232340 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.232454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.232570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.232686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.232802 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.232929 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.233047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.233162 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.233279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.233396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.233511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.233639 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.233753 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.233867 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.233981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.234096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.234213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.234374 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.234491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.234612 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.234737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.234855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.234974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.235113 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.235226 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.235346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.235464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.235582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.235701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.235832 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.235948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.236068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.236187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.236310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.236429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.236559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.236675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.236794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.236912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.237029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.237146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.237276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.237391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.237510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.237629 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.237747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.237866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.238002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.238116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.238277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.238393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.238509 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.238626 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.238760 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.238872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.238990 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.239104 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.239220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.239336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.239464 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.239578 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.239697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.239814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.239931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.240047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.240176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.240290 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.240404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.240526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.240643 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.240764 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.240890 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.241006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.241122 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.241243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.241357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.241482 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.241607 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.241721 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.241838 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.241953 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.242068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.242184 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.242370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.242480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.242600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.242716 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.242835 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.242958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.243085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.243200 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.243316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] role.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.243432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.243547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] role.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.243664 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.243793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.243907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.244024 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.244140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.244255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.244371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.244508 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.244625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.244744 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.244860 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.244976 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.245093 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.245290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.245400 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.245518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.245634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.245752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.245860 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.245984 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.246093 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.246211 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.246354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.246471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.246605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.246716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.246896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.247046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.247156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.247156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.247392 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.247502 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.247618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.247733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.247848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.247970 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.248097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.248209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.248326 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.248441 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] role.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.248556 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.248672 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] role.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.248799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.248913 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.249068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.249178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.249295 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.249411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.249547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.249658 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.249773 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.249890 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.250005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.250120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.250358 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.250471 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.250591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.250714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.250830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.250947 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.251082 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.251200 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.251317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.251434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.251550 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.251667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.251795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.251908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.252025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] token.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.252142 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.252258 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.252258 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.252490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.252603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.252714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.252837 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.252958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.253089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.253207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.253325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.253444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.253563 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.253684 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.253813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.253929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.254048 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.254168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.254308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.254427 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.254561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.254682 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.254797 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.254913 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.255029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.255145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.255280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.255391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.255507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.255622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.255737 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.255852 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.256013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.256139 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.256255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.256385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.256510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.256624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.256739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.256855 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.256984 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.257098 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] token.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.257213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.257330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.257447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.257565 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.257698 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.257812 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.257928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.258044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.258160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.258293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.258439 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.258553 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.258673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.259080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.259199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.259317 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.259446 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.259561 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.259684 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.259800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.259910 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.260026 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.260154 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.260269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.260386 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.260507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.260627 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.260760 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.260872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.260983 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.261099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 15:10:42.261217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.261217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.261217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.261217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.261217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.261217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.261217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.261217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.261217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.262154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.262154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.262154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.262154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.262154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.262154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.262154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.262154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.262154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.263138 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.263138 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.263138 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:10:42.263138 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 15:10:42.284761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.284989 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.285212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.285959 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.286189 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.286439 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.294259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.295728 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.322667 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.322895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.324999 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.325228 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.469504 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.474424 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.519140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.519445 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.521001 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.521211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.589675 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.589931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.590083 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.590256 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.590381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.590492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.590602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.590718 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.590859 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.590977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.591151 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.591433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.619364 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.619629 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.619745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.619861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.619970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.620078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.620204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.620317 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.620423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.620527 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.620631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.620737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.620852 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.620958 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.633198 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.633524 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.646419 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.646853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.647057 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.647195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.647410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.647601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.647601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.647601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.647601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.648294 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.648502 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.648693 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.648693 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.648693 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 15:10:42.665270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.665565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 15:10:42.665803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.666024 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 15:10:42.666240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.666420 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.666579 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.666746 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 15:10:42.666897 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.667060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.667210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.667358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 15:10:42.667358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.667644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.667822 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.667996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.677753 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.678095 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.678330 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.678641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.679398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.679675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.679913 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.680214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.687293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.688857 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.690573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.690817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.691122 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.691368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.691670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.691872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.692109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.692291 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.692448 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.692615 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.692615 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.692906 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.693057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.693208 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.693372 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.693537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.693537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.694396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.694698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.694967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.695215 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.695503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.719950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.721498 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.721776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.722338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.723957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.724237 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.727155 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.727549 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.727824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.730041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.730469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.730749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.735244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.735511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.737994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.738281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.740004 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.740270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.740616 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.740870 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.741333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.741615 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.741858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.742140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.743454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.743747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.743989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.744290 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.744560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.744828 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.745037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.745306 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.761037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.761291 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.764409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.764647 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.765945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.769255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.769543 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.769959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.773883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.774376 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.775125 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.778744 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.779503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.782392 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.782692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.782970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.783169 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.783333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.783490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.783769 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.786725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.787017 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.787312 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.788118 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.788396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.788667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.802926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.803229 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.803560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.803748 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.808232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.808507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.808763 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.809007 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.811938 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.813636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.813880 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.817241 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.817443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.817586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.817736 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.818040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.818349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.819806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.820132 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.823402 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.823718 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.824037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.824353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.824677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.831542 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.831826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.832107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.832376 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.834178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.834561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.834860 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.838950 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.839247 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.839534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.839810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.841545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.841832 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.842126 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.853054 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.856382 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.859658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.860619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.861413 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.863067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.863315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.863618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.863940 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.867823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.869551 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.871222 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.871462 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.871628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.871787 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.872906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.876191 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.876455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.876888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.877324 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.879088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.880810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.885032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.885363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.885720 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.886001 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.889064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.889562 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.890042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.895609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.895932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.896174 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.899551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.899825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.900110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.900353 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.900644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.902759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.902759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.902759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.902759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.902759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.902759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.903706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.903706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.903706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.905003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 15:10:42.905310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.905552 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.905823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.906065 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.906515 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.906796 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.907084 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.907352 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.907568 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.907829 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.909326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.909326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.909326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 15:10:42.949955 dv-cinder-847798-1-smb devstack@keystone.service[80193]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ede86949c0 pid: 80193 (default app) Jun 27 15:10:42.953426 dv-cinder-847798-1-smb devstack@keystone.service[80192]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ede86949c0 pid: 80192 (default app) Jun 27 15:10:42.953785 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d90c4a-75cb-466c-9dc1-dd8506071831 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:42.954089 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d90c4a-75cb-466c-9dc1-dd8506071831 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:42.954395 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d90c4a-75cb-466c-9dc1-dd8506071831 None None] PATH_INFO: `/v3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:42.960414 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Mon Jun 27 15:10:42 2022] GET /identity/v3/ => generated 255 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:10:50.886397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b42bdf-b7d6-44f2-9efd-045a7da397b9 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:50.887041 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b42bdf-b7d6-44f2-9efd-045a7da397b9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:50.887041 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b42bdf-b7d6-44f2-9efd-045a7da397b9 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:50.891443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:10:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:10:50.897809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d2b04-c6e9-46bf-8033-c7674de0a8a5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:50.898362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d2b04-c6e9-46bf-8033-c7674de0a8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:50.898451 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d2b04-c6e9-46bf-8033-c7674de0a8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:50.968860 dv-cinder-847798-1-smb devstack@keystone.service[80193]: INFO dbcounter [None req-ff8d2b04-c6e9-46bf-8033-c7674de0a8a5 None None] Registered counter for database keystone Jun 27 15:10:50.991771 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG oslo_db.sqlalchemy.engines [None req-ff8d2b04-c6e9-46bf-8033-c7674de0a8a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:10:50.999057 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writer thread running {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:10:51.182903 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG passlib.handlers.bcrypt [None req-ff8d2b04-c6e9-46bf-8033-c7674de0a8a5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80193) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 27 15:10:51.183216 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG passlib.handlers.bcrypt [None req-ff8d2b04-c6e9-46bf-8033-c7674de0a8a5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80193) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 27 15:10:51.240251 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ff8d2b04-c6e9-46bf-8033-c7674de0a8a5 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:10:51.241993 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ff8d2b04-c6e9-46bf-8033-c7674de0a8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:10:51.381177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:10:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 27 15:10:51.509472 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b42bdf-b7d6-44f2-9efd-045a7da397b9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:10:51.582510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: INFO dbcounter [None req-38b42bdf-b7d6-44f2-9efd-045a7da397b9 None None] Registered counter for database keystone Jun 27 15:10:51.602881 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG oslo_db.sqlalchemy.engines [None req-38b42bdf-b7d6-44f2-9efd-045a7da397b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:10:51.610478 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writer thread running {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:10:51.729974 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b42bdf-b7d6-44f2-9efd-045a7da397b9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:10:51.734751 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9500e8-bfb6-47e1-b388-340a0498bb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:10:51.735437 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9500e8-bfb6-47e1-b388-340a0498bb03 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:51.735719 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9500e8-bfb6-47e1-b388-340a0498bb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:51.735988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9500e8-bfb6-47e1-b388-340a0498bb03 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:51.744827 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9500e8-bfb6-47e1-b388-340a0498bb03 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:10:51.796657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bd9500e8-bfb6-47e1-b388-340a0498bb03 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 27 15:10:51.796869 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9500e8-bfb6-47e1-b388-340a0498bb03 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:10:51.808192 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Mon Jun 27 15:10:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:10:51.814777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d2b04-c6e9-46bf-8033-c7674de0a8a5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:10:51.830161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d2b04-c6e9-46bf-8033-c7674de0a8a5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:10:51.836602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d77cd-657d-4880-9835-89b39fa222e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:10:51.837778 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d77cd-657d-4880-9835-89b39fa222e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:51.838069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d77cd-657d-4880-9835-89b39fa222e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:51.838359 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d77cd-657d-4880-9835-89b39fa222e7 admin admin] PATH_INFO: `/v3/projects/ad42af4f268b41b59ed4e25b5dbf310e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:51.842796 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d77cd-657d-4880-9835-89b39fa222e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=ad42af4f268b41b59ed4e25b5dbf310e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:10:51.894448 dv-cinder-847798-1-smb devstack@keystone.service[80193]: WARNING keystone.common.rbac_enforcer.enforcer [None req-127d77cd-657d-4880-9835-89b39fa222e7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 27 15:10:51.894776 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d77cd-657d-4880-9835-89b39fa222e7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:10:51.899729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Mon Jun 27 15:10:51 2022] GET /identity/v3/projects/ad42af4f268b41b59ed4e25b5dbf310e => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:10:53.951323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0689f-4db3-452d-9e4c-f2a636168363 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:53.951944 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0689f-4db3-452d-9e4c-f2a636168363 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:53.951944 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0689f-4db3-452d-9e4c-f2a636168363 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:53.956292 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:10:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:10:53.963144 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f01ed-0d7c-4a8d-ba48-cf1cbbf91144 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:53.963992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f01ed-0d7c-4a8d-ba48-cf1cbbf91144 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:53.964146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f01ed-0d7c-4a8d-ba48-cf1cbbf91144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:53.985790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8d7f01ed-0d7c-4a8d-ba48-cf1cbbf91144 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:10:53.987467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8d7f01ed-0d7c-4a8d-ba48-cf1cbbf91144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:10:53.997472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:10:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 27 15:10:54.021147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0689f-4db3-452d-9e4c-f2a636168363 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:10:54.036069 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0689f-4db3-452d-9e4c-f2a636168363 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:10:54.041447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f40da-e3b7-4cd0-8bbe-0d91bc402e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:10:54.042136 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f40da-e3b7-4cd0-8bbe-0d91bc402e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:54.042465 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f40da-e3b7-4cd0-8bbe-0d91bc402e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:54.042740 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f40da-e3b7-4cd0-8bbe-0d91bc402e95 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:54.051990 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f40da-e3b7-4cd0-8bbe-0d91bc402e95 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:10:54.054056 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f40da-e3b7-4cd0-8bbe-0d91bc402e95 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:10:54.064562 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Mon Jun 27 15:10:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:10:54.071038 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f01ed-0d7c-4a8d-ba48-cf1cbbf91144 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:10:54.080925 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f01ed-0d7c-4a8d-ba48-cf1cbbf91144 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:10:54.086730 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97ff9f-112a-4801-ace9-6f90d3caa036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:10:54.087623 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97ff9f-112a-4801-ace9-6f90d3caa036 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:54.087905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97ff9f-112a-4801-ace9-6f90d3caa036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:54.088177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97ff9f-112a-4801-ace9-6f90d3caa036 admin admin] PATH_INFO: `/v3/users/9a202eb6836d4aa3a8bf60c71995def9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:54.089647 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97ff9f-112a-4801-ace9-6f90d3caa036 admin admin] RBAC: Authorizing `identity:get_user(user_id=9a202eb6836d4aa3a8bf60c71995def9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:10:54.091537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97ff9f-112a-4801-ace9-6f90d3caa036 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:10:54.093146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Mon Jun 27 15:10:54 2022] GET /identity/v3/users/9a202eb6836d4aa3a8bf60c71995def9 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:10:56.217306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1ed27-52c0-43eb-90a6-37296283836d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:56.217867 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1ed27-52c0-43eb-90a6-37296283836d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:56.217867 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1ed27-52c0-43eb-90a6-37296283836d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:56.219458 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:10:56.225487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73a841-52c1-405b-b84d-7edf27da1550 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:56.225981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73a841-52c1-405b-b84d-7edf27da1550 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:56.226063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73a841-52c1-405b-b84d-7edf27da1550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:56.232456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a278a4a-cac3-463e-bbd0-60b8222f8409 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:56.232830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a278a4a-cac3-463e-bbd0-60b8222f8409 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:56.233179 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a278a4a-cac3-463e-bbd0-60b8222f8409 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:56.234682 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:10:56.240195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c78fb-5a7a-4082-a035-d6aa46a48b70 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:56.240491 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c78fb-5a7a-4082-a035-d6aa46a48b70 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:56.240775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c78fb-5a7a-4082-a035-d6aa46a48b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:56.244684 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1b73a841-52c1-405b-b84d-7edf27da1550 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:10:56.246067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1b73a841-52c1-405b-b84d-7edf27da1550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:10:56.281410 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG passlib.handlers.bcrypt [None req-a80c78fb-5a7a-4082-a035-d6aa46a48b70 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80192) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 27 15:10:56.281837 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG passlib.handlers.bcrypt [None req-a80c78fb-5a7a-4082-a035-d6aa46a48b70 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80192) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 27 15:10:56.327455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a80c78fb-5a7a-4082-a035-d6aa46a48b70 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:10:56.329093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a80c78fb-5a7a-4082-a035-d6aa46a48b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:10:56.331459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:10:56.355543 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73a841-52c1-405b-b84d-7edf27da1550 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:10:56.381897 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:10:56.432984 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:10:56.457175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c78fb-5a7a-4082-a035-d6aa46a48b70 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:10:56.467829 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73a841-52c1-405b-b84d-7edf27da1550 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:10:56.501949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1bd90-1cbe-487b-9af5-5c903c8fe3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:10:56.502785 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1bd90-1cbe-487b-9af5-5c903c8fe3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:56.503069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1bd90-1cbe-487b-9af5-5c903c8fe3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:56.503353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1bd90-1cbe-487b-9af5-5c903c8fe3f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:56.515662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1bd90-1cbe-487b-9af5-5c903c8fe3f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:10:56.527108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-59e1bd90-1cbe-487b-9af5-5c903c8fe3f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:10:56.527108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:10:56.527108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:10:56.527108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:10:56.527108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:10:56.527108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:10:56.527108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:10:56.527108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:10:56.527108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:10:56.527108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:10:56.527108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:10:56.527108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:10:56.527108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:10:56.527108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:10:56.527108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:10:56.527108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:10:56.528182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:10:56.528182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:10:56.528182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:10:56.528182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:10:56.528182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:10:56.528182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:10:56.528182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:10:56.528182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:10:56.528182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:10:56.528182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:10:56.528182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:10:56.528182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:10:56.528182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:10:56.528182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:10:56.528182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:10:56.528182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:10:56.529283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:10:56.529283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:10:56.529283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:10:56.529283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:10:56.529283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:10:56.529283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:10:56.529283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:10:56.529283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:10:56.529283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:10:56.529283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:10:56.529283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:10:56.529283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:10:56.529283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:10:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:10:56.534327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1bd90-1cbe-487b-9af5-5c903c8fe3f0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:10:56.566253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c78fb-5a7a-4082-a035-d6aa46a48b70 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:10:56.569169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:10:56.605654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea8c66-73ec-401f-bf07-c3d4b533262f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:10:56.606614 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea8c66-73ec-401f-bf07-c3d4b533262f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:56.606902 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea8c66-73ec-401f-bf07-c3d4b533262f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:56.607180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea8c66-73ec-401f-bf07-c3d4b533262f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:56.620415 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:10:56.641323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1bd90-1cbe-487b-9af5-5c903c8fe3f0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:10:56.677446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf64045-9d10-4cd3-8caa-e40a9eefb787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:10:56.678458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf64045-9d10-4cd3-8caa-e40a9eefb787 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:56.679237 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf64045-9d10-4cd3-8caa-e40a9eefb787 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:56.679237 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf64045-9d10-4cd3-8caa-e40a9eefb787 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:56.680392 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf64045-9d10-4cd3-8caa-e40a9eefb787 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:10:56.680827 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf64045-9d10-4cd3-8caa-e40a9eefb787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:10:56.682940 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf64045-9d10-4cd3-8caa-e40a9eefb787 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:10:56.690465 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea8c66-73ec-401f-bf07-c3d4b533262f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:10:56.693158 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea8c66-73ec-401f-bf07-c3d4b533262f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:10:56.702776 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 8/15] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:10:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:10:56.712146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf64045-9d10-4cd3-8caa-e40a9eefb787 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:10:56.821878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 8/16] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:10:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:56.827726 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea8c66-73ec-401f-bf07-c3d4b533262f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:10:56.830901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:10:56.837621 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf64045-9d10-4cd3-8caa-e40a9eefb787 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:10:56.875391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3e74f-aeb2-463b-b290-7a652b18e20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:10:56.876299 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3e74f-aeb2-463b-b290-7a652b18e20f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:56.876593 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3e74f-aeb2-463b-b290-7a652b18e20f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:56.876874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3e74f-aeb2-463b-b290-7a652b18e20f None admin] PATH_INFO: `/v3/users/9a202eb6836d4aa3a8bf60c71995def9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:56.878150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3e74f-aeb2-463b-b290-7a652b18e20f None admin] RBAC: Authorizing `identity:get_user(user_id=9a202eb6836d4aa3a8bf60c71995def9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:10:56.879680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3e74f-aeb2-463b-b290-7a652b18e20f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:10:56.881576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 9/17] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:10:56 2022] GET /identity/v3/users/9a202eb6836d4aa3a8bf60c71995def9 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:10:56.887146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3e74f-aeb2-463b-b290-7a652b18e20f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:10:56.902589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:10:56.937619 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea8c66-73ec-401f-bf07-c3d4b533262f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:10:56.973741 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f16eb6-8abf-4603-96a1-316bc6246c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:10:56.974941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f16eb6-8abf-4603-96a1-316bc6246c4b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:56.975248 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f16eb6-8abf-4603-96a1-316bc6246c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:56.975533 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f16eb6-8abf-4603-96a1-316bc6246c4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:56.998846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3e74f-aeb2-463b-b290-7a652b18e20f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:10:57.004462 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f16eb6-8abf-4603-96a1-316bc6246c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:10:57.007204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f16eb6-8abf-4603-96a1-316bc6246c4b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:10:57.033531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-96f16eb6-8abf-4603-96a1-316bc6246c4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:10:57.033531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:10:57.033531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:10:57.033531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:10:57.033531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:10:57.033531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:10:57.033531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:10:57.033531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:10:57.033531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:10:57.033531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:10:57.033531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:10:57.033531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:10:57.033531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:10:57.033531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:10:57.033531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:10:57.034515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:10:57.035686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:10:57.035686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:10:57.035686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:10:57.035686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:10:57.035686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 9/18] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:10:57.036957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404ac5b-23f2-4044-83de-1f234490aedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:10:57.037895 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404ac5b-23f2-4044-83de-1f234490aedc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:57.038187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404ac5b-23f2-4044-83de-1f234490aedc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:57.038496 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404ac5b-23f2-4044-83de-1f234490aedc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:57.039734 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404ac5b-23f2-4044-83de-1f234490aedc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:10:57.041186 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f16eb6-8abf-4603-96a1-316bc6246c4b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:10:57.041316 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404ac5b-23f2-4044-83de-1f234490aedc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:10:57.042967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 10/19] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:10:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:10:57.048870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404ac5b-23f2-4044-83de-1f234490aedc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:10:57.114074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:10:57.146142 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:10:57.164553 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f16eb6-8abf-4603-96a1-316bc6246c4b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:10:57.166930 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404ac5b-23f2-4044-83de-1f234490aedc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:10:57.202303 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35003d7b-2e9e-45e5-83bb-294358145b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:10:57.203003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35003d7b-2e9e-45e5-83bb-294358145b76 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:57.203296 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35003d7b-2e9e-45e5-83bb-294358145b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:57.203583 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35003d7b-2e9e-45e5-83bb-294358145b76 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:57.204355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35003d7b-2e9e-45e5-83bb-294358145b76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:10:57.204671 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35003d7b-2e9e-45e5-83bb-294358145b76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:10:57.205669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a43b9b-0bbb-4bdd-b5b3-844c3e3d3318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:10:57.206140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35003d7b-2e9e-45e5-83bb-294358145b76 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:10:57.206405 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a43b9b-0bbb-4bdd-b5b3-844c3e3d3318 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:10:57.206698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a43b9b-0bbb-4bdd-b5b3-844c3e3d3318 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:10:57.207270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a43b9b-0bbb-4bdd-b5b3-844c3e3d3318 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:10:57.208152 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a43b9b-0bbb-4bdd-b5b3-844c3e3d3318 None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.domain.id=default, user.id=9a202eb6836d4aa3a8bf60c71995def9) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:10:57.208515 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a43b9b-0bbb-4bdd-b5b3-844c3e3d3318 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:10:57.210023 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a43b9b-0bbb-4bdd-b5b3-844c3e3d3318 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:10:57.218575 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 11/20] 10.222.0.33 () {56 vars in 1322 bytes} [Mon Jun 27 15:10:57 2022] GET /identity/v3/role_assignments?user.id=9a202eb6836d4aa3a8bf60c71995def9&scope.domain.id=default&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 233 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:10:57.228045 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 10/21] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:10:59.999773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e234b8-ad7e-4d9e-bbc3-d39ef15986b6 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:00.000407 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e234b8-ad7e-4d9e-bbc3-d39ef15986b6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:00.000779 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e234b8-ad7e-4d9e-bbc3-d39ef15986b6 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:00.003491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 12/22] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:10:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:00.010274 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49f566-69a0-4efe-a91f-1ef54f051122 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:00.010869 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49f566-69a0-4efe-a91f-1ef54f051122 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:00.011308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49f566-69a0-4efe-a91f-1ef54f051122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:00.052484 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5d49f566-69a0-4efe-a91f-1ef54f051122 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:00.054644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5d49f566-69a0-4efe-a91f-1ef54f051122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:00.198078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 11/23] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:00.235442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e234b8-ad7e-4d9e-bbc3-d39ef15986b6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:00.366275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2adf6-e400-47db-a8c1-f254f11eb9a4 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:00.366715 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2adf6-e400-47db-a8c1-f254f11eb9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:00.367228 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2adf6-e400-47db-a8c1-f254f11eb9a4 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:00.369859 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:00.380795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba79806-c5d2-40ff-b00f-9c487fcf88bd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:00.381318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba79806-c5d2-40ff-b00f-9c487fcf88bd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:00.381838 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba79806-c5d2-40ff-b00f-9c487fcf88bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:00.436564 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4ba79806-c5d2-40ff-b00f-9c487fcf88bd None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:00.438546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4ba79806-c5d2-40ff-b00f-9c487fcf88bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:00.468064 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e234b8-ad7e-4d9e-bbc3-d39ef15986b6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:00.555011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8b9e2-1f05-4dcf-923f-15471fd013b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:00.556213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8b9e2-1f05-4dcf-923f-15471fd013b5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:00.556696 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8b9e2-1f05-4dcf-923f-15471fd013b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:00.557183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8b9e2-1f05-4dcf-923f-15471fd013b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:00.582734 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8b9e2-1f05-4dcf-923f-15471fd013b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:00.584669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8b9e2-1f05-4dcf-923f-15471fd013b5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:00.590624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:00.611688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:00.611871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 13/25] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:00.615588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-efb8b9e2-1f05-4dcf-923f-15471fd013b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:11:00.615588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:00.615588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:00.615588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:00.615588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:00.615588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:00.615588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:00.615588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:00.615588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:00.615588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:00.615588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:00.615588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:00.615588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:11:00.615588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:11:00.615588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:00.616454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:00.617585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:11:00.617585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:11:00.617585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:11:00.617585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:00.617789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8074f-dc9d-4e2f-adaa-d7276a4fd2a9 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:00.617789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8074f-dc9d-4e2f-adaa-d7276a4fd2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:00.617789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8074f-dc9d-4e2f-adaa-d7276a4fd2a9 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:00.617964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 13/26] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:00.618402 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 14/27] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:00.627427 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8b9e2-1f05-4dcf-923f-15471fd013b5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:00.630473 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae0686-13d2-4ef0-9bd5-db8f3db350b8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:00.630974 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae0686-13d2-4ef0-9bd5-db8f3db350b8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:00.631483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae0686-13d2-4ef0-9bd5-db8f3db350b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:00.658568 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-daae0686-13d2-4ef0-9bd5-db8f3db350b8 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:00.660662 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-daae0686-13d2-4ef0-9bd5-db8f3db350b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:00.739938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8b9e2-1f05-4dcf-923f-15471fd013b5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:00.762253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 15/28] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:00.762253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360ca1d-101a-4947-8d0b-ce97f9498c7b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:00.762253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360ca1d-101a-4947-8d0b-ce97f9498c7b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:00.762253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360ca1d-101a-4947-8d0b-ce97f9498c7b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:00.763002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 16/29] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:00.765494 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360ca1d-101a-4947-8d0b-ce97f9498c7b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:00.811340 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98766f7-33aa-4bd4-b569-d6391d879ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:00.812044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98766f7-33aa-4bd4-b569-d6391d879ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:00.812973 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98766f7-33aa-4bd4-b569-d6391d879ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:00.813265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98766f7-33aa-4bd4-b569-d6391d879ed8 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:00.814029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98766f7-33aa-4bd4-b569-d6391d879ed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:00.814378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98766f7-33aa-4bd4-b569-d6391d879ed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:00.816140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98766f7-33aa-4bd4-b569-d6391d879ed8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:00.842237 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 14/30] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:00.843964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88b851-0f0f-4d67-aaf7-76a4ad7cbeda None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:00.844259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88b851-0f0f-4d67-aaf7-76a4ad7cbeda None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:00.844543 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88b851-0f0f-4d67-aaf7-76a4ad7cbeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:00.869618 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5f88b851-0f0f-4d67-aaf7-76a4ad7cbeda None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:00.870939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5f88b851-0f0f-4d67-aaf7-76a4ad7cbeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:00.908154 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360ca1d-101a-4947-8d0b-ce97f9498c7b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:00.919590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:00.939671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:00.961333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 15/31] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:00.962937 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88b851-0f0f-4d67-aaf7-76a4ad7cbeda None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:00.963706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72674300-cb2d-4dba-8111-0f4d521e060f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:00.964590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72674300-cb2d-4dba-8111-0f4d521e060f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:00.964857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72674300-cb2d-4dba-8111-0f4d521e060f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:00.965135 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72674300-cb2d-4dba-8111-0f4d521e060f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:00.997819 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72674300-cb2d-4dba-8111-0f4d521e060f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:01.007697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-72674300-cb2d-4dba-8111-0f4d521e060f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:01.007697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:01.007697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:01.007697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:01.007697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:01.007697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:01.007697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:01.007697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:01.007697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:01.007697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:01.007697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:01.007697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:01.007697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:01.007697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:01.007697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:01.007697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:01.008626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:01.008626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:01.008626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:01.008626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:01.008626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:01.008626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:01.008626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:01.008626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:01.008626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:01.008626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:01.008626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:01.008626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:01.008626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:01.008626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:01.008626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:01.008626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:01.009370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:01.009370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:01.009370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:01.009370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:01.009370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:01.009370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:01.009370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:01.009370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:01.009370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:01.009370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:01.009370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:01.009370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:01.012305 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 17/32] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:11:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:01.013925 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72674300-cb2d-4dba-8111-0f4d521e060f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:01.125576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88b851-0f0f-4d67-aaf7-76a4ad7cbeda None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:01.153912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72674300-cb2d-4dba-8111-0f4d521e060f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:01.168469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9fa30-7da8-401c-9461-d050022f9b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:01.169536 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9fa30-7da8-401c-9461-d050022f9b35 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:01.169661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9fa30-7da8-401c-9461-d050022f9b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:01.169873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9fa30-7da8-401c-9461-d050022f9b35 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:01.170677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9fa30-7da8-401c-9461-d050022f9b35 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:01.172113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9fa30-7da8-401c-9461-d050022f9b35 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:01.192240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a26b83-bcf6-40b9-888f-ac1f38a2f5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:01.193423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a26b83-bcf6-40b9-888f-ac1f38a2f5bd None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:01.193709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a26b83-bcf6-40b9-888f-ac1f38a2f5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:01.193982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a26b83-bcf6-40b9-888f-ac1f38a2f5bd None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:01.194992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a26b83-bcf6-40b9-888f-ac1f38a2f5bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:01.196451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a26b83-bcf6-40b9-888f-ac1f38a2f5bd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:01.304197 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 16/33] 10.222.0.33 () {60 vars in 1131 bytes} [Mon Jun 27 15:11:00 2022] POST /identity/v3/roles => generated 219 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:11:01.305221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9fa30-7da8-401c-9461-d050022f9b35 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:01.371847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:01.406977 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 18/34] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 27 15:11:01 2022] POST /identity/v3/projects => generated 301 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:11:01.415846 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a26b83-bcf6-40b9-888f-ac1f38a2f5bd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:01.450101 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9fa30-7da8-401c-9461-d050022f9b35 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:01.472025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:01.500871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d56be9-1078-49d4-b39b-0eb6cab9f188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:01.501604 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d56be9-1078-49d4-b39b-0eb6cab9f188 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:01.501892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d56be9-1078-49d4-b39b-0eb6cab9f188 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:01.502173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d56be9-1078-49d4-b39b-0eb6cab9f188 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:01.503085 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d56be9-1078-49d4-b39b-0eb6cab9f188 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:01.504697 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d56be9-1078-49d4-b39b-0eb6cab9f188 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:01.538405 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 17/35] 10.222.0.33 () {60 vars in 1131 bytes} [Mon Jun 27 15:11:01 2022] POST /identity/v3/roles => generated 225 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:11:01.540165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da7544-2b86-4b7d-adc8-1a2516797b5f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:01.540526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da7544-2b86-4b7d-adc8-1a2516797b5f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:01.540812 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da7544-2b86-4b7d-adc8-1a2516797b5f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:01.542880 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 18/36] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:01.548417 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddf138-0874-41da-ab8b-6be041ce7099 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:01.548778 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddf138-0874-41da-ab8b-6be041ce7099 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:01.549083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddf138-0874-41da-ab8b-6be041ce7099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:01.594625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3dddf138-0874-41da-ab8b-6be041ce7099 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:01.596244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3dddf138-0874-41da-ab8b-6be041ce7099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:01.619201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a26b83-bcf6-40b9-888f-ac1f38a2f5bd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:01.672300 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35b3dd-a102-4560-a08e-e8ceb5342d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:01.673451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35b3dd-a102-4560-a08e-e8ceb5342d51 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:01.674083 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35b3dd-a102-4560-a08e-e8ceb5342d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:01.674611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35b3dd-a102-4560-a08e-e8ceb5342d51 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:01.676214 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35b3dd-a102-4560-a08e-e8ceb5342d51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:01.678161 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35b3dd-a102-4560-a08e-e8ceb5342d51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:01.680184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35b3dd-a102-4560-a08e-e8ceb5342d51 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:01.696585 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 19/37] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:01.698541 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f06813-5ea7-4868-b00e-f7596abab02a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:01.699068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f06813-5ea7-4868-b00e-f7596abab02a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:01.699644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f06813-5ea7-4868-b00e-f7596abab02a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:01.701503 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 20/38] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:01.702676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f06813-5ea7-4868-b00e-f7596abab02a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:01.718169 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 19/39] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:01.719775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e211f-b4a4-438b-9b44-0016ba7b54e3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:01.720074 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e211f-b4a4-438b-9b44-0016ba7b54e3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:01.720356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e211f-b4a4-438b-9b44-0016ba7b54e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:01.738294 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3d6e211f-b4a4-438b-9b44-0016ba7b54e3 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:01.739726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3d6e211f-b4a4-438b-9b44-0016ba7b54e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:01.783289 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:01.809795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:01.835229 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f06813-5ea7-4868-b00e-f7596abab02a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:01.841119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 20/40] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:01.841941 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e211f-b4a4-438b-9b44-0016ba7b54e3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:01.877048 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2d91b-94dd-4fc5-a280-27998d7bb8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:01.877943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2d91b-94dd-4fc5-a280-27998d7bb8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:01.878238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2d91b-94dd-4fc5-a280-27998d7bb8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:01.878540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2d91b-94dd-4fc5-a280-27998d7bb8b3 None admin] PATH_INFO: `/v3/users/9a202eb6836d4aa3a8bf60c71995def9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:01.880309 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2d91b-94dd-4fc5-a280-27998d7bb8b3 None admin] RBAC: Authorizing `identity:get_user(user_id=9a202eb6836d4aa3a8bf60c71995def9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:01.882410 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2d91b-94dd-4fc5-a280-27998d7bb8b3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:01.884344 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 21/41] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:01 2022] GET /identity/v3/users/9a202eb6836d4aa3a8bf60c71995def9 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:01.885243 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2d91b-94dd-4fc5-a280-27998d7bb8b3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:01.946246 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e211f-b4a4-438b-9b44-0016ba7b54e3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:01.981030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0da086-43c3-4adb-9f22-96c5ea783f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:01.981717 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0da086-43c3-4adb-9f22-96c5ea783f5d None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:01.982004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0da086-43c3-4adb-9f22-96c5ea783f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:01.982318 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0da086-43c3-4adb-9f22-96c5ea783f5d None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:01.983481 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0da086-43c3-4adb-9f22-96c5ea783f5d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:01.984920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0da086-43c3-4adb-9f22-96c5ea783f5d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:01.988985 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2d91b-94dd-4fc5-a280-27998d7bb8b3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:01.998964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 21/42] 10.222.0.33 () {60 vars in 1131 bytes} [Mon Jun 27 15:11:01 2022] POST /identity/v3/roles => generated 223 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:11:01.999802 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0da086-43c3-4adb-9f22-96c5ea783f5d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:02.047519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9560a-a4e2-4a6c-80c8-131c06c2495f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:02.048418 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9560a-a4e2-4a6c-80c8-131c06c2495f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:02.048904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9560a-a4e2-4a6c-80c8-131c06c2495f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:02.049280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9560a-a4e2-4a6c-80c8-131c06c2495f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:02.051007 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9560a-a4e2-4a6c-80c8-131c06c2495f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:02.052683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9560a-a4e2-4a6c-80c8-131c06c2495f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:02.054909 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 22/43] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:11:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:02.061521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9560a-a4e2-4a6c-80c8-131c06c2495f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:02.088049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:02.151352 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:02.242071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9560a-a4e2-4a6c-80c8-131c06c2495f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:02.261570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0da086-43c3-4adb-9f22-96c5ea783f5d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:02.289167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee8d74-60ff-43b6-98a2-b00bc203aee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:02.289861 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee8d74-60ff-43b6-98a2-b00bc203aee5 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:02.290155 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee8d74-60ff-43b6-98a2-b00bc203aee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:02.290473 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee8d74-60ff-43b6-98a2-b00bc203aee5 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:02.291206 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee8d74-60ff-43b6-98a2-b00bc203aee5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:02.296846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35f256-599e-4a6e-a9d0-b494450fe576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:02.297000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee8d74-60ff-43b6-98a2-b00bc203aee5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:02.297666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35f256-599e-4a6e-a9d0-b494450fe576 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:02.297952 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35f256-599e-4a6e-a9d0-b494450fe576 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:02.298244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35f256-599e-4a6e-a9d0-b494450fe576 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:02.299447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35f256-599e-4a6e-a9d0-b494450fe576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:02.300920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35f256-599e-4a6e-a9d0-b494450fe576 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:02.302862 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 22/44] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:11:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:02.308658 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35f256-599e-4a6e-a9d0-b494450fe576 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:02.330328 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 23/45] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 27 15:11:02 2022] POST /identity/v3/projects => generated 312 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:11:02.418741 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:02.426735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35f256-599e-4a6e-a9d0-b494450fe576 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:02.464210 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb791d82-94aa-4399-b38e-7293c5bb11d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:02.465121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791d82-94aa-4399-b38e-7293c5bb11d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:02.465409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791d82-94aa-4399-b38e-7293c5bb11d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:02.465698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791d82-94aa-4399-b38e-7293c5bb11d4 None admin] PATH_INFO: `/v3/domains/default/users/9a202eb6836d4aa3a8bf60c71995def9/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:02.468205 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb791d82-94aa-4399-b38e-7293c5bb11d4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9a202eb6836d4aa3a8bf60c71995def9, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:02.469722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb791d82-94aa-4399-b38e-7293c5bb11d4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:02.486138 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 23/46] 10.222.0.33 () {58 vars in 1361 bytes} [Mon Jun 27 15:11:02 2022] PUT /identity/v3/domains/default/users/9a202eb6836d4aa3a8bf60c71995def9/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:11:04.367833 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b540db-1ef9-43f4-ba1f-afc8f3aa0a30 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:04.368379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b540db-1ef9-43f4-ba1f-afc8f3aa0a30 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:04.368478 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b540db-1ef9-43f4-ba1f-afc8f3aa0a30 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:04.369872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 24/47] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:04.375448 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d458ecf-0811-466e-a7d1-80503b38e9b6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:04.375889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d458ecf-0811-466e-a7d1-80503b38e9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:04.376070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d458ecf-0811-466e-a7d1-80503b38e9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:04.394515 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4d458ecf-0811-466e-a7d1-80503b38e9b6 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:04.395826 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4d458ecf-0811-466e-a7d1-80503b38e9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:04.467087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 24/48] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:04.493686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b540db-1ef9-43f4-ba1f-afc8f3aa0a30 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:04.513881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30864a2-1b59-4ab1-8f31-758bb9e92af9 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:04.514185 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30864a2-1b59-4ab1-8f31-758bb9e92af9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:04.514514 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30864a2-1b59-4ab1-8f31-758bb9e92af9 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:04.515932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 25/49] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:04.521112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990198ac-f1ab-4d00-bbd4-13a457cb318b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:04.521410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990198ac-f1ab-4d00-bbd4-13a457cb318b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:04.521692 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990198ac-f1ab-4d00-bbd4-13a457cb318b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:04.538883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-990198ac-f1ab-4d00-bbd4-13a457cb318b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:04.540062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-990198ac-f1ab-4d00-bbd4-13a457cb318b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:04.564904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:04.600251 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b540db-1ef9-43f4-ba1f-afc8f3aa0a30 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:04.614806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 26/50] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:04.633507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fdd6b-bd13-43a9-8831-f7385feb9032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:04.634276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fdd6b-bd13-43a9-8831-f7385feb9032 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:04.634569 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fdd6b-bd13-43a9-8831-f7385feb9032 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:04.634849 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fdd6b-bd13-43a9-8831-f7385feb9032 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:04.636039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fdd6b-bd13-43a9-8831-f7385feb9032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:04.637810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fdd6b-bd13-43a9-8831-f7385feb9032 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:04.638103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990198ac-f1ab-4d00-bbd4-13a457cb318b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:04.639486 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 25/51] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:11:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:04.645062 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fdd6b-bd13-43a9-8831-f7385feb9032 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:04.653977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:04.744848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990198ac-f1ab-4d00-bbd4-13a457cb318b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:04.745057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fdd6b-bd13-43a9-8831-f7385feb9032 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:04.782292 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210dd70-261e-4589-b163-33dec75652c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:04.782511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8592f-411f-4309-9561-9c2cce587d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:04.783254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210dd70-261e-4589-b163-33dec75652c3 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:04.783458 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210dd70-261e-4589-b163-33dec75652c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:04.783545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8592f-411f-4309-9561-9c2cce587d7c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:04.783658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210dd70-261e-4589-b163-33dec75652c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:04.783738 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8592f-411f-4309-9561-9c2cce587d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:04.784123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8592f-411f-4309-9561-9c2cce587d7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:04.784384 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210dd70-261e-4589-b163-33dec75652c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:04.786017 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210dd70-261e-4589-b163-33dec75652c3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:04.791888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:04.798350 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8592f-411f-4309-9561-9c2cce587d7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:04.806823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2ad8592f-411f-4309-9561-9c2cce587d7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:04.806823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:04.806823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:04.806823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:04.806823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:04.806823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:04.806823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:04.806823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:04.806823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:04.806823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:04.806823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:04.806823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:04.806823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:04.806823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:04.806823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:04.806823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:04.808024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:04.808024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:04.808024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:04.808024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:04.808024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:04.808024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:04.808024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:04.808024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:04.808024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:04.808024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:04.808024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:04.808024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:04.808024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:04.808024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:04.808024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:04.808024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:04.808881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:04.808881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:04.808881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:04.808881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:04.808881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:04.808881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:04.808881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:04.808881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:04.808881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:04.808881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:04.808881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:04.808881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:04.808881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 27/52] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:11:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:11:04.814756 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8592f-411f-4309-9561-9c2cce587d7c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:04.834253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 26/53] 10.222.0.33 () {60 vars in 1140 bytes} [Mon Jun 27 15:11:04 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:11:04.903743 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:04.932356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8592f-411f-4309-9561-9c2cce587d7c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:04.974941 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a2897-3825-433a-a503-680943dae46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:04.975642 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a2897-3825-433a-a503-680943dae46d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:04.975932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a2897-3825-433a-a503-680943dae46d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:04.976191 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a2897-3825-433a-a503-680943dae46d None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:04.976960 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a2897-3825-433a-a503-680943dae46d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:04.977266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a2897-3825-433a-a503-680943dae46d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:04.978722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a2897-3825-433a-a503-680943dae46d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:04.988098 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 28/54] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:04.993954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210dd70-261e-4589-b163-33dec75652c3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:05.096495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210dd70-261e-4589-b163-33dec75652c3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:05.135684 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e6016-cdf9-43c5-acd2-c9c86cf02e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:05.136593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e6016-cdf9-43c5-acd2-c9c86cf02e3a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:05.136892 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e6016-cdf9-43c5-acd2-c9c86cf02e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:05.137171 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e6016-cdf9-43c5-acd2-c9c86cf02e3a None admin] PATH_INFO: `/v3/users/9a202eb6836d4aa3a8bf60c71995def9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:05.138451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e6016-cdf9-43c5-acd2-c9c86cf02e3a None admin] RBAC: Authorizing `identity:get_user(user_id=9a202eb6836d4aa3a8bf60c71995def9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:05.139931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e6016-cdf9-43c5-acd2-c9c86cf02e3a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:05.141588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:04 2022] GET /identity/v3/users/9a202eb6836d4aa3a8bf60c71995def9 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:05.147385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a2897-3825-433a-a503-680943dae46d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:05.257214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a2897-3825-433a-a503-680943dae46d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:05.297655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560841c-1561-4cbd-9ac5-502e34e3c0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:05.298530 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560841c-1561-4cbd-9ac5-502e34e3c0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:05.298820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560841c-1561-4cbd-9ac5-502e34e3c0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:05.299096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560841c-1561-4cbd-9ac5-502e34e3c0f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:05.300356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560841c-1561-4cbd-9ac5-502e34e3c0f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:05.302076 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560841c-1561-4cbd-9ac5-502e34e3c0f1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:05.304125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 29/56] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:11:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:05.310646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e6016-cdf9-43c5-acd2-c9c86cf02e3a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:05.378502 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:05.536544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e6016-cdf9-43c5-acd2-c9c86cf02e3a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:05.571038 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a618a9-9cb4-4e8b-80f9-8678a25ebbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:05.571707 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a618a9-9cb4-4e8b-80f9-8678a25ebbaa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:05.571999 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a618a9-9cb4-4e8b-80f9-8678a25ebbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:05.572275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a618a9-9cb4-4e8b-80f9-8678a25ebbaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:05.573115 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a618a9-9cb4-4e8b-80f9-8678a25ebbaa None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.domain.id=default, user.id=9a202eb6836d4aa3a8bf60c71995def9) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:05.573415 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a618a9-9cb4-4e8b-80f9-8678a25ebbaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:05.574927 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a618a9-9cb4-4e8b-80f9-8678a25ebbaa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:05.584008 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1322 bytes} [Mon Jun 27 15:11:05 2022] GET /identity/v3/role_assignments?user.id=9a202eb6836d4aa3a8bf60c71995def9&scope.domain.id=default&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 530 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:06.901952 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988dc85-c70d-4f7b-98c8-96b187b4d2c5 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:06.902584 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988dc85-c70d-4f7b-98c8-96b187b4d2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:06.902584 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988dc85-c70d-4f7b-98c8-96b187b4d2c5 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:06.903958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 30/58] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:06.910055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51b915-47df-4998-94fa-f712f971d140 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:06.910604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51b915-47df-4998-94fa-f712f971d140 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:06.910685 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51b915-47df-4998-94fa-f712f971d140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:06.929624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2f51b915-47df-4998-94fa-f712f971d140 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:06.931255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2f51b915-47df-4998-94fa-f712f971d140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:07.007044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 29/59] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:07.032156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988dc85-c70d-4f7b-98c8-96b187b4d2c5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:07.036561 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:07.151148 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988dc85-c70d-4f7b-98c8-96b187b4d2c5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:07.189617 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37a3fe-2abd-467f-b558-d9a1e9dae474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:07.190383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37a3fe-2abd-467f-b558-d9a1e9dae474 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:07.190674 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37a3fe-2abd-467f-b558-d9a1e9dae474 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:07.190952 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37a3fe-2abd-467f-b558-d9a1e9dae474 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:07.192271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37a3fe-2abd-467f-b558-d9a1e9dae474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:07.193776 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37a3fe-2abd-467f-b558-d9a1e9dae474 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:07.195463 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 31/60] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:11:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:07.201461 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51b915-47df-4998-94fa-f712f971d140 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:07.253640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:07.316863 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51b915-47df-4998-94fa-f712f971d140 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:07.353636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386dc6b-31f0-4dc1-83e4-d1baa003ec67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:07.354358 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386dc6b-31f0-4dc1-83e4-d1baa003ec67 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:07.354642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386dc6b-31f0-4dc1-83e4-d1baa003ec67 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:07.354901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386dc6b-31f0-4dc1-83e4-d1baa003ec67 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:07.355629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386dc6b-31f0-4dc1-83e4-d1baa003ec67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:07.357104 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386dc6b-31f0-4dc1-83e4-d1baa003ec67 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:07.384045 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 30/61] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:11:07 2022] POST /identity/v3/users => generated 275 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:11:10.843318 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca565ff-2108-42ea-a102-ea46bc60e09e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:10.844959 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca565ff-2108-42ea-a102-ea46bc60e09e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:10.845763 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca565ff-2108-42ea-a102-ea46bc60e09e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:10.849316 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 32/62] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:10.855803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ac484-4b34-45a6-b2c2-7b77d6953b89 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:10.857219 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ac484-4b34-45a6-b2c2-7b77d6953b89 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:10.857745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ac484-4b34-45a6-b2c2-7b77d6953b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:10.879249 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-142ac484-4b34-45a6-b2c2-7b77d6953b89 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:10.880902 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-142ac484-4b34-45a6-b2c2-7b77d6953b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:10.939199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9b60a-064a-4557-9c30-576344ac7d30 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:10.939847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9b60a-064a-4557-9c30-576344ac7d30 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:10.940321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9b60a-064a-4557-9c30-576344ac7d30 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:10.942046 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 33/63] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:11:10.947926 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87dc9c-2b22-4005-8592-822e0c7aad6f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:10.948523 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87dc9c-2b22-4005-8592-822e0c7aad6f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:10.949020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87dc9c-2b22-4005-8592-822e0c7aad6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:10.973205 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-db87dc9c-2b22-4005-8592-822e0c7aad6f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:10.976840 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-db87dc9c-2b22-4005-8592-822e0c7aad6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:11.014782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 31/64] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:11.038094 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ac484-4b34-45a6-b2c2-7b77d6953b89 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:11.095364 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 34/65] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:11.097508 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79d533-752b-40ef-a4f8-9912e83157a0 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:11.098047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79d533-752b-40ef-a4f8-9912e83157a0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:11.098646 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79d533-752b-40ef-a4f8-9912e83157a0 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:11.100277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 35/66] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:11.103535 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:11.123951 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ed7b1-f5fd-4862-8338-6ed5a22dada1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:11.124831 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ed7b1-f5fd-4862-8338-6ed5a22dada1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:11.125629 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ed7b1-f5fd-4862-8338-6ed5a22dada1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:11.134404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:11.154703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-452ed7b1-f5fd-4862-8338-6ed5a22dada1 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:11.157103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-452ed7b1-f5fd-4862-8338-6ed5a22dada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:11.232481 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ac484-4b34-45a6-b2c2-7b77d6953b89 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:11.256192 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 36/67] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:11.257692 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ed7b1-f5fd-4862-8338-6ed5a22dada1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:11.302197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac3c13-c48d-47d9-a9d3-5564d3ca5427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:11.303484 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac3c13-c48d-47d9-a9d3-5564d3ca5427 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:11.303959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac3c13-c48d-47d9-a9d3-5564d3ca5427 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:11.304402 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac3c13-c48d-47d9-a9d3-5564d3ca5427 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:11.316708 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac3c13-c48d-47d9-a9d3-5564d3ca5427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:11.325266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a6ac3c13-c48d-47d9-a9d3-5564d3ca5427 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:11.325266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:11.325266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:11.325266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:11.325266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:11.325266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:11.325266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:11.325266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:11.325266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:11.325266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:11.325266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:11.325266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:11.325266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:11.325266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:11.325266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:11.325266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:11.326336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:11.326336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:11.326336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:11.326336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:11.326336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:11.326336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:11.326336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:11.326336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:11.326336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:11.326336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:11.326336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:11.326336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:11.326336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:11.326336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:11.326336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:11.326336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:11.327288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:11.327288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:11.327288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:11.327288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:11.327288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:11.327288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:11.327288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:11.327288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:11.327288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:11.327288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:11.327288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:11.327288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:11.329305 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 32/68] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:11:11.330868 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff14f6-1302-466c-814f-e1e8dc9e46ed None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:11.331157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff14f6-1302-466c-814f-e1e8dc9e46ed None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:11.331437 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff14f6-1302-466c-814f-e1e8dc9e46ed None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:11.333609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 33/69] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:11.334447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff14f6-1302-466c-814f-e1e8dc9e46ed None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:11.375531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ed7b1-f5fd-4862-8338-6ed5a22dada1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:11.409156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:11.415883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed91b64-6f0f-4283-b3f6-41ae962ac974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:11.416708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed91b64-6f0f-4283-b3f6-41ae962ac974 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:11.416996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed91b64-6f0f-4283-b3f6-41ae962ac974 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:11.417283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed91b64-6f0f-4283-b3f6-41ae962ac974 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:11.428878 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed91b64-6f0f-4283-b3f6-41ae962ac974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:11.436889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-aed91b64-6f0f-4283-b3f6-41ae962ac974 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:11.436889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:11.436889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:11.436889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:11.436889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:11.436889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:11.436889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:11.436889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:11.436889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:11.436889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:11.436889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:11.436889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:11.436889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:11.436889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:11.436889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:11.436889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:11.437766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:11.437766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:11.437766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:11.437766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:11.437766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:11.437766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:11.437766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:11.437766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:11.437766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:11.437766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:11.437766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:11.437766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:11.437766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:11.437766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:11.437766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:11.437766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:11.438546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:11.438546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:11.438546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:11.438546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:11.438546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:11.438546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:11.438546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:11.438546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:11.438546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:11.438546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:11.438546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:11.438546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:11.438546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 37/70] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:11:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:11.439185 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed91b64-6f0f-4283-b3f6-41ae962ac974 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:11.449397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:11.457515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff14f6-1302-466c-814f-e1e8dc9e46ed None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:11.504074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bec32-806d-48c8-89ff-dce975c53274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:11.504980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bec32-806d-48c8-89ff-dce975c53274 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:11.505269 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bec32-806d-48c8-89ff-dce975c53274 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:11.505550 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bec32-806d-48c8-89ff-dce975c53274 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:11.519509 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bec32-806d-48c8-89ff-dce975c53274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:11.527560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e86bec32-806d-48c8-89ff-dce975c53274 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:11.527560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:11.527560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:11.527560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:11.527560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:11.527560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:11.527560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:11.527560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:11.527560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:11.527560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:11.527560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:11.527560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:11.527560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:11.527560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:11.527560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:11.527560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:11.528560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:11.528560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:11.528560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:11.528560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:11.528560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:11.528560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:11.528560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:11.528560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:11.528560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:11.528560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:11.528560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:11.528560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:11.528560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:11.528560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:11.528560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:11.528560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:11.529321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:11.529321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:11.529321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:11.529321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:11.529321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:11.529321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:11.529321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:11.529321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:11.529321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:11.529321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:11.529321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:11.529321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:11.529321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 34/71] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:11.530118 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946515d-2126-4206-b074-d6ac9b569e86 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:11.530338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946515d-2126-4206-b074-d6ac9b569e86 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:11.530600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946515d-2126-4206-b074-d6ac9b569e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:11.547694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d946515d-2126-4206-b074-d6ac9b569e86 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:11.548927 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d946515d-2126-4206-b074-d6ac9b569e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:11.568813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed91b64-6f0f-4283-b3f6-41ae962ac974 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:11.602870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef31f8-1938-4bfa-9754-7ec1c19ba7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:11.603563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef31f8-1938-4bfa-9754-7ec1c19ba7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:11.603855 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef31f8-1938-4bfa-9754-7ec1c19ba7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:11.604138 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef31f8-1938-4bfa-9754-7ec1c19ba7a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:11.604910 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef31f8-1938-4bfa-9754-7ec1c19ba7a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:11.605224 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef31f8-1938-4bfa-9754-7ec1c19ba7a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:11.606657 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef31f8-1938-4bfa-9754-7ec1c19ba7a9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:11.615416 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 38/72] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:11.616235 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef31f8-1938-4bfa-9754-7ec1c19ba7a9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:11.627648 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 35/73] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:11.628931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe852967-9d7e-4002-9987-d087e41f3b19 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:11.629226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe852967-9d7e-4002-9987-d087e41f3b19 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:11.629583 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe852967-9d7e-4002-9987-d087e41f3b19 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:11.631124 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 36/74] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:11.631124 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe852967-9d7e-4002-9987-d087e41f3b19 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:11.693013 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:11.740762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef31f8-1938-4bfa-9754-7ec1c19ba7a9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:11.742885 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:11.760240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe852967-9d7e-4002-9987-d087e41f3b19 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:11.775907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845e5a2-dc31-49fc-8e22-36148d7de1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:11.776622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845e5a2-dc31-49fc-8e22-36148d7de1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:11.776914 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845e5a2-dc31-49fc-8e22-36148d7de1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:11.777186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845e5a2-dc31-49fc-8e22-36148d7de1c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:11.777944 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845e5a2-dc31-49fc-8e22-36148d7de1c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:11.778281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845e5a2-dc31-49fc-8e22-36148d7de1c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:11.779739 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845e5a2-dc31-49fc-8e22-36148d7de1c1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:11.788145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 39/75] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:11.788968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845e5a2-dc31-49fc-8e22-36148d7de1c1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:11.794101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4ddf5-b76d-4f85-a0cb-df93d7ce1b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:11.794825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4ddf5-b76d-4f85-a0cb-df93d7ce1b91 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:11.795114 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4ddf5-b76d-4f85-a0cb-df93d7ce1b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:11.795394 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4ddf5-b76d-4f85-a0cb-df93d7ce1b91 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:11.796185 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4ddf5-b76d-4f85-a0cb-df93d7ce1b91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:11.796500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4ddf5-b76d-4f85-a0cb-df93d7ce1b91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:11.797912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4ddf5-b76d-4f85-a0cb-df93d7ce1b91 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:11.806707 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 37/76] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:11.807771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521639dd-a6c8-4cf7-be0e-14a94e3a345c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:11.808057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521639dd-a6c8-4cf7-be0e-14a94e3a345c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:11.808339 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521639dd-a6c8-4cf7-be0e-14a94e3a345c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:11.824834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-521639dd-a6c8-4cf7-be0e-14a94e3a345c None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:11.826035 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-521639dd-a6c8-4cf7-be0e-14a94e3a345c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:11.918342 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 38/77] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:11.918342 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521639dd-a6c8-4cf7-be0e-14a94e3a345c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:11.919040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845e5a2-dc31-49fc-8e22-36148d7de1c1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:11.920733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:11.939506 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123d5a5-aea6-433e-8e2c-722a1a10a17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:11.940411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123d5a5-aea6-433e-8e2c-722a1a10a17f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:11.940707 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123d5a5-aea6-433e-8e2c-722a1a10a17f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:11.940990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123d5a5-aea6-433e-8e2c-722a1a10a17f None admin] PATH_INFO: `/v3/users/b837aa4151fc426f856f309fe1286c92` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:11.954991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123d5a5-aea6-433e-8e2c-722a1a10a17f None admin] RBAC: Authorizing `identity:get_user(user_id=b837aa4151fc426f856f309fe1286c92)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:11.956492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123d5a5-aea6-433e-8e2c-722a1a10a17f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:11.958412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 40/78] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:11 2022] GET /identity/v3/users/b837aa4151fc426f856f309fe1286c92 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:11.959221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123d5a5-aea6-433e-8e2c-722a1a10a17f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:11.984196 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:12.008457 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521639dd-a6c8-4cf7-be0e-14a94e3a345c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:12.043685 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552c17a-9004-4870-99d1-f70f2a6bac36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:12.044533 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552c17a-9004-4870-99d1-f70f2a6bac36 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:12.044826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552c17a-9004-4870-99d1-f70f2a6bac36 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:12.045109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552c17a-9004-4870-99d1-f70f2a6bac36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:12.057411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552c17a-9004-4870-99d1-f70f2a6bac36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:12.066116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6552c17a-9004-4870-99d1-f70f2a6bac36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:12.066116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:12.066116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:12.066116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:12.066116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:12.066116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:12.066116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:12.066116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:12.066116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:12.066116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:12.066116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:12.066116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:12.066116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:12.066116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:12.066116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:12.066116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:12.067966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:12.067966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:12.067966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:12.067966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:12.067966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:12.067966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:12.067966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:12.067966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:12.067966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:12.067966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:12.067966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:12.067966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:12.067966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:12.067966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:12.067966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:12.067966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:12.068824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:12.068824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:12.068824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:12.068824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:12.068824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:12.068824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:12.068824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:12.068824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:12.068824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:12.068824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:12.068824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:12.068824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:12.068824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 39/79] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:11:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:12.068824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552c17a-9004-4870-99d1-f70f2a6bac36 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:12.087099 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123d5a5-aea6-433e-8e2c-722a1a10a17f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:12.127532 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb40eb-60dd-419f-9550-db919b4972b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:12.128447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb40eb-60dd-419f-9550-db919b4972b7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:12.128737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb40eb-60dd-419f-9550-db919b4972b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:12.129017 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb40eb-60dd-419f-9550-db919b4972b7 None admin] PATH_INFO: `/v3/users/9a202eb6836d4aa3a8bf60c71995def9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:12.130531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb40eb-60dd-419f-9550-db919b4972b7 None admin] RBAC: Authorizing `identity:get_user(user_id=9a202eb6836d4aa3a8bf60c71995def9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:12.132003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb40eb-60dd-419f-9550-db919b4972b7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:12.133679 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 41/80] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:11 2022] GET /identity/v3/users/9a202eb6836d4aa3a8bf60c71995def9 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:12.134476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb40eb-60dd-419f-9550-db919b4972b7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:12.179731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552c17a-9004-4870-99d1-f70f2a6bac36 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:12.186204 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:12.215935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec464899-4110-4395-927e-c8b170f82fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:12.216849 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec464899-4110-4395-927e-c8b170f82fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:12.217144 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec464899-4110-4395-927e-c8b170f82fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:12.217430 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec464899-4110-4395-927e-c8b170f82fd3 None admin] PATH_INFO: `/v3/users/b837aa4151fc426f856f309fe1286c92` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:12.218723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec464899-4110-4395-927e-c8b170f82fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=b837aa4151fc426f856f309fe1286c92)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:12.220232 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec464899-4110-4395-927e-c8b170f82fd3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:12.221911 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 40/81] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:12 2022] GET /identity/v3/users/b837aa4151fc426f856f309fe1286c92 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:12.226958 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec464899-4110-4395-927e-c8b170f82fd3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:12.233879 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:12.256399 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb40eb-60dd-419f-9550-db919b4972b7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:12.293372 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbf203-5288-4649-802f-18c1f854e59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:12.294184 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbf203-5288-4649-802f-18c1f854e59e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:12.294500 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbf203-5288-4649-802f-18c1f854e59e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:12.294777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbf203-5288-4649-802f-18c1f854e59e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:12.295958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbf203-5288-4649-802f-18c1f854e59e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:12.297470 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbf203-5288-4649-802f-18c1f854e59e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:12.299130 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 42/82] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:11:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:12.299890 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbf203-5288-4649-802f-18c1f854e59e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:12.330635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec464899-4110-4395-927e-c8b170f82fd3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:12.365650 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881e046-f615-47c4-a3ee-f06789da9cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:12.366345 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881e046-f615-47c4-a3ee-f06789da9cfc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:12.366621 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881e046-f615-47c4-a3ee-f06789da9cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:12.366906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881e046-f615-47c4-a3ee-f06789da9cfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:12.405738 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbf203-5288-4649-802f-18c1f854e59e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:12.417328 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:12.440513 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881e046-f615-47c4-a3ee-f06789da9cfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:12.442184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881e046-f615-47c4-a3ee-f06789da9cfc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:12.444373 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34590e-bb2b-40df-a153-fcae7a84cecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:12.445064 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34590e-bb2b-40df-a153-fcae7a84cecf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:12.445358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34590e-bb2b-40df-a153-fcae7a84cecf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:12.445644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34590e-bb2b-40df-a153-fcae7a84cecf None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:12.446439 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34590e-bb2b-40df-a153-fcae7a84cecf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:12.446755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34590e-bb2b-40df-a153-fcae7a84cecf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:12.448174 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34590e-bb2b-40df-a153-fcae7a84cecf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:12.451039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:12.457376 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 43/83] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:11:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:12.458902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34590e-bb2b-40df-a153-fcae7a84cecf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:12.549725 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 41/84] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:12.550635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881e046-f615-47c4-a3ee-f06789da9cfc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:12.568812 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34590e-bb2b-40df-a153-fcae7a84cecf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:12.603172 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8b6bd-238d-4001-9ed2-820453fd4c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:12.603835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8b6bd-238d-4001-9ed2-820453fd4c52 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:12.604141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8b6bd-238d-4001-9ed2-820453fd4c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:12.604424 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8b6bd-238d-4001-9ed2-820453fd4c52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:12.645509 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:12.652308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881e046-f615-47c4-a3ee-f06789da9cfc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:12.659899 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:12.672841 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8b6bd-238d-4001-9ed2-820453fd4c52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:12.674416 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8b6bd-238d-4001-9ed2-820453fd4c52 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:12.688803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98cfc1-2853-413c-adf6-617161d76420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:12.689475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98cfc1-2853-413c-adf6-617161d76420 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:12.689761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98cfc1-2853-413c-adf6-617161d76420 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:12.690040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98cfc1-2853-413c-adf6-617161d76420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:12.758507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98cfc1-2853-413c-adf6-617161d76420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:12.759921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98cfc1-2853-413c-adf6-617161d76420 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:12.778040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 44/85] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:12.778952 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8b6bd-238d-4001-9ed2-820453fd4c52 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:12.858513 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:12.875740 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 42/86] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:12.876629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98cfc1-2853-413c-adf6-617161d76420 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:12.885495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:12.892577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8b6bd-238d-4001-9ed2-820453fd4c52 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:12.927656 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739745-43c1-4a07-8d42-aed3cd13bdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:12.928340 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739745-43c1-4a07-8d42-aed3cd13bdbd None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:12.928616 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739745-43c1-4a07-8d42-aed3cd13bdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:12.928895 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739745-43c1-4a07-8d42-aed3cd13bdbd None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:12.929637 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13739745-43c1-4a07-8d42-aed3cd13bdbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:12.931141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13739745-43c1-4a07-8d42-aed3cd13bdbd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:12.959447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 45/87] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:11:12 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:11:12.960297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739745-43c1-4a07-8d42-aed3cd13bdbd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:12.989040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98cfc1-2853-413c-adf6-617161d76420 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:13.029854 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdbe1a-2305-4994-9fc9-a4955c354010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:13.030732 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdbe1a-2305-4994-9fc9-a4955c354010 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:13.031025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdbe1a-2305-4994-9fc9-a4955c354010 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:13.031316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdbe1a-2305-4994-9fc9-a4955c354010 None admin] PATH_INFO: `/v3/users/b837aa4151fc426f856f309fe1286c92` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:13.032664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdbe1a-2305-4994-9fc9-a4955c354010 None admin] RBAC: Authorizing `identity:get_user(user_id=b837aa4151fc426f856f309fe1286c92)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:13.034181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdbe1a-2305-4994-9fc9-a4955c354010 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:13.036120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 43/88] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:12 2022] GET /identity/v3/users/b837aa4151fc426f856f309fe1286c92 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:13.038651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdbe1a-2305-4994-9fc9-a4955c354010 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:13.097439 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739745-43c1-4a07-8d42-aed3cd13bdbd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:13.137777 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:13.141094 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:13.155110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf3130-7aca-409c-a9d7-857c78af3d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:13.155312 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf3130-7aca-409c-a9d7-857c78af3d63 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:13.155599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf3130-7aca-409c-a9d7-857c78af3d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:13.155883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf3130-7aca-409c-a9d7-857c78af3d63 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:13.157170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf3130-7aca-409c-a9d7-857c78af3d63 None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:13.159307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf3130-7aca-409c-a9d7-857c78af3d63 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:13.162336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 46/89] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:12 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:13.163193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf3130-7aca-409c-a9d7-857c78af3d63 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:13.181349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdbe1a-2305-4994-9fc9-a4955c354010 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:13.225806 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52665f-d9d1-4de5-8b2d-88b4c0fdcba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:13.226788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52665f-d9d1-4de5-8b2d-88b4c0fdcba8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:13.227081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52665f-d9d1-4de5-8b2d-88b4c0fdcba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:13.227393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52665f-d9d1-4de5-8b2d-88b4c0fdcba8 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:13.228693 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52665f-d9d1-4de5-8b2d-88b4c0fdcba8 None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:13.230196 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52665f-d9d1-4de5-8b2d-88b4c0fdcba8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:13.232028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 44/90] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:13 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:13.232844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52665f-d9d1-4de5-8b2d-88b4c0fdcba8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:13.301848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf3130-7aca-409c-a9d7-857c78af3d63 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:13.348908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e145b39-e965-49db-abbb-b10d723da13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:13.349903 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e145b39-e965-49db-abbb-b10d723da13b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:13.350197 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e145b39-e965-49db-abbb-b10d723da13b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:13.350509 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e145b39-e965-49db-abbb-b10d723da13b None admin] PATH_INFO: `/v3/projects/896c28e85208446ab9ea4cb7205d2e3e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:13.351895 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e145b39-e965-49db-abbb-b10d723da13b None admin] RBAC: Authorizing `identity:get_project(project_id=896c28e85208446ab9ea4cb7205d2e3e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:13.353473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e145b39-e965-49db-abbb-b10d723da13b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:13.355614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 47/91] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:13 2022] GET /identity/v3/projects/896c28e85208446ab9ea4cb7205d2e3e => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:13.356246 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e145b39-e965-49db-abbb-b10d723da13b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:13.366626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52665f-d9d1-4de5-8b2d-88b4c0fdcba8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:13.411021 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de9703-eb37-4819-a0a1-01aa22c5a096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:13.411702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de9703-eb37-4819-a0a1-01aa22c5a096 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:13.411995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de9703-eb37-4819-a0a1-01aa22c5a096 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:13.412283 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de9703-eb37-4819-a0a1-01aa22c5a096 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:13.429347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:13.440907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:13.488131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e145b39-e965-49db-abbb-b10d723da13b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:13.510035 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de9703-eb37-4819-a0a1-01aa22c5a096 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:13.511757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de9703-eb37-4819-a0a1-01aa22c5a096 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:13.535466 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b319d9-d0b2-4a35-a683-9ac72c400487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:13.537239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b319d9-d0b2-4a35-a683-9ac72c400487 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:13.538343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b319d9-d0b2-4a35-a683-9ac72c400487 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:13.538652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b319d9-d0b2-4a35-a683-9ac72c400487 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:13.539867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b319d9-d0b2-4a35-a683-9ac72c400487 None admin] RBAC: Adding query filter params (role.id=bb946622ce1842cba751c5f862237f14, scope.project.id=0b20137a36384531941036a989526bd2, user.id=b837aa4151fc426f856f309fe1286c92) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:13.540314 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b319d9-d0b2-4a35-a683-9ac72c400487 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:13.542802 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b319d9-d0b2-4a35-a683-9ac72c400487 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:13.550464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 48/92] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:13 2022] GET /identity/v3/role_assignments?user.id=b837aa4151fc426f856f309fe1286c92&scope.project.id=0b20137a36384531941036a989526bd2&role.id=bb946622ce1842cba751c5f862237f14 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:13.552010 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b319d9-d0b2-4a35-a683-9ac72c400487 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:13.699191 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b319d9-d0b2-4a35-a683-9ac72c400487 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:13.733598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:13.744748 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac07fe7-1f75-4ddf-b14a-bdd0a603c792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:13.745956 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac07fe7-1f75-4ddf-b14a-bdd0a603c792 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:13.746431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac07fe7-1f75-4ddf-b14a-bdd0a603c792 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:13.746815 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac07fe7-1f75-4ddf-b14a-bdd0a603c792 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:13.748326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac07fe7-1f75-4ddf-b14a-bdd0a603c792 None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=0b20137a36384531941036a989526bd2, user.id=9a202eb6836d4aa3a8bf60c71995def9) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:13.748788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac07fe7-1f75-4ddf-b14a-bdd0a603c792 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:13.750411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac07fe7-1f75-4ddf-b14a-bdd0a603c792 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:13.752507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 45/93] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:13.753490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de9703-eb37-4819-a0a1-01aa22c5a096 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:13.767003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 49/94] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:13 2022] GET /identity/v3/role_assignments?user.id=9a202eb6836d4aa3a8bf60c71995def9&scope.project.id=0b20137a36384531941036a989526bd2&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:13.770199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac07fe7-1f75-4ddf-b14a-bdd0a603c792 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:13.824574 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:13.953827 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de9703-eb37-4819-a0a1-01aa22c5a096 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:13.993573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06913577-f4a0-4d41-8dc9-96bf004963c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:13.994456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06913577-f4a0-4d41-8dc9-96bf004963c5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:13.994558 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06913577-f4a0-4d41-8dc9-96bf004963c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:13.994869 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06913577-f4a0-4d41-8dc9-96bf004963c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:13.995773 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06913577-f4a0-4d41-8dc9-96bf004963c5 None admin] RBAC: Adding query filter params (role.id=bb946622ce1842cba751c5f862237f14, scope.project.id=896c28e85208446ab9ea4cb7205d2e3e, user.id=b837aa4151fc426f856f309fe1286c92) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:13.996106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06913577-f4a0-4d41-8dc9-96bf004963c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:13.997624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06913577-f4a0-4d41-8dc9-96bf004963c5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:14.003611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac07fe7-1f75-4ddf-b14a-bdd0a603c792 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:14.004401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 46/95] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:13 2022] GET /identity/v3/role_assignments?user.id=b837aa4151fc426f856f309fe1286c92&scope.project.id=896c28e85208446ab9ea4cb7205d2e3e&role.id=bb946622ce1842cba751c5f862237f14 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:14.071195 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f1110-ac07-4fad-bc39-86429fc28354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:14.072571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f1110-ac07-4fad-bc39-86429fc28354 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:14.073100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f1110-ac07-4fad-bc39-86429fc28354 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:14.073573 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f1110-ac07-4fad-bc39-86429fc28354 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:14.075410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f1110-ac07-4fad-bc39-86429fc28354 None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:14.077223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f1110-ac07-4fad-bc39-86429fc28354 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:14.079600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 50/96] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:13 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:14.087212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06913577-f4a0-4d41-8dc9-96bf004963c5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:14.237434 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06913577-f4a0-4d41-8dc9-96bf004963c5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:14.249148 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:14.285152 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e9786-1fb3-4000-bb4e-42a15ad65482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:14.286430 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e9786-1fb3-4000-bb4e-42a15ad65482 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:14.286913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e9786-1fb3-4000-bb4e-42a15ad65482 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:14.287377 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e9786-1fb3-4000-bb4e-42a15ad65482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:14.288460 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e9786-1fb3-4000-bb4e-42a15ad65482 None admin] RBAC: Adding query filter params (role.id=0763e374972f4ce29ab449e27fd89355, scope.project.id=0b20137a36384531941036a989526bd2, user.id=b837aa4151fc426f856f309fe1286c92) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:14.288982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e9786-1fb3-4000-bb4e-42a15ad65482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:14.290709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e9786-1fb3-4000-bb4e-42a15ad65482 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:14.301914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 47/97] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:14 2022] GET /identity/v3/role_assignments?user.id=b837aa4151fc426f856f309fe1286c92&scope.project.id=0b20137a36384531941036a989526bd2&role.id=0763e374972f4ce29ab449e27fd89355 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:15.688408 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bb910-7d4b-4831-86f7-776f011680f9 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:15.689415 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bb910-7d4b-4831-86f7-776f011680f9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:15.689921 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bb910-7d4b-4831-86f7-776f011680f9 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:15.691654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 51/98] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:15.697576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdd8bc-0595-4ace-a77c-aa373203b479 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:15.698521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdd8bc-0595-4ace-a77c-aa373203b479 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:15.699037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdd8bc-0595-4ace-a77c-aa373203b479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:15.723487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-84bdd8bc-0595-4ace-a77c-aa373203b479 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:15.725114 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-84bdd8bc-0595-4ace-a77c-aa373203b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:15.819508 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 48/99] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:15.854980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bb910-7d4b-4831-86f7-776f011680f9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:15.883003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c71e1-6c25-46c4-b62e-953cab23c4e3 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:15.883629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c71e1-6c25-46c4-b62e-953cab23c4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:15.884123 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c71e1-6c25-46c4-b62e-953cab23c4e3 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:15.885759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 49/100] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:11:15.891459 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95dd3-f9fe-4df1-92bb-b18280648a09 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:15.892070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95dd3-f9fe-4df1-92bb-b18280648a09 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:15.892535 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95dd3-f9fe-4df1-92bb-b18280648a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:15.919865 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bac95dd3-f9fe-4df1-92bb-b18280648a09 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:15.922517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bac95dd3-f9fe-4df1-92bb-b18280648a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:15.978421 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:16.037336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bb910-7d4b-4831-86f7-776f011680f9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:16.053261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 50/101] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:16.073088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ef4c4-269c-45cf-8a17-57e1e90bce3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:16.074273 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ef4c4-269c-45cf-8a17-57e1e90bce3c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:16.074751 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ef4c4-269c-45cf-8a17-57e1e90bce3c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:16.075216 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ef4c4-269c-45cf-8a17-57e1e90bce3c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:16.086413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ef4c4-269c-45cf-8a17-57e1e90bce3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:16.089476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac95dd3-f9fe-4df1-92bb-b18280648a09 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:16.094590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-390ef4c4-269c-45cf-8a17-57e1e90bce3c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:16.094590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:16.094590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:16.094590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:16.094590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:16.094590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:16.094590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:16.094590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:16.094590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:16.094590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:16.094590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:16.094590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:16.094590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:16.094590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:16.094590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:16.094590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:16.095444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:16.095444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:16.095444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:16.095444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:16.095444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:16.095444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:16.095444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:16.095444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:16.095444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:16.095444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:16.095444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:16.095444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:16.095444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:16.095444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:16.095444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:16.095444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:16.096203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:16.096203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:16.096203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:16.096203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:16.096203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:16.096203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:16.096203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:16.096203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:16.096203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:16.096203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:16.096203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:16.096203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:16.098925 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 52/102] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:16.107614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ef4c4-269c-45cf-8a17-57e1e90bce3c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:16.146500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:16.276587 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac95dd3-f9fe-4df1-92bb-b18280648a09 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:16.285702 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ef4c4-269c-45cf-8a17-57e1e90bce3c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:16.311886 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:16.367916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdb450-3dfa-47c6-a385-4a6ef36175bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:16.368950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdb450-3dfa-47c6-a385-4a6ef36175bc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:16.369239 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdb450-3dfa-47c6-a385-4a6ef36175bc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:16.369518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdb450-3dfa-47c6-a385-4a6ef36175bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:16.370772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdb450-3dfa-47c6-a385-4a6ef36175bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:16.372450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdb450-3dfa-47c6-a385-4a6ef36175bc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:16.374128 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 51/103] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:11:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:16.375677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2897ebe-4248-404e-8867-c31fcce2e3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:16.376401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2897ebe-4248-404e-8867-c31fcce2e3fc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:16.376709 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2897ebe-4248-404e-8867-c31fcce2e3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:16.376992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2897ebe-4248-404e-8867-c31fcce2e3fc None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:16.377790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2897ebe-4248-404e-8867-c31fcce2e3fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:16.378106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2897ebe-4248-404e-8867-c31fcce2e3fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:16.379682 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2897ebe-4248-404e-8867-c31fcce2e3fc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:16.379941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdb450-3dfa-47c6-a385-4a6ef36175bc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:16.400636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 53/104] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:16.407267 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2897ebe-4248-404e-8867-c31fcce2e3fc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:16.554708 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:16.559997 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdb450-3dfa-47c6-a385-4a6ef36175bc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:16.631802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aca06-0382-4582-8fa8-a47843695fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:16.632519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aca06-0382-4582-8fa8-a47843695fe1 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:16.632806 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aca06-0382-4582-8fa8-a47843695fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:16.633083 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aca06-0382-4582-8fa8-a47843695fe1 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:16.633843 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aca06-0382-4582-8fa8-a47843695fe1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:16.635423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aca06-0382-4582-8fa8-a47843695fe1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:16.671449 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2897ebe-4248-404e-8867-c31fcce2e3fc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:16.689733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 52/105] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 27 15:11:16 2022] POST /identity/v3/projects => generated 302 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:11:16.698610 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814cb46-d14a-46ba-9f08-63735473a978 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:16.699671 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814cb46-d14a-46ba-9f08-63735473a978 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:16.700175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814cb46-d14a-46ba-9f08-63735473a978 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:16.701881 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 53/106] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:11:16.709354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb2753-7e5f-4a53-833a-b377d1ce59d9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:16.710001 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb2753-7e5f-4a53-833a-b377d1ce59d9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:16.710530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb2753-7e5f-4a53-833a-b377d1ce59d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:16.729861 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c7cb2753-7e5f-4a53-833a-b377d1ce59d9 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:16.731744 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c7cb2753-7e5f-4a53-833a-b377d1ce59d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:16.764308 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d367aa0-48b2-4f4a-8b1c-f67e54e54a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:16.765216 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d367aa0-48b2-4f4a-8b1c-f67e54e54a3a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:16.765491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d367aa0-48b2-4f4a-8b1c-f67e54e54a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:16.765773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d367aa0-48b2-4f4a-8b1c-f67e54e54a3a None admin] PATH_INFO: `/v3/users/31e7b636d4d3447ebd60ebae1b00a603` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:16.796224 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d367aa0-48b2-4f4a-8b1c-f67e54e54a3a None admin] RBAC: Authorizing `identity:get_user(user_id=31e7b636d4d3447ebd60ebae1b00a603)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:16.802394 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d367aa0-48b2-4f4a-8b1c-f67e54e54a3a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:16.805188 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 54/107] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:16 2022] GET /identity/v3/users/31e7b636d4d3447ebd60ebae1b00a603 => generated 289 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:16.810796 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d367aa0-48b2-4f4a-8b1c-f67e54e54a3a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:16.834321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 54/108] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:16.871876 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb2753-7e5f-4a53-833a-b377d1ce59d9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:16.898454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:17.020354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d367aa0-48b2-4f4a-8b1c-f67e54e54a3a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:17.029531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:17.063862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb2753-7e5f-4a53-833a-b377d1ce59d9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:17.072547 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c872c-ba22-4056-a8e5-b56d9e49ee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:17.073599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c872c-ba22-4056-a8e5-b56d9e49ee64 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:17.074314 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c872c-ba22-4056-a8e5-b56d9e49ee64 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:17.074799 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c872c-ba22-4056-a8e5-b56d9e49ee64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:17.122390 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11dfc4-5588-44eb-bb4b-199f9e3052b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:17.123723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11dfc4-5588-44eb-bb4b-199f9e3052b0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:17.124207 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11dfc4-5588-44eb-bb4b-199f9e3052b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:17.124900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11dfc4-5588-44eb-bb4b-199f9e3052b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:17.159610 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11dfc4-5588-44eb-bb4b-199f9e3052b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:17.168037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ed11dfc4-5588-44eb-bb4b-199f9e3052b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:17.168037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:17.168037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:17.168037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:17.168037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:17.168037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:17.168037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:17.168037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:17.168037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:17.168037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:17.168037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:17.168037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:17.168037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:17.168037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:17.168037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:17.168037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:17.168934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:17.168934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:17.168934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:17.168934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:17.168934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:17.168934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:17.168934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:17.168934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:17.168934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:17.168934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:17.168934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:17.168934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:17.168934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:17.168934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:17.168934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:17.168934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:17.169692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:17.169692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:17.169692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:17.169692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:17.169692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:17.169692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:17.169692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:17.169692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:17.169692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:17.169692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:17.169692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:17.169692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:17.172241 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 55/109] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:11:17.173731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25403ce0-eaf9-4b31-8f44-46a4073287fb None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:17.174478 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25403ce0-eaf9-4b31-8f44-46a4073287fb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:17.174954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25403ce0-eaf9-4b31-8f44-46a4073287fb None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:17.176565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 56/110] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:17.187749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534591f-fb1d-4e27-909c-17a2e9b9274e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:17.188341 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534591f-fb1d-4e27-909c-17a2e9b9274e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:17.188696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534591f-fb1d-4e27-909c-17a2e9b9274e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:17.199149 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c872c-ba22-4056-a8e5-b56d9e49ee64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:17.200870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c872c-ba22-4056-a8e5-b56d9e49ee64 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:17.218849 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e534591f-fb1d-4e27-909c-17a2e9b9274e None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:17.222262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e534591f-fb1d-4e27-909c-17a2e9b9274e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:17.275443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:17.356203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 57/111] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:17.356906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534591f-fb1d-4e27-909c-17a2e9b9274e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:17.394611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 55/112] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:17.395794 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c872c-ba22-4056-a8e5-b56d9e49ee64 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:17.494649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:17.505990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c872c-ba22-4056-a8e5-b56d9e49ee64 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:17.543478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91414e8b-c706-4da8-8ac0-efcbd1133bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:17.544572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91414e8b-c706-4da8-8ac0-efcbd1133bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:17.545008 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91414e8b-c706-4da8-8ac0-efcbd1133bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:17.545463 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91414e8b-c706-4da8-8ac0-efcbd1133bb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:17.560500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534591f-fb1d-4e27-909c-17a2e9b9274e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:17.562576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:17.570470 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91414e8b-c706-4da8-8ac0-efcbd1133bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:17.578326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-91414e8b-c706-4da8-8ac0-efcbd1133bb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:17.578326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:17.578326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:17.578326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:17.578326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:17.578326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:17.578326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:17.578326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:17.578326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:17.578326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:17.578326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:17.578326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:17.578326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:17.578326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:17.578326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:17.578326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:17.579178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:17.579178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:17.579178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:17.579178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:17.579178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:17.579178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:17.579178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:17.579178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:17.579178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:17.579178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:17.579178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:17.579178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:17.579178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:17.579178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:17.579178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:17.579178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:17.579939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:17.579939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:17.579939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:17.579939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:17.579939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:17.579939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:17.579939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:17.579939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:17.579939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:17.579939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:17.579939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:17.579939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:17.579939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 56/113] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:11:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:17.585905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91414e8b-c706-4da8-8ac0-efcbd1133bb6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:17.618027 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b4c04-2f24-489b-8dfa-236a6f877bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:17.619066 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b4c04-2f24-489b-8dfa-236a6f877bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:17.619553 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b4c04-2f24-489b-8dfa-236a6f877bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:17.620016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b4c04-2f24-489b-8dfa-236a6f877bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:17.621137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b4c04-2f24-489b-8dfa-236a6f877bd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:17.621597 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b4c04-2f24-489b-8dfa-236a6f877bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:17.623274 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b4c04-2f24-489b-8dfa-236a6f877bd7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:17.632643 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 58/114] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:17.633715 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b4c04-2f24-489b-8dfa-236a6f877bd7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:17.702112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91414e8b-c706-4da8-8ac0-efcbd1133bb6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:17.740173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e7f4c-3c25-4683-9b85-534759a35fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:17.741067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e7f4c-3c25-4683-9b85-534759a35fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:17.741354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e7f4c-3c25-4683-9b85-534759a35fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:17.741635 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e7f4c-3c25-4683-9b85-534759a35fb9 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:17.742886 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e7f4c-3c25-4683-9b85-534759a35fb9 None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:17.744373 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e7f4c-3c25-4683-9b85-534759a35fb9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:17.746265 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b4c04-2f24-489b-8dfa-236a6f877bd7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:17.746724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 57/115] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:17 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:17.747541 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee04f99-8076-4caf-986e-c34473a3ffe1 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:17.747835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee04f99-8076-4caf-986e-c34473a3ffe1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:17.748115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee04f99-8076-4caf-986e-c34473a3ffe1 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:17.754318 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 58/116] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:17.754318 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee04f99-8076-4caf-986e-c34473a3ffe1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:17.789780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:17.796217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6b858-165c-48df-8dbf-3d740be72d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:17.796914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6b858-165c-48df-8dbf-3d740be72d79 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:17.797204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6b858-165c-48df-8dbf-3d740be72d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:17.797514 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6b858-165c-48df-8dbf-3d740be72d79 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:17.798332 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6b858-165c-48df-8dbf-3d740be72d79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:17.798653 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6b858-165c-48df-8dbf-3d740be72d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:17.800066 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6b858-165c-48df-8dbf-3d740be72d79 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:17.809508 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 59/117] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:17.810884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723a835-7b2d-417c-97bf-922ec45aead8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:17.811185 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723a835-7b2d-417c-97bf-922ec45aead8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:17.811472 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723a835-7b2d-417c-97bf-922ec45aead8 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:17.814678 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 60/118] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:17.814678 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723a835-7b2d-417c-97bf-922ec45aead8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:17.836837 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:17.880131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee04f99-8076-4caf-986e-c34473a3ffe1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:17.916351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb47aa-e1e1-4ef2-9ec1-7dd0591d9df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:17.917243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb47aa-e1e1-4ef2-9ec1-7dd0591d9df5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:17.917531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb47aa-e1e1-4ef2-9ec1-7dd0591d9df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:17.917837 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb47aa-e1e1-4ef2-9ec1-7dd0591d9df5 None admin] PATH_INFO: `/v3/users/b837aa4151fc426f856f309fe1286c92` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:17.919034 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb47aa-e1e1-4ef2-9ec1-7dd0591d9df5 None admin] RBAC: Authorizing `identity:get_user(user_id=b837aa4151fc426f856f309fe1286c92)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:17.920520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb47aa-e1e1-4ef2-9ec1-7dd0591d9df5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:17.922364 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 59/119] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:17 2022] GET /identity/v3/users/b837aa4151fc426f856f309fe1286c92 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:17.926146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723a835-7b2d-417c-97bf-922ec45aead8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:17.928009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b318c60-6a94-46b1-80fc-053971fa0d0d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:17.928307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b318c60-6a94-46b1-80fc-053971fa0d0d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:17.928592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b318c60-6a94-46b1-80fc-053971fa0d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:17.946297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7b318c60-6a94-46b1-80fc-053971fa0d0d None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:17.947512 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7b318c60-6a94-46b1-80fc-053971fa0d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:17.962492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16f8b8-af8a-4dde-ae48-dbbcf0f80737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:17.963803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16f8b8-af8a-4dde-ae48-dbbcf0f80737 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:17.964294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16f8b8-af8a-4dde-ae48-dbbcf0f80737 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:17.964585 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16f8b8-af8a-4dde-ae48-dbbcf0f80737 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:17.965437 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b16f8b8-af8a-4dde-ae48-dbbcf0f80737 None admin] RBAC: Adding query filter params (role.id=084af5d7b08e4468a0c81c61f14c51eb, scope.project.id=0b20137a36384531941036a989526bd2, user.id=31e7b636d4d3447ebd60ebae1b00a603) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:17.965761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b16f8b8-af8a-4dde-ae48-dbbcf0f80737 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:17.967298 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b16f8b8-af8a-4dde-ae48-dbbcf0f80737 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:17.972986 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 61/120] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:17 2022] GET /identity/v3/role_assignments?user.id=31e7b636d4d3447ebd60ebae1b00a603&scope.project.id=0b20137a36384531941036a989526bd2&role.id=084af5d7b08e4468a0c81c61f14c51eb => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:17.975403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16f8b8-af8a-4dde-ae48-dbbcf0f80737 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:18.024592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 60/121] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:18.031632 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07485b02-29ed-44ce-96ac-53652bf7eac8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:18.031984 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07485b02-29ed-44ce-96ac-53652bf7eac8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:18.032211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07485b02-29ed-44ce-96ac-53652bf7eac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:18.063838 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:18.068145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-07485b02-29ed-44ce-96ac-53652bf7eac8 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:18.070060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-07485b02-29ed-44ce-96ac-53652bf7eac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:18.124063 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16f8b8-af8a-4dde-ae48-dbbcf0f80737 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:18.163534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:18.178353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 61/122] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:18.179137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07485b02-29ed-44ce-96ac-53652bf7eac8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:18.199711 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5ed9d-abdc-415f-b6cd-3b2d31b4f442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:18.200647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5ed9d-abdc-415f-b6cd-3b2d31b4f442 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:18.200946 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5ed9d-abdc-415f-b6cd-3b2d31b4f442 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:18.201222 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5ed9d-abdc-415f-b6cd-3b2d31b4f442 None admin] PATH_INFO: `/v3/users/9a202eb6836d4aa3a8bf60c71995def9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:18.208181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5ed9d-abdc-415f-b6cd-3b2d31b4f442 None admin] RBAC: Authorizing `identity:get_user(user_id=9a202eb6836d4aa3a8bf60c71995def9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:18.208852 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5ed9d-abdc-415f-b6cd-3b2d31b4f442 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:18.210959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 62/123] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:17 2022] GET /identity/v3/users/9a202eb6836d4aa3a8bf60c71995def9 => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:18.211666 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5ed9d-abdc-415f-b6cd-3b2d31b4f442 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:18.310452 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07485b02-29ed-44ce-96ac-53652bf7eac8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:18.338475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5ed9d-abdc-415f-b6cd-3b2d31b4f442 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:18.358800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579397a4-68df-453f-801e-9abf675a6671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:18.360693 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579397a4-68df-453f-801e-9abf675a6671 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:18.361322 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579397a4-68df-453f-801e-9abf675a6671 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:18.361883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579397a4-68df-453f-801e-9abf675a6671 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:18.364088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579397a4-68df-453f-801e-9abf675a6671 None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:18.366342 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:18.366533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579397a4-68df-453f-801e-9abf675a6671 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:18.368576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 62/124] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:18 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:18.369189 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579397a4-68df-453f-801e-9abf675a6671 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:18.379675 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d6803-996d-471f-b441-7b7c4c4a3b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:18.381498 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d6803-996d-471f-b441-7b7c4c4a3b70 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:18.382002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d6803-996d-471f-b441-7b7c4c4a3b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:18.382920 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d6803-996d-471f-b441-7b7c4c4a3b70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:18.397904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d6803-996d-471f-b441-7b7c4c4a3b70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:18.409286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-895d6803-996d-471f-b441-7b7c4c4a3b70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:18.409286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:18.409286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:18.409286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:18.409286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:18.409286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:18.409286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:18.409286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:18.409286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:18.409286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:18.409286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:18.409286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:18.409286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:18.409286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:18.409286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:18.409286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:18.410210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:18.410210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:18.410210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:18.410210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:18.410210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:18.410210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:18.410210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:18.410210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:18.410210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:18.410210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:18.410210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:18.410210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:18.410210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:18.410210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:18.410210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:18.410210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:18.411092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:18.411092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:18.411092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:18.411092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:18.411092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:18.411092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:18.411092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:18.411092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:18.411092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:18.411092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:18.411092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:18.411092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:18.414136 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 63/125] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:18.415706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d6803-996d-471f-b441-7b7c4c4a3b70 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:18.443464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:18.487647 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579397a4-68df-453f-801e-9abf675a6671 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:18.526894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278f6f2-5a56-4310-b286-a996e6988aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:18.527850 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278f6f2-5a56-4310-b286-a996e6988aea None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:18.528138 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278f6f2-5a56-4310-b286-a996e6988aea None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:18.528422 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278f6f2-5a56-4310-b286-a996e6988aea None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:18.529232 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d6803-996d-471f-b441-7b7c4c4a3b70 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:18.529730 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278f6f2-5a56-4310-b286-a996e6988aea None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:18.531397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278f6f2-5a56-4310-b286-a996e6988aea None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:18.533429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 63/126] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:18 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:18.534014 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278f6f2-5a56-4310-b286-a996e6988aea None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:18.566251 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab223600-bb94-4636-adeb-58f0501e6fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:18.567709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab223600-bb94-4636-adeb-58f0501e6fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:18.568213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab223600-bb94-4636-adeb-58f0501e6fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:18.568714 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab223600-bb94-4636-adeb-58f0501e6fd4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:18.579800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab223600-bb94-4636-adeb-58f0501e6fd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:18.588436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ab223600-bb94-4636-adeb-58f0501e6fd4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:18.588436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:18.588436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:18.588436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:18.588436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:18.588436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:18.588436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:18.588436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:18.588436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:18.588436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:18.588436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:18.588436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:18.588436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:18.588436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:18.588436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:18.588436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:18.589314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:18.589314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:18.589314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:18.589314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:18.589314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:18.589314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:18.589314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:18.589314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:18.589314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:18.589314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:18.589314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:18.589314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:18.589314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:18.589314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:18.589314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:18.589314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:18.590097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:18.590097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:18.590097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:18.590097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:18.590097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:18.590097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:18.590097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:18.590097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:18.590097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:18.590097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:18.590097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:18.590097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:18.592044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 64/127] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:11:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:18.592983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab223600-bb94-4636-adeb-58f0501e6fd4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:18.641278 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:18.653666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278f6f2-5a56-4310-b286-a996e6988aea None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:18.687896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:18.694907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0235d9b-fd6d-4732-9061-72ed86d32379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:18.696131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0235d9b-fd6d-4732-9061-72ed86d32379 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:18.696696 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0235d9b-fd6d-4732-9061-72ed86d32379 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:18.697117 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0235d9b-fd6d-4732-9061-72ed86d32379 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2/users/b837aa4151fc426f856f309fe1286c92/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:18.699646 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0235d9b-fd6d-4732-9061-72ed86d32379 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b20137a36384531941036a989526bd2, user_id=b837aa4151fc426f856f309fe1286c92, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:18.700521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab223600-bb94-4636-adeb-58f0501e6fd4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:18.701515 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0235d9b-fd6d-4732-9061-72ed86d32379 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:18.718412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 64/128] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:11:18 2022] PUT /identity/v3/projects/0b20137a36384531941036a989526bd2/users/b837aa4151fc426f856f309fe1286c92/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:11:18.719871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0235d9b-fd6d-4732-9061-72ed86d32379 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:18.740659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619c24a-2c8d-4535-b74b-39c5bb30df2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:18.741411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619c24a-2c8d-4535-b74b-39c5bb30df2f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:18.741687 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619c24a-2c8d-4535-b74b-39c5bb30df2f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:18.741978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619c24a-2c8d-4535-b74b-39c5bb30df2f None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:18.742781 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619c24a-2c8d-4535-b74b-39c5bb30df2f None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:18.743098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619c24a-2c8d-4535-b74b-39c5bb30df2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:18.744511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619c24a-2c8d-4535-b74b-39c5bb30df2f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:18.758032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 65/129] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:18.758032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619c24a-2c8d-4535-b74b-39c5bb30df2f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:18.878613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0235d9b-fd6d-4732-9061-72ed86d32379 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:18.884700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619c24a-2c8d-4535-b74b-39c5bb30df2f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:18.896644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:18.937603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5fc77-8333-49ef-bb91-1b652475cabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:18.938834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5fc77-8333-49ef-bb91-1b652475cabf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:18.941034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5fc77-8333-49ef-bb91-1b652475cabf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:18.941314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5fc77-8333-49ef-bb91-1b652475cabf None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:18.942292 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5fc77-8333-49ef-bb91-1b652475cabf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:18.942626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5fc77-8333-49ef-bb91-1b652475cabf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:18.944076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5fc77-8333-49ef-bb91-1b652475cabf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:18.954527 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 66/130] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:11:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:18.955044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b7c3c-0bce-4b7c-8ce0-fa0f6ed21cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:18.955237 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5fc77-8333-49ef-bb91-1b652475cabf None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:18.956424 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b7c3c-0bce-4b7c-8ce0-fa0f6ed21cde None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:18.956958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b7c3c-0bce-4b7c-8ce0-fa0f6ed21cde None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:18.958465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b7c3c-0bce-4b7c-8ce0-fa0f6ed21cde None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2/users/9a202eb6836d4aa3a8bf60c71995def9/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:18.960957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b7c3c-0bce-4b7c-8ce0-fa0f6ed21cde None admin] RBAC: Authorizing `identity:create_grant(project_id=0b20137a36384531941036a989526bd2, user_id=9a202eb6836d4aa3a8bf60c71995def9, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:18.962818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b7c3c-0bce-4b7c-8ce0-fa0f6ed21cde None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:18.980989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 65/131] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:11:18 2022] PUT /identity/v3/projects/0b20137a36384531941036a989526bd2/users/9a202eb6836d4aa3a8bf60c71995def9/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:11:18.982518 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b7c3c-0bce-4b7c-8ce0-fa0f6ed21cde None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:19.047566 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:19.090898 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5fc77-8333-49ef-bb91-1b652475cabf None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:19.106666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b7c3c-0bce-4b7c-8ce0-fa0f6ed21cde None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:19.151271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59ede3-9cb9-4d2c-a341-8ce1f5fd5371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:19.152583 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59ede3-9cb9-4d2c-a341-8ce1f5fd5371 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:19.153099 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59ede3-9cb9-4d2c-a341-8ce1f5fd5371 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:19.153596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59ede3-9cb9-4d2c-a341-8ce1f5fd5371 None admin] PATH_INFO: `/v3/users/b837aa4151fc426f856f309fe1286c92` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:19.155378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59ede3-9cb9-4d2c-a341-8ce1f5fd5371 None admin] RBAC: Authorizing `identity:get_user(user_id=b837aa4151fc426f856f309fe1286c92)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:19.157227 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59ede3-9cb9-4d2c-a341-8ce1f5fd5371 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:19.159486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 66/132] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:18 2022] GET /identity/v3/users/b837aa4151fc426f856f309fe1286c92 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:19.160724 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c58a4-e053-4128-a4d8-46432ded3569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:19.161638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c58a4-e053-4128-a4d8-46432ded3569 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:19.161933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c58a4-e053-4128-a4d8-46432ded3569 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:19.162249 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c58a4-e053-4128-a4d8-46432ded3569 None admin] PATH_INFO: `/v3/users/b837aa4151fc426f856f309fe1286c92` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:19.164926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c58a4-e053-4128-a4d8-46432ded3569 None admin] RBAC: Authorizing `identity:get_user(user_id=b837aa4151fc426f856f309fe1286c92)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:19.165688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59ede3-9cb9-4d2c-a341-8ce1f5fd5371 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:19.166453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c58a4-e053-4128-a4d8-46432ded3569 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:19.168169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 67/133] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:18 2022] GET /identity/v3/users/b837aa4151fc426f856f309fe1286c92 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:19.173846 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c58a4-e053-4128-a4d8-46432ded3569 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:19.242698 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:19.281576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59ede3-9cb9-4d2c-a341-8ce1f5fd5371 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:19.305399 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:19.307959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c58a4-e053-4128-a4d8-46432ded3569 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:19.324225 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbe80e-fc26-4ef7-b57f-4b99f468391d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:19.325196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbe80e-fc26-4ef7-b57f-4b99f468391d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:19.325563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbe80e-fc26-4ef7-b57f-4b99f468391d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:19.325920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbe80e-fc26-4ef7-b57f-4b99f468391d None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:19.327385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbe80e-fc26-4ef7-b57f-4b99f468391d None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:19.329187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbe80e-fc26-4ef7-b57f-4b99f468391d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:19.331153 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 67/134] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:19 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:19.337511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbe80e-fc26-4ef7-b57f-4b99f468391d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:19.352358 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebec98-8f6f-44b7-ade9-6d81e9620fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:19.353577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebec98-8f6f-44b7-ade9-6d81e9620fcf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:19.354037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebec98-8f6f-44b7-ade9-6d81e9620fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:19.354556 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebec98-8f6f-44b7-ade9-6d81e9620fcf None admin] PATH_INFO: `/v3/projects/896c28e85208446ab9ea4cb7205d2e3e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:19.356306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebec98-8f6f-44b7-ade9-6d81e9620fcf None admin] RBAC: Authorizing `identity:get_project(project_id=896c28e85208446ab9ea4cb7205d2e3e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:19.358068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebec98-8f6f-44b7-ade9-6d81e9620fcf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:19.360261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 68/135] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:19 2022] GET /identity/v3/projects/896c28e85208446ab9ea4cb7205d2e3e => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:19.361752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99098b03-e9d7-4f77-b8eb-e1308581205c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:19.362238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99098b03-e9d7-4f77-b8eb-e1308581205c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:19.362719 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99098b03-e9d7-4f77-b8eb-e1308581205c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:19.364328 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 69/136] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:19.367195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99098b03-e9d7-4f77-b8eb-e1308581205c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:19.477008 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbe80e-fc26-4ef7-b57f-4b99f468391d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:19.489209 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99098b03-e9d7-4f77-b8eb-e1308581205c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:19.497533 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:19.526337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62019e-f03d-4c5e-8931-7845b30408c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:19.527620 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62019e-f03d-4c5e-8931-7845b30408c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:19.528116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62019e-f03d-4c5e-8931-7845b30408c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:19.528589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62019e-f03d-4c5e-8931-7845b30408c9 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2/users/b837aa4151fc426f856f309fe1286c92/roles/0763e374972f4ce29ab449e27fd89355` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:19.531134 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62019e-f03d-4c5e-8931-7845b30408c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b20137a36384531941036a989526bd2, user_id=b837aa4151fc426f856f309fe1286c92, role_id=0763e374972f4ce29ab449e27fd89355)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:19.532813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62019e-f03d-4c5e-8931-7845b30408c9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:19.535486 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb702192-d981-48d8-8684-78430fdd661c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:19.536345 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb702192-d981-48d8-8684-78430fdd661c None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:19.536687 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb702192-d981-48d8-8684-78430fdd661c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:19.536981 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb702192-d981-48d8-8684-78430fdd661c None admin] PATH_INFO: `/v3/projects/896c28e85208446ab9ea4cb7205d2e3e/users/b837aa4151fc426f856f309fe1286c92/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:19.539907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb702192-d981-48d8-8684-78430fdd661c None admin] RBAC: Authorizing `identity:create_grant(project_id=896c28e85208446ab9ea4cb7205d2e3e, user_id=b837aa4151fc426f856f309fe1286c92, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:19.541720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb702192-d981-48d8-8684-78430fdd661c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:19.558114 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 68/137] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:11:19 2022] PUT /identity/v3/projects/0b20137a36384531941036a989526bd2/users/b837aa4151fc426f856f309fe1286c92/roles/0763e374972f4ce29ab449e27fd89355 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:11:19.560408 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a24b0-89aa-455b-99cd-7286d1d921c0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:19.561862 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a24b0-89aa-455b-99cd-7286d1d921c0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:19.563410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a24b0-89aa-455b-99cd-7286d1d921c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:19.575648 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 70/138] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:11:19 2022] PUT /identity/v3/projects/896c28e85208446ab9ea4cb7205d2e3e/users/b837aa4151fc426f856f309fe1286c92/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:11:19.589598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ff1a24b0-89aa-455b-99cd-7286d1d921c0 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:19.591517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ff1a24b0-89aa-455b-99cd-7286d1d921c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:19.647943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:19.677327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 69/139] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:19.719472 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb702192-d981-48d8-8684-78430fdd661c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:19.867061 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb702192-d981-48d8-8684-78430fdd661c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:19.919192 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ebe48-14d2-4bb2-9dbf-4a2101360ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:19.920470 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ebe48-14d2-4bb2-9dbf-4a2101360ada None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:19.921040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ebe48-14d2-4bb2-9dbf-4a2101360ada None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:19.921519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ebe48-14d2-4bb2-9dbf-4a2101360ada None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:19.923159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ebe48-14d2-4bb2-9dbf-4a2101360ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:19.924943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ebe48-14d2-4bb2-9dbf-4a2101360ada None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:19.927320 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 71/140] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:11:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:19.933643 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a24b0-89aa-455b-99cd-7286d1d921c0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:20.051287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a24b0-89aa-455b-99cd-7286d1d921c0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:20.093200 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0016976-8a51-495d-b01a-f20bd806fb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:20.094386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0016976-8a51-495d-b01a-f20bd806fb40 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:20.094896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0016976-8a51-495d-b01a-f20bd806fb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:20.095360 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0016976-8a51-495d-b01a-f20bd806fb40 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:20.096290 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0016976-8a51-495d-b01a-f20bd806fb40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:20.098210 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0016976-8a51-495d-b01a-f20bd806fb40 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:20.124840 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 70/141] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:11:19 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:11:20.671185 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49b486-a0e3-481a-97b1-a8f6fc170acb None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:20.671584 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49b486-a0e3-481a-97b1-a8f6fc170acb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:20.671944 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49b486-a0e3-481a-97b1-a8f6fc170acb None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:20.673451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 72/142] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:20.680859 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66350c67-ad82-403d-89a0-7f3a0dd5b804 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:20.681152 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66350c67-ad82-403d-89a0-7f3a0dd5b804 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:20.681501 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66350c67-ad82-403d-89a0-7f3a0dd5b804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:20.709136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-66350c67-ad82-403d-89a0-7f3a0dd5b804 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:20.710435 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-66350c67-ad82-403d-89a0-7f3a0dd5b804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:20.766477 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:20.870871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 71/143] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:20.932173 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49b486-a0e3-481a-97b1-a8f6fc170acb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:21.001089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:21.098350 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49b486-a0e3-481a-97b1-a8f6fc170acb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:21.155078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d806fd-287f-4ada-8863-0906eb21ba13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:21.156103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d806fd-287f-4ada-8863-0906eb21ba13 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:21.156432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d806fd-287f-4ada-8863-0906eb21ba13 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:21.156960 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d806fd-287f-4ada-8863-0906eb21ba13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:21.177908 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d806fd-287f-4ada-8863-0906eb21ba13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:21.187723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c4d806fd-287f-4ada-8863-0906eb21ba13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:21.187723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:21.187723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:21.187723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:21.187723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:21.187723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:21.187723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:21.187723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:21.187723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:21.187723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:21.187723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:21.187723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:21.187723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:21.187723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:21.187723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:21.187723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:21.188595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:21.188595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:21.188595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:21.188595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:21.188595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:21.188595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:21.188595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:21.188595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:21.188595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:21.188595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:21.188595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:21.188595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:21.188595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:21.188595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:21.188595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:21.188595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:21.189367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:21.189367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:21.189367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:21.189367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:21.189367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:21.189367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:21.189367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:21.189367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:21.189367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:21.189367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:21.189367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:21.189367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:21.189367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 73/144] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:11:21.195793 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66350c67-ad82-403d-89a0-7f3a0dd5b804 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:21.337198 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66350c67-ad82-403d-89a0-7f3a0dd5b804 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:21.383885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71042cf4-1083-4d1a-b36a-342e8474dbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:21.384653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71042cf4-1083-4d1a-b36a-342e8474dbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:21.384967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71042cf4-1083-4d1a-b36a-342e8474dbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:21.385275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71042cf4-1083-4d1a-b36a-342e8474dbe1 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:21.386239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71042cf4-1083-4d1a-b36a-342e8474dbe1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:21.386601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71042cf4-1083-4d1a-b36a-342e8474dbe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:21.388264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71042cf4-1083-4d1a-b36a-342e8474dbe1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:21.399151 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 72/145] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:21.405835 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d806fd-287f-4ada-8863-0906eb21ba13 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:21.533171 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:21.541710 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d806fd-287f-4ada-8863-0906eb21ba13 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:21.587422 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccc9b5-4115-45f9-ba1d-34f3283c59c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:21.588680 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccc9b5-4115-45f9-ba1d-34f3283c59c9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:21.589228 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccc9b5-4115-45f9-ba1d-34f3283c59c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:21.589552 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccc9b5-4115-45f9-ba1d-34f3283c59c9 None admin] PATH_INFO: `/v3/users/31e7b636d4d3447ebd60ebae1b00a603` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:21.591313 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccc9b5-4115-45f9-ba1d-34f3283c59c9 None admin] RBAC: Authorizing `identity:get_user(user_id=31e7b636d4d3447ebd60ebae1b00a603)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:21.593046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccc9b5-4115-45f9-ba1d-34f3283c59c9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:21.595241 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 74/146] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:21 2022] GET /identity/v3/users/31e7b636d4d3447ebd60ebae1b00a603 => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:21.602722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50b7fe-2a88-4cc3-9f25-1c8ea8584bfb None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:21.603004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50b7fe-2a88-4cc3-9f25-1c8ea8584bfb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:21.603288 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50b7fe-2a88-4cc3-9f25-1c8ea8584bfb None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:21.604803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 73/147] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:21.606506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccc9b5-4115-45f9-ba1d-34f3283c59c9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:21.610570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c1f93-6554-473e-bf9d-4f8c95bc7ccb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:21.610902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c1f93-6554-473e-bf9d-4f8c95bc7ccb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:21.611236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c1f93-6554-473e-bf9d-4f8c95bc7ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:21.643039 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d74c1f93-6554-473e-bf9d-4f8c95bc7ccb None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:21.644277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d74c1f93-6554-473e-bf9d-4f8c95bc7ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:21.691560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:21.779888 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 74/148] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:21.788772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccc9b5-4115-45f9-ba1d-34f3283c59c9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:21.825295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c1f93-6554-473e-bf9d-4f8c95bc7ccb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:21.849331 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de8859-c7d1-4bf3-8621-1e63d311171d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:21.851275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de8859-c7d1-4bf3-8621-1e63d311171d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:21.852154 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de8859-c7d1-4bf3-8621-1e63d311171d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:21.852867 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de8859-c7d1-4bf3-8621-1e63d311171d None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:21.856525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de8859-c7d1-4bf3-8621-1e63d311171d None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:21.859331 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de8859-c7d1-4bf3-8621-1e63d311171d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:21.863668 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 75/149] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:21 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:21.878534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de8859-c7d1-4bf3-8621-1e63d311171d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:21.938934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:22.031193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c1f93-6554-473e-bf9d-4f8c95bc7ccb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:22.067928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de8859-c7d1-4bf3-8621-1e63d311171d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:22.104560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626e8d7-5a8d-4ea9-8cb0-453cb85f6f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:22.105644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626e8d7-5a8d-4ea9-8cb0-453cb85f6f92 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:22.106075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626e8d7-5a8d-4ea9-8cb0-453cb85f6f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:22.106602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626e8d7-5a8d-4ea9-8cb0-453cb85f6f92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:22.136073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626e8d7-5a8d-4ea9-8cb0-453cb85f6f92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:22.140245 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3beb483-ffeb-4e3c-9ab1-fc0e45f811c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:22.141976 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3beb483-ffeb-4e3c-9ab1-fc0e45f811c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:22.142532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3beb483-ffeb-4e3c-9ab1-fc0e45f811c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:22.143054 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3beb483-ffeb-4e3c-9ab1-fc0e45f811c3 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2/users/31e7b636d4d3447ebd60ebae1b00a603/roles/084af5d7b08e4468a0c81c61f14c51eb` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:22.144520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-3626e8d7-5a8d-4ea9-8cb0-453cb85f6f92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:22.144520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:22.144520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:22.144520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:22.144520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:22.144520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:22.144520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:22.144520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:22.144520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:22.144520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:22.144520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:22.144520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:22.144520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:22.144520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:22.144520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:22.144520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:22.145996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:22.145996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:22.145996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:22.145996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:22.145996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:22.145996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:22.145996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:22.145996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:22.145996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:22.145996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:22.145996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:22.145996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:22.145996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:22.145996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:22.145996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:22.145996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:22.147196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:22.147196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:22.147196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:22.147196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:22.147196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:22.147196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:22.147196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:22.147196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:22.147196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:22.147196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:22.147196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:22.147196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:22.150487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3beb483-ffeb-4e3c-9ab1-fc0e45f811c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b20137a36384531941036a989526bd2, user_id=31e7b636d4d3447ebd60ebae1b00a603, role_id=084af5d7b08e4468a0c81c61f14c51eb)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:22.152783 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3beb483-ffeb-4e3c-9ab1-fc0e45f811c3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:22.155791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 75/150] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:22.161141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626e8d7-5a8d-4ea9-8cb0-453cb85f6f92 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:22.186050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 76/151] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:11:21 2022] PUT /identity/v3/projects/0b20137a36384531941036a989526bd2/users/31e7b636d4d3447ebd60ebae1b00a603/roles/084af5d7b08e4468a0c81c61f14c51eb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:11:22.203538 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:22.330000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626e8d7-5a8d-4ea9-8cb0-453cb85f6f92 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:22.376168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fef42e-861d-4c94-8ed3-caeeb17e6928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:22.376888 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fef42e-861d-4c94-8ed3-caeeb17e6928 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:22.377178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fef42e-861d-4c94-8ed3-caeeb17e6928 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:22.377468 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fef42e-861d-4c94-8ed3-caeeb17e6928 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:22.378333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fef42e-861d-4c94-8ed3-caeeb17e6928 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:22.378675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fef42e-861d-4c94-8ed3-caeeb17e6928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:22.380625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fef42e-861d-4c94-8ed3-caeeb17e6928 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:22.395063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 76/152] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:22.401419 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3beb483-ffeb-4e3c-9ab1-fc0e45f811c3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:22.553154 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:22.566413 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3beb483-ffeb-4e3c-9ab1-fc0e45f811c3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:22.613711 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e116a-633d-4305-ae66-81da55c542f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:22.615162 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e116a-633d-4305-ae66-81da55c542f0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:22.615519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e116a-633d-4305-ae66-81da55c542f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:22.615825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e116a-633d-4305-ae66-81da55c542f0 None admin] PATH_INFO: `/v3/users/b837aa4151fc426f856f309fe1286c92` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:22.617212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e116a-633d-4305-ae66-81da55c542f0 None admin] RBAC: Authorizing `identity:get_user(user_id=b837aa4151fc426f856f309fe1286c92)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:22.618861 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e116a-633d-4305-ae66-81da55c542f0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:22.624824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 77/153] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:22 2022] GET /identity/v3/users/b837aa4151fc426f856f309fe1286c92 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:22.626177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fef42e-861d-4c94-8ed3-caeeb17e6928 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:22.749811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:22.784299 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fef42e-861d-4c94-8ed3-caeeb17e6928 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:22.835497 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec1d2b-d629-45d7-b1b5-e8c12c317137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:22.836564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec1d2b-d629-45d7-b1b5-e8c12c317137 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:22.837059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec1d2b-d629-45d7-b1b5-e8c12c317137 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:22.837542 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec1d2b-d629-45d7-b1b5-e8c12c317137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:22.919560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec1d2b-d629-45d7-b1b5-e8c12c317137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:22.921422 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec1d2b-d629-45d7-b1b5-e8c12c317137 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:23.022266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:23.046657 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 77/154] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:23.052655 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e116a-633d-4305-ae66-81da55c542f0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:23.209138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e116a-633d-4305-ae66-81da55c542f0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:23.231682 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bc1b9-6c3b-4ba8-a4cc-d7a341a892de None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:23.232660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bc1b9-6c3b-4ba8-a4cc-d7a341a892de None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:23.233135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bc1b9-6c3b-4ba8-a4cc-d7a341a892de None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:23.238896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 78/155] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:23.245512 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab5f8e-d11b-4713-8d72-fb6183c5444d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:23.246076 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab5f8e-d11b-4713-8d72-fb6183c5444d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:23.246605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab5f8e-d11b-4713-8d72-fb6183c5444d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:23.261422 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa513cb4-b730-457c-bcc9-ff68eaf75c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:23.262425 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa513cb4-b730-457c-bcc9-ff68eaf75c67 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:23.262704 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa513cb4-b730-457c-bcc9-ff68eaf75c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:23.262980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa513cb4-b730-457c-bcc9-ff68eaf75c67 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:23.264224 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa513cb4-b730-457c-bcc9-ff68eaf75c67 None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:23.265709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa513cb4-b730-457c-bcc9-ff68eaf75c67 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:23.270256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 78/156] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:23 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:23.276617 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa513cb4-b730-457c-bcc9-ff68eaf75c67 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:23.283226 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-efab5f8e-d11b-4713-8d72-fb6183c5444d None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:23.284819 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-efab5f8e-d11b-4713-8d72-fb6183c5444d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:23.307097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:23.394519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa513cb4-b730-457c-bcc9-ff68eaf75c67 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:23.433016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081923ae-60db-4bb2-8373-881ed0721a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:23.434043 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081923ae-60db-4bb2-8373-881ed0721a13 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:23.434378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081923ae-60db-4bb2-8373-881ed0721a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:23.434652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081923ae-60db-4bb2-8373-881ed0721a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:23.435630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081923ae-60db-4bb2-8373-881ed0721a13 None admin] RBAC: Adding query filter params (role.id=bb946622ce1842cba751c5f862237f14, scope.project.id=0b20137a36384531941036a989526bd2, user.id=b837aa4151fc426f856f309fe1286c92) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:23.435945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081923ae-60db-4bb2-8373-881ed0721a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:23.437438 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081923ae-60db-4bb2-8373-881ed0721a13 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:23.445048 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 79/158] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:23 2022] GET /identity/v3/role_assignments?user.id=b837aa4151fc426f856f309fe1286c92&scope.project.id=0b20137a36384531941036a989526bd2&role.id=bb946622ce1842cba751c5f862237f14 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:23.445397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 79/158] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:23.451751 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0a5f6-41e6-4ee9-9e10-5fd661df5b77 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:23.452079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0a5f6-41e6-4ee9-9e10-5fd661df5b77 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:23.452325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0a5f6-41e6-4ee9-9e10-5fd661df5b77 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:23.453789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 80/159] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:23.460167 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427edd20-0658-4544-92c9-abc368255387 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:23.460849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427edd20-0658-4544-92c9-abc368255387 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:23.461357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427edd20-0658-4544-92c9-abc368255387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:23.492953 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-427edd20-0658-4544-92c9-abc368255387 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:23.494542 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-427edd20-0658-4544-92c9-abc368255387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:23.505347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0a5f6-41e6-4ee9-9e10-5fd661df5b77 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:23.660947 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 80/160] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:23.671318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:23.698822 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0a5f6-41e6-4ee9-9e10-5fd661df5b77 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:23.756402 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427edd20-0658-4544-92c9-abc368255387 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:23.760820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52195591-d36e-4df8-87b3-a6fbed93e9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:23.761782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52195591-d36e-4df8-87b3-a6fbed93e9aa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:23.762067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52195591-d36e-4df8-87b3-a6fbed93e9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:23.762366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52195591-d36e-4df8-87b3-a6fbed93e9aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:23.785771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52195591-d36e-4df8-87b3-a6fbed93e9aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:23.795299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-52195591-d36e-4df8-87b3-a6fbed93e9aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:23.795299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:23.795299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:23.795299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:23.795299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:23.795299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:23.795299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:23.795299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:23.795299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:23.795299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:23.795299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:23.795299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:23.795299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:23.795299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:23.795299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:23.795299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:23.796304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:23.796304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:23.796304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:23.796304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:23.796304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:23.796304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:23.796304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:23.796304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:23.796304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:23.796304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:23.796304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:23.796304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:23.796304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:23.796304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:23.796304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:23.796304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:23.797072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:23.797072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:23.797072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:23.797072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:23.797072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:23.797072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:23.797072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:23.797072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:23.797072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:23.797072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:23.797072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:23.797072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:23.797072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 81/161] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:11:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:23.803500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52195591-d36e-4df8-87b3-a6fbed93e9aa None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:23.850683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:23.968068 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427edd20-0658-4544-92c9-abc368255387 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:23.997952 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52195591-d36e-4df8-87b3-a6fbed93e9aa None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:24.049553 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b5180-678c-4e22-8074-a79cf8910593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:24.050170 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b5180-678c-4e22-8074-a79cf8910593 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:24.050503 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b5180-678c-4e22-8074-a79cf8910593 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:24.050891 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b5180-678c-4e22-8074-a79cf8910593 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:24.051928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b5180-678c-4e22-8074-a79cf8910593 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:24.052236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b5180-678c-4e22-8074-a79cf8910593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:24.053671 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b5180-678c-4e22-8074-a79cf8910593 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:24.059164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201a88e-70a8-45ef-9c2f-32daeeb5e4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:24.060018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201a88e-70a8-45ef-9c2f-32daeeb5e4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:24.060317 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201a88e-70a8-45ef-9c2f-32daeeb5e4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:24.060583 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201a88e-70a8-45ef-9c2f-32daeeb5e4e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:24.068285 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 82/162] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:11:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:24.074430 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b5180-678c-4e22-8074-a79cf8910593 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:24.091380 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201a88e-70a8-45ef-9c2f-32daeeb5e4e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:24.100391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:24.103863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-9201a88e-70a8-45ef-9c2f-32daeeb5e4e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:24.103863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:24.103863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:24.103863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:24.103863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:24.103863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:24.103863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:24.103863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:24.103863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:24.103863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:24.103863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:24.103863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:24.103863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:24.103863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:24.103863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:24.103863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:24.104789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:24.104789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:24.104789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:24.104789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:24.104789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:24.104789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:24.104789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:24.104789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:24.104789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:24.104789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:24.104789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:24.104789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:24.104789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:24.104789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:24.104789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:24.104789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:24.105557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:24.105557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:24.105557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:24.105557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:24.105557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:24.105557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:24.105557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:24.105557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:24.105557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:24.105557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:24.105557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:24.105557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:24.105557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 81/163] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:11:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:11:24.111514 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201a88e-70a8-45ef-9c2f-32daeeb5e4e7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:24.316545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b5180-678c-4e22-8074-a79cf8910593 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:24.349432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201a88e-70a8-45ef-9c2f-32daeeb5e4e7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:24.358565 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:24.395017 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4450d5e-9279-4c2a-8014-fb57f8d42e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:24.395911 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4450d5e-9279-4c2a-8014-fb57f8d42e6a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:24.396191 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4450d5e-9279-4c2a-8014-fb57f8d42e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:24.396466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4450d5e-9279-4c2a-8014-fb57f8d42e6a None admin] PATH_INFO: `/v3/users/b837aa4151fc426f856f309fe1286c92` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:24.399103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4450d5e-9279-4c2a-8014-fb57f8d42e6a None admin] RBAC: Authorizing `identity:get_user(user_id=b837aa4151fc426f856f309fe1286c92)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:24.401901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4450d5e-9279-4c2a-8014-fb57f8d42e6a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:24.403825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 83/164] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:24 2022] GET /identity/v3/users/b837aa4151fc426f856f309fe1286c92 => generated 275 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:24.413905 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4450d5e-9279-4c2a-8014-fb57f8d42e6a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:24.428634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b6664-99ed-4445-b8f9-76c93cb74d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:24.429325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b6664-99ed-4445-b8f9-76c93cb74d34 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:24.429607 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b6664-99ed-4445-b8f9-76c93cb74d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:24.429881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b6664-99ed-4445-b8f9-76c93cb74d34 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:24.430675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b6664-99ed-4445-b8f9-76c93cb74d34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:24.430982 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b6664-99ed-4445-b8f9-76c93cb74d34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:24.432384 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b6664-99ed-4445-b8f9-76c93cb74d34 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:24.455385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 82/165] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:24.469207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b6664-99ed-4445-b8f9-76c93cb74d34 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:24.605288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:24.663791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4450d5e-9279-4c2a-8014-fb57f8d42e6a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:24.700446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b6664-99ed-4445-b8f9-76c93cb74d34 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:24.720322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c52694-5e16-41b6-976c-4fa5c02d5442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:24.721000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c52694-5e16-41b6-976c-4fa5c02d5442 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:24.721288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c52694-5e16-41b6-976c-4fa5c02d5442 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:24.721567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c52694-5e16-41b6-976c-4fa5c02d5442 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:24.777900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c51c5-7fe1-40e9-b84e-58a63ca0f7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:24.778894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c51c5-7fe1-40e9-b84e-58a63ca0f7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:24.779175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c51c5-7fe1-40e9-b84e-58a63ca0f7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:24.779445 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c51c5-7fe1-40e9-b84e-58a63ca0f7b0 None admin] PATH_INFO: `/v3/users/9a202eb6836d4aa3a8bf60c71995def9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:24.780790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c51c5-7fe1-40e9-b84e-58a63ca0f7b0 None admin] RBAC: Authorizing `identity:get_user(user_id=9a202eb6836d4aa3a8bf60c71995def9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:24.782265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c51c5-7fe1-40e9-b84e-58a63ca0f7b0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:24.785895 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 83/166] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:24 2022] GET /identity/v3/users/9a202eb6836d4aa3a8bf60c71995def9 => generated 247 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:24.790542 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c51c5-7fe1-40e9-b84e-58a63ca0f7b0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:24.820560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c52694-5e16-41b6-976c-4fa5c02d5442 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:24.822060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c52694-5e16-41b6-976c-4fa5c02d5442 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:24.878703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:24.906064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:24.938850 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 84/167] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:24.940159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287fed7-6a12-4db3-9cad-9149c95c0409 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:24.940520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287fed7-6a12-4db3-9cad-9149c95c0409 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:24.940862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287fed7-6a12-4db3-9cad-9149c95c0409 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:24.942335 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 85/168] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:24.947592 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bd3d6-c9ab-4185-80d7-5270e44ee19f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:24.947947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bd3d6-c9ab-4185-80d7-5270e44ee19f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:24.948295 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bd3d6-c9ab-4185-80d7-5270e44ee19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:24.966923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-513bd3d6-c9ab-4185-80d7-5270e44ee19f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:24.968223 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-513bd3d6-c9ab-4185-80d7-5270e44ee19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:25.002825 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c51c5-7fe1-40e9-b84e-58a63ca0f7b0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:25.055689 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 86/169] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:25.056597 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bd3d6-c9ab-4185-80d7-5270e44ee19f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:25.062097 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00633d-2e47-47c6-ad46-672a9cea6705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:25.062838 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00633d-2e47-47c6-ad46-672a9cea6705 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:25.063121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00633d-2e47-47c6-ad46-672a9cea6705 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:25.070726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00633d-2e47-47c6-ad46-672a9cea6705 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:25.188920 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bd3d6-c9ab-4185-80d7-5270e44ee19f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:25.203263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:25.209571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00633d-2e47-47c6-ad46-672a9cea6705 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:25.211422 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00633d-2e47-47c6-ad46-672a9cea6705 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:25.241636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5551c-f883-466d-9e3b-c21fb69be328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:25.242580 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5551c-f883-466d-9e3b-c21fb69be328 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:25.242859 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5551c-f883-466d-9e3b-c21fb69be328 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:25.243137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5551c-f883-466d-9e3b-c21fb69be328 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:25.247223 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5551c-f883-466d-9e3b-c21fb69be328 None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:25.249264 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5551c-f883-466d-9e3b-c21fb69be328 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:25.251236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 87/170] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:25 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:25.252344 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5551c-f883-466d-9e3b-c21fb69be328 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:25.273598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:25.431851 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 84/171] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:25.432756 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00633d-2e47-47c6-ad46-672a9cea6705 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:25.460308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5551c-f883-466d-9e3b-c21fb69be328 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:25.519034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf551f8-bca6-4f60-9f99-75a6e7a93512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:25.520220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf551f8-bca6-4f60-9f99-75a6e7a93512 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:25.520639 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf551f8-bca6-4f60-9f99-75a6e7a93512 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:25.521067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf551f8-bca6-4f60-9f99-75a6e7a93512 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:25.536863 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf551f8-bca6-4f60-9f99-75a6e7a93512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:25.551321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ddf551f8-bca6-4f60-9f99-75a6e7a93512 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:25.551321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:25.551321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:25.551321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:25.551321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:25.551321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:25.551321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:25.551321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:25.551321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:25.551321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:25.551321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:25.551321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:25.551321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:25.551321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:25.551321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:25.551321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:25.552466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:25.552466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:25.552466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:25.552466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:25.552466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:25.552466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:25.552466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:25.552466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:25.552466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:25.552466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:25.552466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:25.552466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:25.552466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:25.552466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:25.552466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:25.552466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:25.553530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:25.553530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:25.553530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:25.553530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:25.553530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:25.553530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:25.553530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:25.553530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:25.553530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:25.553530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:25.553530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:25.553530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:25.562248 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 88/172] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:25.564106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10c419-e3ba-4df5-a923-cf8866b081b2 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:25.564543 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10c419-e3ba-4df5-a923-cf8866b081b2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:25.564968 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10c419-e3ba-4df5-a923-cf8866b081b2 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:25.566639 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 89/173] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:25.567687 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10c419-e3ba-4df5-a923-cf8866b081b2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:25.588630 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00633d-2e47-47c6-ad46-672a9cea6705 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:25.617625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:25.618021 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:25.627408 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbf28f-f179-46b1-a940-a9fb19655aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:25.628124 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbf28f-f179-46b1-a940-a9fb19655aaa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:25.628483 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbf28f-f179-46b1-a940-a9fb19655aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:25.628842 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbf28f-f179-46b1-a940-a9fb19655aaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:25.630271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbf28f-f179-46b1-a940-a9fb19655aaa None admin] RBAC: Adding query filter params (role.id=0763e374972f4ce29ab449e27fd89355, scope.project.id=0b20137a36384531941036a989526bd2, user.id=b837aa4151fc426f856f309fe1286c92) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:25.630782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbf28f-f179-46b1-a940-a9fb19655aaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:25.632556 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbf28f-f179-46b1-a940-a9fb19655aaa None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:25.639808 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 85/174] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:25 2022] GET /identity/v3/role_assignments?user.id=b837aa4151fc426f856f309fe1286c92&scope.project.id=0b20137a36384531941036a989526bd2&role.id=0763e374972f4ce29ab449e27fd89355 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:25.641185 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbf28f-f179-46b1-a940-a9fb19655aaa None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:25.698549 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10c419-e3ba-4df5-a923-cf8866b081b2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:25.738369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b84e7-ddb5-4573-8490-9655da7cfa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:25.739412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b84e7-ddb5-4573-8490-9655da7cfa32 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:25.739828 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b84e7-ddb5-4573-8490-9655da7cfa32 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:25.740180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b84e7-ddb5-4573-8490-9655da7cfa32 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:25.741703 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b84e7-ddb5-4573-8490-9655da7cfa32 None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:25.743333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b84e7-ddb5-4573-8490-9655da7cfa32 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:25.745240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 90/175] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:25 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:25.747037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7a022-b89b-4d89-950a-d863a6ac64ed None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:25.747396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7a022-b89b-4d89-950a-d863a6ac64ed None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:25.747779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7a022-b89b-4d89-950a-d863a6ac64ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:25.766538 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a1a7a022-b89b-4d89-950a-d863a6ac64ed None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:25.767884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a1a7a022-b89b-4d89-950a-d863a6ac64ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:25.768588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbf28f-f179-46b1-a940-a9fb19655aaa None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:25.808324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cae4fb-21cc-4ff4-9aa9-fa607646197c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:25.809355 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cae4fb-21cc-4ff4-9aa9-fa607646197c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:25.809852 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cae4fb-21cc-4ff4-9aa9-fa607646197c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:25.810343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cae4fb-21cc-4ff4-9aa9-fa607646197c None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:25.811326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cae4fb-21cc-4ff4-9aa9-fa607646197c None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:25.811860 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cae4fb-21cc-4ff4-9aa9-fa607646197c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:25.813520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cae4fb-21cc-4ff4-9aa9-fa607646197c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:25.823718 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 86/176] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:25.826269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a327d-e711-4dbc-89d0-9c5ca1486bf4 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:25.830552 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a327d-e711-4dbc-89d0-9c5ca1486bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:25.830937 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a327d-e711-4dbc-89d0-9c5ca1486bf4 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:25.832681 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 87/177] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:25.833649 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a327d-e711-4dbc-89d0-9c5ca1486bf4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:25.849929 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 91/178] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:25.855932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597b7f2-e761-4776-b866-219cc8d3094d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:25.856251 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597b7f2-e761-4776-b866-219cc8d3094d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:25.856504 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597b7f2-e761-4776-b866-219cc8d3094d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:25.858044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 92/179] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:25.858856 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597b7f2-e761-4776-b866-219cc8d3094d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:25.898598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:25.925436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:25.966877 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a327d-e711-4dbc-89d0-9c5ca1486bf4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:26.017157 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07a887-7e60-41ed-a687-7f8e547b7e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:26.017821 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07a887-7e60-41ed-a687-7f8e547b7e0c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:26.018164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07a887-7e60-41ed-a687-7f8e547b7e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:26.018369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07a887-7e60-41ed-a687-7f8e547b7e0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:26.019247 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07a887-7e60-41ed-a687-7f8e547b7e0c None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=0b20137a36384531941036a989526bd2, user.id=9a202eb6836d4aa3a8bf60c71995def9) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:26.019734 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07a887-7e60-41ed-a687-7f8e547b7e0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:26.021047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07a887-7e60-41ed-a687-7f8e547b7e0c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:26.027458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 88/180] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:25 2022] GET /identity/v3/role_assignments?user.id=9a202eb6836d4aa3a8bf60c71995def9&scope.project.id=0b20137a36384531941036a989526bd2&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:26.027587 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597b7f2-e761-4776-b866-219cc8d3094d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:26.028496 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832f4c0-a95e-4028-9cc7-0a50d98f544e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:26.028786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832f4c0-a95e-4028-9cc7-0a50d98f544e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:26.029100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832f4c0-a95e-4028-9cc7-0a50d98f544e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:26.046788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f832f4c0-a95e-4028-9cc7-0a50d98f544e None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:26.048076 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f832f4c0-a95e-4028-9cc7-0a50d98f544e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:26.089684 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6ef1e-f21d-434d-ae7e-82f8cb25f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:26.090698 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6ef1e-f21d-434d-ae7e-82f8cb25f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:26.090990 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6ef1e-f21d-434d-ae7e-82f8cb25f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:26.091264 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6ef1e-f21d-434d-ae7e-82f8cb25f6a9 None admin] PATH_INFO: `/v3/users/b837aa4151fc426f856f309fe1286c92` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:26.092626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6ef1e-f21d-434d-ae7e-82f8cb25f6a9 None admin] RBAC: Authorizing `identity:get_user(user_id=b837aa4151fc426f856f309fe1286c92)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:26.094147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6ef1e-f21d-434d-ae7e-82f8cb25f6a9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:26.096238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 93/181] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:25 2022] GET /identity/v3/users/b837aa4151fc426f856f309fe1286c92 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:26.102537 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b466-7e83-4d9e-9e1c-129ee9b99691 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:26.102860 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b466-7e83-4d9e-9e1c-129ee9b99691 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:26.103100 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b466-7e83-4d9e-9e1c-129ee9b99691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:26.126114 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1694b466-7e83-4d9e-9e1c-129ee9b99691 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:26.128633 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1694b466-7e83-4d9e-9e1c-129ee9b99691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:26.147786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 89/182] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:26.154574 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832f4c0-a95e-4028-9cc7-0a50d98f544e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:26.215986 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:26.222196 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 94/183] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:26.231480 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694b466-7e83-4d9e-9e1c-129ee9b99691 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:26.278625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832f4c0-a95e-4028-9cc7-0a50d98f544e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:26.286280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:26.322708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dc305-4da1-4c73-b85f-774235a6241d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:26.323534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dc305-4da1-4c73-b85f-774235a6241d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:26.323830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dc305-4da1-4c73-b85f-774235a6241d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:26.324105 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dc305-4da1-4c73-b85f-774235a6241d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:26.336317 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10dc305-4da1-4c73-b85f-774235a6241d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:26.344051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f10dc305-4da1-4c73-b85f-774235a6241d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:26.344051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:26.344051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:26.344051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:26.344051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:26.344051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:26.344051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:26.344051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:26.344051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:26.344051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:26.344051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:26.344051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:26.344051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:26.344051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:26.344051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:26.344051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:26.344936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:26.344936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:26.344936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:26.344936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:26.344936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:26.344936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:26.344936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:26.344936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:26.344936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:26.344936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:26.344936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:26.344936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:26.344936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:26.344936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:26.344936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:26.344936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:26.345934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:26.345934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:26.345934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:26.345934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:26.345934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:26.345934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:26.345934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:26.345934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:26.345934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:26.345934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:26.345934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:26.345934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:26.345934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 90/184] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:11:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:26.346987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dc305-4da1-4c73-b85f-774235a6241d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:26.364176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694b466-7e83-4d9e-9e1c-129ee9b99691 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:26.397721 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b48dad-7aa6-410b-add3-bfa87c378380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:26.398420 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b48dad-7aa6-410b-add3-bfa87c378380 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:26.398708 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b48dad-7aa6-410b-add3-bfa87c378380 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:26.398985 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b48dad-7aa6-410b-add3-bfa87c378380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:26.447332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dc305-4da1-4c73-b85f-774235a6241d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:26.458441 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:26.468195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b48dad-7aa6-410b-add3-bfa87c378380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:26.469706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b48dad-7aa6-410b-add3-bfa87c378380 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:26.483935 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a72b6-da58-494a-b291-fac6bd27c0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:26.484735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a72b6-da58-494a-b291-fac6bd27c0ef None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:26.485011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a72b6-da58-494a-b291-fac6bd27c0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:26.485286 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a72b6-da58-494a-b291-fac6bd27c0ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:26.486480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a72b6-da58-494a-b291-fac6bd27c0ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:26.487948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a72b6-da58-494a-b291-fac6bd27c0ef None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:26.490412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 91/185] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:11:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:26.495425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d33c2-4a3e-413a-9322-867c7e6bb443 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:26.495425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d33c2-4a3e-413a-9322-867c7e6bb443 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:26.495425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d33c2-4a3e-413a-9322-867c7e6bb443 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:26.495425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 92/186] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:26.495425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d33c2-4a3e-413a-9322-867c7e6bb443 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:26.509461 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:26.581904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 95/187] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:26.582734 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b48dad-7aa6-410b-add3-bfa87c378380 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:26.607783 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d33c2-4a3e-413a-9322-867c7e6bb443 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:26.645831 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440454f9-cb92-4efe-9e2d-870e5a8d0b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:26.646725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440454f9-cb92-4efe-9e2d-870e5a8d0b14 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:26.647017 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440454f9-cb92-4efe-9e2d-870e5a8d0b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:26.647295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440454f9-cb92-4efe-9e2d-870e5a8d0b14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:26.660220 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440454f9-cb92-4efe-9e2d-870e5a8d0b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:26.668545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-440454f9-cb92-4efe-9e2d-870e5a8d0b14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:26.668545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:26.668545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:26.668545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:26.668545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:26.668545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:26.668545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:26.668545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:26.668545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:26.668545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:26.668545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:26.668545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:26.668545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:26.668545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:26.668545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:26.668545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:26.669579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:26.669579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:26.669579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:26.669579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:26.669579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:26.669579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:26.669579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:26.669579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:26.669579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:26.669579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:26.669579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:26.669579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:26.669579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:26.669579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:26.669579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:26.669579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:26.670413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:26.670413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:26.670413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:26.670413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:26.670413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:26.670413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:26.670413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:26.670413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:26.670413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:26.670413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:26.670413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:26.670413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:26.670413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 93/188] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:11:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:26.671070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440454f9-cb92-4efe-9e2d-870e5a8d0b14 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:26.692416 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b48dad-7aa6-410b-add3-bfa87c378380 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:26.711213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:26.727491 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a85f28-bbc2-40ef-a36d-7fc06c9b3909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:26.728176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a85f28-bbc2-40ef-a36d-7fc06c9b3909 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:26.728461 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a85f28-bbc2-40ef-a36d-7fc06c9b3909 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:26.728744 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a85f28-bbc2-40ef-a36d-7fc06c9b3909 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:26.729504 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a85f28-bbc2-40ef-a36d-7fc06c9b3909 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:26.729814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a85f28-bbc2-40ef-a36d-7fc06c9b3909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:26.731258 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a85f28-bbc2-40ef-a36d-7fc06c9b3909 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:26.732627 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:26.740266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 96/189] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:26.741509 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4461d72-b682-4d61-a16b-2ebf7aa7c572 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:26.741804 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4461d72-b682-4d61-a16b-2ebf7aa7c572 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:26.742086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4461d72-b682-4d61-a16b-2ebf7aa7c572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:26.758332 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a4461d72-b682-4d61-a16b-2ebf7aa7c572 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:26.759553 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a4461d72-b682-4d61-a16b-2ebf7aa7c572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:26.781713 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440454f9-cb92-4efe-9e2d-870e5a8d0b14 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:26.816945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f24cd-3e44-410f-87c5-2d03443e1716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:26.817609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f24cd-3e44-410f-87c5-2d03443e1716 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:26.817904 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f24cd-3e44-410f-87c5-2d03443e1716 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:26.818178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f24cd-3e44-410f-87c5-2d03443e1716 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:26.818927 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f24cd-3e44-410f-87c5-2d03443e1716 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:26.820383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f24cd-3e44-410f-87c5-2d03443e1716 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:26.827351 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 97/190] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:26.828201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4461d72-b682-4d61-a16b-2ebf7aa7c572 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:26.848483 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 94/191] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:11:26 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:11:26.849752 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f24cd-3e44-410f-87c5-2d03443e1716 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:26.959110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:26.968844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4461d72-b682-4d61-a16b-2ebf7aa7c572 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:26.973779 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f24cd-3e44-410f-87c5-2d03443e1716 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:26.998031 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:27.007835 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e721df3-6c1e-48d0-9933-f73a8dd3edb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:27.008838 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e721df3-6c1e-48d0-9933-f73a8dd3edb4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:27.009123 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e721df3-6c1e-48d0-9933-f73a8dd3edb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:27.009406 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e721df3-6c1e-48d0-9933-f73a8dd3edb4 None admin] PATH_INFO: `/v3/projects/896c28e85208446ab9ea4cb7205d2e3e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:27.011036 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e721df3-6c1e-48d0-9933-f73a8dd3edb4 None admin] RBAC: Authorizing `identity:get_project(project_id=896c28e85208446ab9ea4cb7205d2e3e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:27.012931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e721df3-6c1e-48d0-9933-f73a8dd3edb4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:27.014393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 98/192] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:26 2022] GET /identity/v3/projects/896c28e85208446ab9ea4cb7205d2e3e => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:27.020043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a6015-d82c-4211-8769-5d68b7e366f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:27.020310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e721df3-6c1e-48d0-9933-f73a8dd3edb4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:27.020892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a6015-d82c-4211-8769-5d68b7e366f1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:27.021182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a6015-d82c-4211-8769-5d68b7e366f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:27.021465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a6015-d82c-4211-8769-5d68b7e366f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:27.022276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a6015-d82c-4211-8769-5d68b7e366f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:27.022595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a6015-d82c-4211-8769-5d68b7e366f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:27.024018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a6015-d82c-4211-8769-5d68b7e366f1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:27.034073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 95/193] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:11:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:27.035130 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a6015-d82c-4211-8769-5d68b7e366f1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:27.154864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e721df3-6c1e-48d0-9933-f73a8dd3edb4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:27.174187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a6015-d82c-4211-8769-5d68b7e366f1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:27.203368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb85f2-3de7-4f45-b1af-ee43d2776321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:27.204937 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb85f2-3de7-4f45-b1af-ee43d2776321 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:27.205618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb85f2-3de7-4f45-b1af-ee43d2776321 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:27.206137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb85f2-3de7-4f45-b1af-ee43d2776321 None admin] PATH_INFO: `/v3/users/d87877ba120a42d693721bf80967f89a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:27.219160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e9784-46d6-4cd4-865b-87de8e88c86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:27.220343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e9784-46d6-4cd4-865b-87de8e88c86a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:27.220814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e9784-46d6-4cd4-865b-87de8e88c86a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:27.221266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e9784-46d6-4cd4-865b-87de8e88c86a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:27.229886 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb85f2-3de7-4f45-b1af-ee43d2776321 None admin] RBAC: Authorizing `identity:get_user(user_id=d87877ba120a42d693721bf80967f89a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:27.232260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb85f2-3de7-4f45-b1af-ee43d2776321 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:27.234238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 99/194] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:27 2022] GET /identity/v3/users/d87877ba120a42d693721bf80967f89a => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:27.237932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb85f2-3de7-4f45-b1af-ee43d2776321 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:27.238150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e9784-46d6-4cd4-865b-87de8e88c86a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:27.244056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-726e9784-46d6-4cd4-865b-87de8e88c86a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:27.244056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:27.244056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:27.244056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:27.244056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:27.244056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:27.244056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:27.244056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:27.244056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:27.244056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:27.244056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:27.244056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:27.244056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:27.244056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:27.244056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:27.244056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:27.244957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:27.244957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:27.244957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:27.244957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:27.244957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:27.244957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:27.244957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:27.244957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:27.244957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:27.244957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:27.244957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:27.244957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:27.244957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:27.244957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:27.244957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:27.244957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:27.245731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:27.245731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:27.245731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:27.245731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:27.245731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:27.245731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:27.245731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:27.245731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:27.245731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:27.245731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:27.245731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:27.245731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:27.245731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 96/195] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:27.246425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e9784-46d6-4cd4-865b-87de8e88c86a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:27.266746 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:27.310659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:27.370626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb85f2-3de7-4f45-b1af-ee43d2776321 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:27.378363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e9784-46d6-4cd4-865b-87de8e88c86a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:27.413943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2df0cf-bb22-4467-8928-4a96e9db18a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:27.415106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2df0cf-bb22-4467-8928-4a96e9db18a4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:27.415418 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2df0cf-bb22-4467-8928-4a96e9db18a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:27.415789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2df0cf-bb22-4467-8928-4a96e9db18a4 None admin] PATH_INFO: `/v3/users/d87877ba120a42d693721bf80967f89a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:27.417164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2df0cf-bb22-4467-8928-4a96e9db18a4 None admin] RBAC: Authorizing `identity:get_user(user_id=d87877ba120a42d693721bf80967f89a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:27.417558 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e052b1-24ba-4ed8-be8b-fee3dadcd199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:27.418251 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e052b1-24ba-4ed8-be8b-fee3dadcd199 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:27.418535 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e052b1-24ba-4ed8-be8b-fee3dadcd199 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:27.418812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e052b1-24ba-4ed8-be8b-fee3dadcd199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:27.419205 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2df0cf-bb22-4467-8928-4a96e9db18a4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:27.419653 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e052b1-24ba-4ed8-be8b-fee3dadcd199 None admin] RBAC: Adding query filter params (role.id=bb946622ce1842cba751c5f862237f14, scope.project.id=896c28e85208446ab9ea4cb7205d2e3e, user.id=b837aa4151fc426f856f309fe1286c92) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:27.419963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e052b1-24ba-4ed8-be8b-fee3dadcd199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:27.421191 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 97/196] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:27 2022] GET /identity/v3/users/d87877ba120a42d693721bf80967f89a => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:27.421397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e052b1-24ba-4ed8-be8b-fee3dadcd199 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:27.422137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2df0cf-bb22-4467-8928-4a96e9db18a4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:27.434854 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 100/197] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:27 2022] GET /identity/v3/role_assignments?user.id=b837aa4151fc426f856f309fe1286c92&scope.project.id=896c28e85208446ab9ea4cb7205d2e3e&role.id=bb946622ce1842cba751c5f862237f14 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:27.439006 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e052b1-24ba-4ed8-be8b-fee3dadcd199 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:27.594624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:27.619684 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e052b1-24ba-4ed8-be8b-fee3dadcd199 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:27.634094 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2df0cf-bb22-4467-8928-4a96e9db18a4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:27.657130 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:27.679828 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eab035-14cd-4e20-86a2-58dbf21aee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:27.680509 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eab035-14cd-4e20-86a2-58dbf21aee24 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:27.680798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eab035-14cd-4e20-86a2-58dbf21aee24 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:27.681075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eab035-14cd-4e20-86a2-58dbf21aee24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:27.690943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfe33c-d5b7-4c7d-adbc-fd7f91ce6257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:27.691723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfe33c-d5b7-4c7d-adbc-fd7f91ce6257 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:27.692014 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfe33c-d5b7-4c7d-adbc-fd7f91ce6257 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:27.692297 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfe33c-d5b7-4c7d-adbc-fd7f91ce6257 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:27.693086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfe33c-d5b7-4c7d-adbc-fd7f91ce6257 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:27.693398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfe33c-d5b7-4c7d-adbc-fd7f91ce6257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:27.694866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfe33c-d5b7-4c7d-adbc-fd7f91ce6257 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:27.722624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 101/198] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:27.723595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfe33c-d5b7-4c7d-adbc-fd7f91ce6257 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:27.768782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eab035-14cd-4e20-86a2-58dbf21aee24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:27.770722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eab035-14cd-4e20-86a2-58dbf21aee24 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:27.853666 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfe33c-d5b7-4c7d-adbc-fd7f91ce6257 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:27.878154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:27.904125 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493c7f0-63af-4cb2-bbcd-1b0b0ad8132e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:27.904759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493c7f0-63af-4cb2-bbcd-1b0b0ad8132e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:27.905053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493c7f0-63af-4cb2-bbcd-1b0b0ad8132e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:27.905492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493c7f0-63af-4cb2-bbcd-1b0b0ad8132e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:27.908426 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 98/199] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:27.910674 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eab035-14cd-4e20-86a2-58dbf21aee24 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:27.964825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:27.996928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493c7f0-63af-4cb2-bbcd-1b0b0ad8132e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:27.998444 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493c7f0-63af-4cb2-bbcd-1b0b0ad8132e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:28.050079 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eab035-14cd-4e20-86a2-58dbf21aee24 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:28.098416 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae33cd-f410-4a1f-92ae-0d550f50923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:28.100210 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae33cd-f410-4a1f-92ae-0d550f50923d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:28.100935 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae33cd-f410-4a1f-92ae-0d550f50923d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:28.101362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae33cd-f410-4a1f-92ae-0d550f50923d None admin] PATH_INFO: `/v3/users/31e7b636d4d3447ebd60ebae1b00a603` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:28.102890 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae33cd-f410-4a1f-92ae-0d550f50923d None admin] RBAC: Authorizing `identity:get_user(user_id=31e7b636d4d3447ebd60ebae1b00a603)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:28.108000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 102/200] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:28.108000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493c7f0-63af-4cb2-bbcd-1b0b0ad8132e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:28.111287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae33cd-f410-4a1f-92ae-0d550f50923d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:28.115571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 99/201] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:27 2022] GET /identity/v3/users/31e7b636d4d3447ebd60ebae1b00a603 => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:28.116600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae33cd-f410-4a1f-92ae-0d550f50923d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:28.197560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:28.233606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:28.239074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493c7f0-63af-4cb2-bbcd-1b0b0ad8132e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:28.261896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae33cd-f410-4a1f-92ae-0d550f50923d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:28.290788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b3296-a83e-4856-a4f0-fa95ed8d579b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:28.292023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b3296-a83e-4856-a4f0-fa95ed8d579b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:28.292330 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b3296-a83e-4856-a4f0-fa95ed8d579b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:28.292834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b3296-a83e-4856-a4f0-fa95ed8d579b None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:28.294255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b3296-a83e-4856-a4f0-fa95ed8d579b None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:28.296278 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b3296-a83e-4856-a4f0-fa95ed8d579b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:28.303313 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 103/202] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:28 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:28.303313 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b3296-a83e-4856-a4f0-fa95ed8d579b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:28.308341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a58e4-ecd3-4d77-92f9-5c927facf866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:28.309589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a58e4-ecd3-4d77-92f9-5c927facf866 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:28.310096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a58e4-ecd3-4d77-92f9-5c927facf866 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:28.310598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a58e4-ecd3-4d77-92f9-5c927facf866 None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:28.312135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a58e4-ecd3-4d77-92f9-5c927facf866 None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:28.313849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a58e4-ecd3-4d77-92f9-5c927facf866 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:28.316140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 100/203] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:28 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:28.322073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a58e4-ecd3-4d77-92f9-5c927facf866 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:28.422795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b3296-a83e-4856-a4f0-fa95ed8d579b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:28.424601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a58e4-ecd3-4d77-92f9-5c927facf866 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:28.459858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:28.464453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe1fc1-a506-41f0-9c25-3093ae17376b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:28.465203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe1fc1-a506-41f0-9c25-3093ae17376b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:28.465407 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe1fc1-a506-41f0-9c25-3093ae17376b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:28.465689 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe1fc1-a506-41f0-9c25-3093ae17376b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:28.467361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bddc94-3909-46a0-a193-695d885c5019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:28.468264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bddc94-3909-46a0-a193-695d885c5019 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:28.468779 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bddc94-3909-46a0-a193-695d885c5019 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:28.469251 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bddc94-3909-46a0-a193-695d885c5019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:28.470318 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bddc94-3909-46a0-a193-695d885c5019 None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=2ef691ae767340c29a30ccdea323f352, user.id=d87877ba120a42d693721bf80967f89a) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:28.470835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bddc94-3909-46a0-a193-695d885c5019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:28.472563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bddc94-3909-46a0-a193-695d885c5019 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:28.478770 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 101/204] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:28 2022] GET /identity/v3/role_assignments?user.id=d87877ba120a42d693721bf80967f89a&scope.project.id=2ef691ae767340c29a30ccdea323f352&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:28.482876 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:28.485044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bddc94-3909-46a0-a193-695d885c5019 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:28.546676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe1fc1-a506-41f0-9c25-3093ae17376b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:28.549200 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe1fc1-a506-41f0-9c25-3093ae17376b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:28.682030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 104/205] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:28.690471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe1fc1-a506-41f0-9c25-3093ae17376b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:28.717488 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bddc94-3909-46a0-a193-695d885c5019 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:28.768745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed406d59-59b9-46be-b1b7-ad72e70798f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:28.769537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed406d59-59b9-46be-b1b7-ad72e70798f0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:28.769995 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed406d59-59b9-46be-b1b7-ad72e70798f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:28.770311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed406d59-59b9-46be-b1b7-ad72e70798f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:28.771235 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed406d59-59b9-46be-b1b7-ad72e70798f0 None admin] RBAC: Adding query filter params (role.id=0763e374972f4ce29ab449e27fd89355, scope.project.id=2ef691ae767340c29a30ccdea323f352, user.id=d87877ba120a42d693721bf80967f89a) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:28.771556 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed406d59-59b9-46be-b1b7-ad72e70798f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:28.773134 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed406d59-59b9-46be-b1b7-ad72e70798f0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:28.797822 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 102/206] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:28 2022] GET /identity/v3/role_assignments?user.id=d87877ba120a42d693721bf80967f89a&scope.project.id=2ef691ae767340c29a30ccdea323f352&role.id=0763e374972f4ce29ab449e27fd89355 => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:28.805523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:28.872550 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe1fc1-a506-41f0-9c25-3093ae17376b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:28.921976 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428ec21-feb5-479c-8fe6-b2c3feb71113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:28.923300 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428ec21-feb5-479c-8fe6-b2c3feb71113 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:28.923821 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428ec21-feb5-479c-8fe6-b2c3feb71113 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:28.924292 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428ec21-feb5-479c-8fe6-b2c3feb71113 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:28.931259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428ec21-feb5-479c-8fe6-b2c3feb71113 None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:28.933486 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428ec21-feb5-479c-8fe6-b2c3feb71113 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:28.935952 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 105/207] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:28 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:28.942476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed406d59-59b9-46be-b1b7-ad72e70798f0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:29.006729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:29.090607 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed406d59-59b9-46be-b1b7-ad72e70798f0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:29.154051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686fdd4-e05d-40ae-8272-5fda795e9bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:29.154898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686fdd4-e05d-40ae-8272-5fda795e9bfe None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:29.155181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686fdd4-e05d-40ae-8272-5fda795e9bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:29.155535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686fdd4-e05d-40ae-8272-5fda795e9bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:29.156600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686fdd4-e05d-40ae-8272-5fda795e9bfe None admin] RBAC: Adding query filter params (role.id=084af5d7b08e4468a0c81c61f14c51eb, scope.project.id=0b20137a36384531941036a989526bd2, user.id=31e7b636d4d3447ebd60ebae1b00a603) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:29.156920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686fdd4-e05d-40ae-8272-5fda795e9bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:29.158752 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686fdd4-e05d-40ae-8272-5fda795e9bfe None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:29.172213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 103/208] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:28 2022] GET /identity/v3/role_assignments?user.id=31e7b636d4d3447ebd60ebae1b00a603&scope.project.id=0b20137a36384531941036a989526bd2&role.id=084af5d7b08e4468a0c81c61f14c51eb => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:29.295231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d32a2-b3f6-4a54-aaf6-8cb2ccc7390f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:29.295729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d32a2-b3f6-4a54-aaf6-8cb2ccc7390f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:29.295729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d32a2-b3f6-4a54-aaf6-8cb2ccc7390f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:29.297306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 106/209] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:29.303780 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01697b2b-9984-4e60-8a09-9ab845ee10d0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:29.304104 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01697b2b-9984-4e60-8a09-9ab845ee10d0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:29.304343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01697b2b-9984-4e60-8a09-9ab845ee10d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:29.327521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4eec6-627b-4648-90f9-e5c6fd2f53c5 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:29.327835 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4eec6-627b-4648-90f9-e5c6fd2f53c5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:29.328201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4eec6-627b-4648-90f9-e5c6fd2f53c5 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:29.329626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 107/210] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:11:29.330950 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-01697b2b-9984-4e60-8a09-9ab845ee10d0 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:29.333083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-01697b2b-9984-4e60-8a09-9ab845ee10d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:29.335787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b385d1-f241-4593-9ead-ddd7855ea0f9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:29.336076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b385d1-f241-4593-9ead-ddd7855ea0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:29.336352 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b385d1-f241-4593-9ead-ddd7855ea0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:29.355016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e2b385d1-f241-4593-9ead-ddd7855ea0f9 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:29.356233 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e2b385d1-f241-4593-9ead-ddd7855ea0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:29.444862 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 104/211] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:29.458991 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 108/212] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:29.471043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01697b2b-9984-4e60-8a09-9ab845ee10d0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:29.485861 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b385d1-f241-4593-9ead-ddd7855ea0f9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:29.521874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:29.551679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:29.605018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01697b2b-9984-4e60-8a09-9ab845ee10d0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:29.623116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b385d1-f241-4593-9ead-ddd7855ea0f9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:29.655540 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057641e-ed80-4c3b-884a-e26e13920cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:29.656834 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057641e-ed80-4c3b-884a-e26e13920cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:29.657743 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057641e-ed80-4c3b-884a-e26e13920cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:29.658200 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057641e-ed80-4c3b-884a-e26e13920cc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:29.672171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057641e-ed80-4c3b-884a-e26e13920cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:29.673175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12e657-1cc3-4b78-a99e-8898be45df14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:29.674080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12e657-1cc3-4b78-a99e-8898be45df14 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:29.675857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12e657-1cc3-4b78-a99e-8898be45df14 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:29.676345 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12e657-1cc3-4b78-a99e-8898be45df14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:29.677707 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12e657-1cc3-4b78-a99e-8898be45df14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:29.679286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12e657-1cc3-4b78-a99e-8898be45df14 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:29.681024 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 109/213] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:11:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:29.681797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d057641e-ed80-4c3b-884a-e26e13920cc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:29.681797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:29.681797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:29.681797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:29.681797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:29.681797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:29.681797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:29.681797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:29.681797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:29.681797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:29.681797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:29.681797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:29.681797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:29.681797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:29.681797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:29.681797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:29.683179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:29.683179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:29.683179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:29.683179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:29.683179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:29.683179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:29.683179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:29.683179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:29.683179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:29.683179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:29.683179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:29.683179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:29.683179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:29.683179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:29.683179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:29.683179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:29.683967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:29.683967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:29.683967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:29.683967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:29.683967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:29.683967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:29.683967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:29.683967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:29.683967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:29.683967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:29.683967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:29.683967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:29.686251 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 105/214] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:29.690336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12e657-1cc3-4b78-a99e-8898be45df14 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:29.692719 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057641e-ed80-4c3b-884a-e26e13920cc1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:29.810653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:29.813680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057641e-ed80-4c3b-884a-e26e13920cc1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:29.814433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12e657-1cc3-4b78-a99e-8898be45df14 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:29.830188 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:29.852874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bb54b-6ea2-47fd-9947-1b45fa715ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:29.853865 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bb54b-6ea2-47fd-9947-1b45fa715ffa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:29.854155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bb54b-6ea2-47fd-9947-1b45fa715ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:29.854514 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bb54b-6ea2-47fd-9947-1b45fa715ffa None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:29.855295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bb54b-6ea2-47fd-9947-1b45fa715ffa None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:29.855605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bb54b-6ea2-47fd-9947-1b45fa715ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:29.856921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ff7f6-bb37-40cf-bafb-85535936a018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:29.857044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bb54b-6ea2-47fd-9947-1b45fa715ffa None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:29.857920 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ff7f6-bb37-40cf-bafb-85535936a018 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:29.858628 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ff7f6-bb37-40cf-bafb-85535936a018 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:29.859104 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ff7f6-bb37-40cf-bafb-85535936a018 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:29.860122 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ff7f6-bb37-40cf-bafb-85535936a018 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:29.861782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ff7f6-bb37-40cf-bafb-85535936a018 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:29.870987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 106/215] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:29.873550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bb54b-6ea2-47fd-9947-1b45fa715ffa None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:29.900525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 110/216] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:11:29 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:11:30.003416 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bb54b-6ea2-47fd-9947-1b45fa715ffa None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:30.044865 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062a73e-6145-4748-934a-6cb5e24f7c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:30.045787 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062a73e-6145-4748-934a-6cb5e24f7c3a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:30.046082 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062a73e-6145-4748-934a-6cb5e24f7c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:30.046380 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062a73e-6145-4748-934a-6cb5e24f7c3a None admin] PATH_INFO: `/v3/users/02d77d5c69db494aac5ef45afaed7e79` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:30.062679 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062a73e-6145-4748-934a-6cb5e24f7c3a None admin] RBAC: Authorizing `identity:get_user(user_id=02d77d5c69db494aac5ef45afaed7e79)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:30.064125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062a73e-6145-4748-934a-6cb5e24f7c3a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:30.066259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 107/217] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:29 2022] GET /identity/v3/users/02d77d5c69db494aac5ef45afaed7e79 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:30.072053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ff7f6-bb37-40cf-bafb-85535936a018 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:30.194208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ff7f6-bb37-40cf-bafb-85535936a018 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:30.231234 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf759479-e6b0-4002-83cf-be31e90389dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:30.232286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf759479-e6b0-4002-83cf-be31e90389dc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:30.232795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf759479-e6b0-4002-83cf-be31e90389dc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:30.233333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf759479-e6b0-4002-83cf-be31e90389dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:30.278676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:30.323348 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf759479-e6b0-4002-83cf-be31e90389dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:30.324773 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf759479-e6b0-4002-83cf-be31e90389dc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:30.438638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 111/218] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:30.444427 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062a73e-6145-4748-934a-6cb5e24f7c3a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:30.474688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:30.584594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062a73e-6145-4748-934a-6cb5e24f7c3a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:30.626946 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9e652-8f85-41b1-af93-fb9b51d75541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:30.628249 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e652-8f85-41b1-af93-fb9b51d75541 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:30.628795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e652-8f85-41b1-af93-fb9b51d75541 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:30.629272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e652-8f85-41b1-af93-fb9b51d75541 None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:30.630744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9e652-8f85-41b1-af93-fb9b51d75541 None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:30.632432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9e652-8f85-41b1-af93-fb9b51d75541 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:30.634411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 108/219] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:30 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:30.640402 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf759479-e6b0-4002-83cf-be31e90389dc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:30.725001 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:30.770082 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf759479-e6b0-4002-83cf-be31e90389dc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:30.829468 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a49024-b388-4378-9373-e6864adb53ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:30.830158 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a49024-b388-4378-9373-e6864adb53ad None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:30.830469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a49024-b388-4378-9373-e6864adb53ad None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:30.830744 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a49024-b388-4378-9373-e6864adb53ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:30.831683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a49024-b388-4378-9373-e6864adb53ad None admin] RBAC: Adding query filter params (role.id=bb946622ce1842cba751c5f862237f14, scope.project.id=2ef691ae767340c29a30ccdea323f352, user.id=02d77d5c69db494aac5ef45afaed7e79) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:30.831976 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a49024-b388-4378-9373-e6864adb53ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:30.833562 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a49024-b388-4378-9373-e6864adb53ad None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:30.840248 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 112/220] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:30 2022] GET /identity/v3/role_assignments?user.id=02d77d5c69db494aac5ef45afaed7e79&scope.project.id=2ef691ae767340c29a30ccdea323f352&role.id=bb946622ce1842cba751c5f862237f14 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:31.002792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf4f9b-2b9a-440b-878b-805ae6c43884 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:31.003827 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf4f9b-2b9a-440b-878b-805ae6c43884 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:31.004305 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf4f9b-2b9a-440b-878b-805ae6c43884 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:31.005918 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 109/221] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:31.011933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359aecd-4052-41e1-a6d8-fe9e136910e7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:31.012228 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359aecd-4052-41e1-a6d8-fe9e136910e7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:31.012493 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359aecd-4052-41e1-a6d8-fe9e136910e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:31.039524 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5359aecd-4052-41e1-a6d8-fe9e136910e7 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:31.040787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5359aecd-4052-41e1-a6d8-fe9e136910e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:31.136973 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 113/222] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:31.175442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf4f9b-2b9a-440b-878b-805ae6c43884 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:31.295320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:31.318178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf4f9b-2b9a-440b-878b-805ae6c43884 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:31.335933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1c39b-131b-4f4b-a543-3e93ef093314 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:31.336476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1c39b-131b-4f4b-a543-3e93ef093314 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:31.336476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1c39b-131b-4f4b-a543-3e93ef093314 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:31.338164 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 114/223] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:31.345227 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb760300-e96b-4901-adfb-144c07ff62e5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:31.345517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb760300-e96b-4901-adfb-144c07ff62e5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:31.345799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb760300-e96b-4901-adfb-144c07ff62e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:31.366019 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cb760300-e96b-4901-adfb-144c07ff62e5 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:31.367255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cb760300-e96b-4901-adfb-144c07ff62e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:31.387207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a00eb-7917-4930-8c95-217d16cdf7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:31.387971 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a00eb-7917-4930-8c95-217d16cdf7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:31.388254 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a00eb-7917-4930-8c95-217d16cdf7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:31.388529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a00eb-7917-4930-8c95-217d16cdf7c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:31.411372 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a00eb-7917-4930-8c95-217d16cdf7c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:31.419325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-204a00eb-7917-4930-8c95-217d16cdf7c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:31.419325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:31.419325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:31.419325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:31.419325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:31.419325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:31.419325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:31.419325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:31.419325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:31.419325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:31.419325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:31.419325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:31.419325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:31.419325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:31.419325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:31.419325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:31.420325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:31.420325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:31.420325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:31.420325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:31.420325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:31.420325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:31.420325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:31.420325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:31.420325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:31.420325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:31.420325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:31.420325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:31.420325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:31.420325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:31.420325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:31.420325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:31.421136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:31.421136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:31.421136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:31.421136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:31.421136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:31.421136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:31.421136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:31.421136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:31.421136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:31.421136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:31.421136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:31.421136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:31.421136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 110/224] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:11:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:31.431338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a00eb-7917-4930-8c95-217d16cdf7c4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:31.437622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:31.451310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 115/225] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:31.476581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb760300-e96b-4901-adfb-144c07ff62e5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:31.593489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb760300-e96b-4901-adfb-144c07ff62e5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:31.634132 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0d799-9429-4a13-bab4-7e1d0173cb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:31.635001 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0d799-9429-4a13-bab4-7e1d0173cb89 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:31.635288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0d799-9429-4a13-bab4-7e1d0173cb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:31.635567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0d799-9429-4a13-bab4-7e1d0173cb89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:31.644199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a00eb-7917-4930-8c95-217d16cdf7c4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:31.679534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06310f-6f06-40e8-b36e-365eafe02b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:31.680224 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06310f-6f06-40e8-b36e-365eafe02b1f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:31.680670 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06310f-6f06-40e8-b36e-365eafe02b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:31.680958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06310f-6f06-40e8-b36e-365eafe02b1f None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:31.681720 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06310f-6f06-40e8-b36e-365eafe02b1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:31.682033 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06310f-6f06-40e8-b36e-365eafe02b1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:31.683816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06310f-6f06-40e8-b36e-365eafe02b1f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:31.690859 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0d799-9429-4a13-bab4-7e1d0173cb89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:31.693210 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 111/226] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:31.699180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a6e0d799-9429-4a13-bab4-7e1d0173cb89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:31.699180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:31.699180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:31.699180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:31.699180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:31.699180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:31.699180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:31.699180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:31.699180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:31.699180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:31.699180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:31.699180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:31.699180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:31.699180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:31.699180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:31.699180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:31.700260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:31.700260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:31.700260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:31.700260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:31.700260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:31.700260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:31.700260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:31.700260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:31.700260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:31.700260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:31.700260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:31.700260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:31.700260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:31.700260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:31.700260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:31.700260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:31.701253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:31.701253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:31.701253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:31.701253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:31.701253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:31.701253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:31.701253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:31.701253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:31.701253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:31.701253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:31.701253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:31.701253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:31.701253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 116/227] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:11:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:11:31.705956 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06310f-6f06-40e8-b36e-365eafe02b1f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:31.711793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0d799-9429-4a13-bab4-7e1d0173cb89 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:31.738763 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:31.802692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:31.890614 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0d799-9429-4a13-bab4-7e1d0173cb89 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:31.893885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06310f-6f06-40e8-b36e-365eafe02b1f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:31.937912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3870ed-29a0-4a43-b5b4-af7bdf392350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:31.938745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3870ed-29a0-4a43-b5b4-af7bdf392350 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:31.939032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3870ed-29a0-4a43-b5b4-af7bdf392350 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:31.939308 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3870ed-29a0-4a43-b5b4-af7bdf392350 None admin] PATH_INFO: `/v3/users/d87877ba120a42d693721bf80967f89a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:31.943333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3870ed-29a0-4a43-b5b4-af7bdf392350 None admin] RBAC: Authorizing `identity:get_user(user_id=d87877ba120a42d693721bf80967f89a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:31.944812 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3870ed-29a0-4a43-b5b4-af7bdf392350 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:31.947988 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 112/228] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:31 2022] GET /identity/v3/users/d87877ba120a42d693721bf80967f89a => generated 283 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:31.956193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3870ed-29a0-4a43-b5b4-af7bdf392350 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:31.994386 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab06ee-301e-42e2-a7f1-48cda7d70213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:31.995412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab06ee-301e-42e2-a7f1-48cda7d70213 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:31.995856 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab06ee-301e-42e2-a7f1-48cda7d70213 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:31.996278 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab06ee-301e-42e2-a7f1-48cda7d70213 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:31.997614 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab06ee-301e-42e2-a7f1-48cda7d70213 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:31.998165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab06ee-301e-42e2-a7f1-48cda7d70213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:32.000823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab06ee-301e-42e2-a7f1-48cda7d70213 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:32.028675 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 117/229] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:11:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:32.035847 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab06ee-301e-42e2-a7f1-48cda7d70213 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:32.135534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:32.159354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3870ed-29a0-4a43-b5b4-af7bdf392350 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:32.196453 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae8234-7083-45e4-ad69-a0aa8e0270f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:32.197349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae8234-7083-45e4-ad69-a0aa8e0270f2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:32.197634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae8234-7083-45e4-ad69-a0aa8e0270f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:32.197916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae8234-7083-45e4-ad69-a0aa8e0270f2 None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:32.199259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae8234-7083-45e4-ad69-a0aa8e0270f2 None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:32.200738 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae8234-7083-45e4-ad69-a0aa8e0270f2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:32.202603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 113/230] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:31 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:32.215411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae8234-7083-45e4-ad69-a0aa8e0270f2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:32.283539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab06ee-301e-42e2-a7f1-48cda7d70213 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:32.311142 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:32.356260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58348c8d-dbc6-4848-9850-965f8c2e2249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:32.357166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58348c8d-dbc6-4848-9850-965f8c2e2249 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:32.357449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58348c8d-dbc6-4848-9850-965f8c2e2249 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:32.357723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58348c8d-dbc6-4848-9850-965f8c2e2249 None admin] PATH_INFO: `/v3/users/d87877ba120a42d693721bf80967f89a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:32.358957 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58348c8d-dbc6-4848-9850-965f8c2e2249 None admin] RBAC: Authorizing `identity:get_user(user_id=d87877ba120a42d693721bf80967f89a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:32.360414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58348c8d-dbc6-4848-9850-965f8c2e2249 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:32.362086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 118/231] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:32 2022] GET /identity/v3/users/d87877ba120a42d693721bf80967f89a => generated 283 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:32.369139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58348c8d-dbc6-4848-9850-965f8c2e2249 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:32.399505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae8234-7083-45e4-ad69-a0aa8e0270f2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:32.459252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c666ed4-8b9a-46ea-bb4f-1710ed859795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:32.460076 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666ed4-8b9a-46ea-bb4f-1710ed859795 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:32.460362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666ed4-8b9a-46ea-bb4f-1710ed859795 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:32.460645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666ed4-8b9a-46ea-bb4f-1710ed859795 None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352/users/d87877ba120a42d693721bf80967f89a/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:32.467087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c666ed4-8b9a-46ea-bb4f-1710ed859795 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ef691ae767340c29a30ccdea323f352, user_id=d87877ba120a42d693721bf80967f89a, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:32.468585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c666ed4-8b9a-46ea-bb4f-1710ed859795 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:32.498246 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 114/232] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:11:32 2022] PUT /identity/v3/projects/2ef691ae767340c29a30ccdea323f352/users/d87877ba120a42d693721bf80967f89a/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:11:32.538287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58348c8d-dbc6-4848-9850-965f8c2e2249 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:32.585241 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd349ee9-7d0a-4895-9474-63dded03f21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:32.586567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd349ee9-7d0a-4895-9474-63dded03f21c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:32.587044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd349ee9-7d0a-4895-9474-63dded03f21c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:32.587552 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd349ee9-7d0a-4895-9474-63dded03f21c None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:32.589087 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd349ee9-7d0a-4895-9474-63dded03f21c None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:32.590941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd349ee9-7d0a-4895-9474-63dded03f21c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:32.593256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 119/233] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:32 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:32.599382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c666ed4-8b9a-46ea-bb4f-1710ed859795 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:32.612140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:32.770793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38e176-0e1c-41b3-bfab-4f7ddfc475bb None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:32.771447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38e176-0e1c-41b3-bfab-4f7ddfc475bb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:32.771940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38e176-0e1c-41b3-bfab-4f7ddfc475bb None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:32.773785 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 120/234] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:32.773888 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c666ed4-8b9a-46ea-bb4f-1710ed859795 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:32.784704 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb13f7-d221-4c30-a70b-81a8785f12ab None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:32.785449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb13f7-d221-4c30-a70b-81a8785f12ab None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:32.786080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb13f7-d221-4c30-a70b-81a8785f12ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:32.809706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2feb13f7-d221-4c30-a70b-81a8785f12ab None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:32.810932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2feb13f7-d221-4c30-a70b-81a8785f12ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:32.820443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23967afd-7331-477d-bf31-921de4cec22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:32.821701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23967afd-7331-477d-bf31-921de4cec22f None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:32.821987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23967afd-7331-477d-bf31-921de4cec22f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:32.822281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23967afd-7331-477d-bf31-921de4cec22f None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352/users/d87877ba120a42d693721bf80967f89a/roles/0763e374972f4ce29ab449e27fd89355` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:32.824579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23967afd-7331-477d-bf31-921de4cec22f None admin] RBAC: Authorizing `identity:create_grant(project_id=2ef691ae767340c29a30ccdea323f352, user_id=d87877ba120a42d693721bf80967f89a, role_id=0763e374972f4ce29ab449e27fd89355)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:32.826092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23967afd-7331-477d-bf31-921de4cec22f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:32.844406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 115/235] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:11:32 2022] PUT /identity/v3/projects/2ef691ae767340c29a30ccdea323f352/users/d87877ba120a42d693721bf80967f89a/roles/0763e374972f4ce29ab449e27fd89355 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:11:32.855842 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d857b1b-d961-4f2c-9f4f-6f22a1e14f08 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:32.856150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d857b1b-d961-4f2c-9f4f-6f22a1e14f08 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:32.856526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d857b1b-d961-4f2c-9f4f-6f22a1e14f08 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:32.857913 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 116/236] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:32.863870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e7a13-57aa-4d5d-9fe0-f69a27536e72 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:32.864233 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e7a13-57aa-4d5d-9fe0-f69a27536e72 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:32.864472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e7a13-57aa-4d5d-9fe0-f69a27536e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:32.874591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:32.895914 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-403e7a13-57aa-4d5d-9fe0-f69a27536e72 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:32.897132 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-403e7a13-57aa-4d5d-9fe0-f69a27536e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:32.899164 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 121/237] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:32.953727 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb13f7-d221-4c30-a70b-81a8785f12ab None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:32.966667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:32.973148 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 117/238] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:32.995992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e7a13-57aa-4d5d-9fe0-f69a27536e72 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:33.154060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e7a13-57aa-4d5d-9fe0-f69a27536e72 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:33.155132 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb13f7-d221-4c30-a70b-81a8785f12ab None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:33.196226 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ba355-c75a-46a7-bd48-4d622f5a200f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:33.197156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ba355-c75a-46a7-bd48-4d622f5a200f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:33.197438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ba355-c75a-46a7-bd48-4d622f5a200f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:33.197711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ba355-c75a-46a7-bd48-4d622f5a200f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:33.205429 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83896b16-e786-43d0-addf-df3de79d091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:33.206955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83896b16-e786-43d0-addf-df3de79d091a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:33.207249 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83896b16-e786-43d0-addf-df3de79d091a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:33.207601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83896b16-e786-43d0-addf-df3de79d091a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:33.208965 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83896b16-e786-43d0-addf-df3de79d091a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:33.210293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ba355-c75a-46a7-bd48-4d622f5a200f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:33.210795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83896b16-e786-43d0-addf-df3de79d091a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:33.212814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 122/239] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:11:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:33.218367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-116ba355-c75a-46a7-bd48-4d622f5a200f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:33.218367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:33.218367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:33.218367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:33.218367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:33.218367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:33.218367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:33.218367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:33.218367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:33.218367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:33.218367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:33.218367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:33.218367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:33.218367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:33.218367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:33.218367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:33.219275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:33.219275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:33.219275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:33.219275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:33.219275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:33.219275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:33.219275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:33.219275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:33.219275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:33.219275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:33.219275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:33.219275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:33.219275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:33.219275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:33.219275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:33.219275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:33.220723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:33.220723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:33.220723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:33.220723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:33.220723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:33.220723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:33.220723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:33.220723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:33.220723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:33.220723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:33.220723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:33.220723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:33.221323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83896b16-e786-43d0-addf-df3de79d091a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:33.221392 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 118/240] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:11:33.225721 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ba355-c75a-46a7-bd48-4d622f5a200f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:33.322214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:33.335497 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:33.412796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83896b16-e786-43d0-addf-df3de79d091a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:33.416691 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ba355-c75a-46a7-bd48-4d622f5a200f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:33.452309 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5314b-a35e-4232-af34-407ce557b9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:33.453128 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5314b-a35e-4232-af34-407ce557b9ed None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:33.453479 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5314b-a35e-4232-af34-407ce557b9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:33.453828 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5314b-a35e-4232-af34-407ce557b9ed None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:33.454699 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5314b-a35e-4232-af34-407ce557b9ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:33.456329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5314b-a35e-4232-af34-407ce557b9ed None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:33.466092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac795d66-837f-48ad-987a-c7a163f74c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:33.467912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac795d66-837f-48ad-987a-c7a163f74c65 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:33.468348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac795d66-837f-48ad-987a-c7a163f74c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:33.469082 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac795d66-837f-48ad-987a-c7a163f74c65 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:33.469953 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac795d66-837f-48ad-987a-c7a163f74c65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:33.470277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac795d66-837f-48ad-987a-c7a163f74c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:33.472001 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac795d66-837f-48ad-987a-c7a163f74c65 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:33.481063 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 123/241] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:11:33 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:11:33.487409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 119/242] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:33.487409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3210965-29e1-482c-891d-449b6a2493b6 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:33.487409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3210965-29e1-482c-891d-449b6a2493b6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:33.487409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3210965-29e1-482c-891d-449b6a2493b6 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:33.487409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 120/243] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:33.489053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3210965-29e1-482c-891d-449b6a2493b6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:33.501639 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df3296-69a8-441f-8d28-bd4ab7b8b574 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:33.502165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df3296-69a8-441f-8d28-bd4ab7b8b574 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:33.502607 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df3296-69a8-441f-8d28-bd4ab7b8b574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:33.542324 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c7df3296-69a8-441f-8d28-bd4ab7b8b574 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:33.543757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c7df3296-69a8-441f-8d28-bd4ab7b8b574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:33.716097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 124/244] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:33.717790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3210965-29e1-482c-891d-449b6a2493b6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:33.738977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:33.747436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df3296-69a8-441f-8d28-bd4ab7b8b574 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:33.764563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10ef64-2503-4961-ab74-d250449f8847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:33.766119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10ef64-2503-4961-ab74-d250449f8847 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:33.766631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10ef64-2503-4961-ab74-d250449f8847 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:33.767103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10ef64-2503-4961-ab74-d250449f8847 None admin] PATH_INFO: `/v3/users/f9fd086837254437b545ee481e08c31b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:33.790506 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10ef64-2503-4961-ab74-d250449f8847 None admin] RBAC: Authorizing `identity:get_user(user_id=f9fd086837254437b545ee481e08c31b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:33.792546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10ef64-2503-4961-ab74-d250449f8847 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:33.794621 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:33.795358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 121/245] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:33 2022] GET /identity/v3/users/f9fd086837254437b545ee481e08c31b => generated 297 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:33.801258 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10ef64-2503-4961-ab74-d250449f8847 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:33.883638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df3296-69a8-441f-8d28-bd4ab7b8b574 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:33.938940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da81b7-8419-445d-9858-cba8e6c50005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:33.940287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da81b7-8419-445d-9858-cba8e6c50005 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:33.940628 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da81b7-8419-445d-9858-cba8e6c50005 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:33.941011 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da81b7-8419-445d-9858-cba8e6c50005 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:33.950142 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10ef64-2503-4961-ab74-d250449f8847 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:33.959154 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da81b7-8419-445d-9858-cba8e6c50005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:33.970134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-61da81b7-8419-445d-9858-cba8e6c50005 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:33.970134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:33.970134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:33.970134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:33.970134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:33.970134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:33.970134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:33.970134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:33.970134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:33.970134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:33.970134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:33.970134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:33.970134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:33.970134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:33.970134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:33.970134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:33.971070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:33.971070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:33.971070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:33.971070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:33.971070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:33.971070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:33.971070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:33.971070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:33.971070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:33.971070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:33.971070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:33.971070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:33.971070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:33.971070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:33.971070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:33.971070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:33.971916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:33.971916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:33.971916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:33.971916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:33.971916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:33.971916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:33.971916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:33.971916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:33.971916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:33.971916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:33.971916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:33.971916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:33.978665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 125/246] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:33.980701 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da81b7-8419-445d-9858-cba8e6c50005 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:34.003931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06440a-d099-44f5-84ed-d2199aaba986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:34.005045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06440a-d099-44f5-84ed-d2199aaba986 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:34.005488 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06440a-d099-44f5-84ed-d2199aaba986 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:34.006077 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06440a-d099-44f5-84ed-d2199aaba986 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:34.073389 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:34.113037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06440a-d099-44f5-84ed-d2199aaba986 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:34.113379 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06440a-d099-44f5-84ed-d2199aaba986 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:34.135958 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:34.147539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da81b7-8419-445d-9858-cba8e6c50005 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:34.189971 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2eefac-a898-41b3-8598-7ad605819a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:34.190707 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2eefac-a898-41b3-8598-7ad605819a1d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:34.191037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2eefac-a898-41b3-8598-7ad605819a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:34.191400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2eefac-a898-41b3-8598-7ad605819a1d None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:34.192513 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2eefac-a898-41b3-8598-7ad605819a1d None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:34.192826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2eefac-a898-41b3-8598-7ad605819a1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:34.194731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2eefac-a898-41b3-8598-7ad605819a1d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:34.205395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 126/247] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:34.212267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2eefac-a898-41b3-8598-7ad605819a1d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:34.270745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 122/248] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:34.279620 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06440a-d099-44f5-84ed-d2199aaba986 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:34.387112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:34.409207 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2eefac-a898-41b3-8598-7ad605819a1d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:34.416660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06440a-d099-44f5-84ed-d2199aaba986 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:34.485453 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdb557-5823-4403-88e0-4c644f222e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:34.487286 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdb557-5823-4403-88e0-4c644f222e2c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:34.487567 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdb557-5823-4403-88e0-4c644f222e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:34.488096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdb557-5823-4403-88e0-4c644f222e2c None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:34.490310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdb557-5823-4403-88e0-4c644f222e2c None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:34.491803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdb557-5823-4403-88e0-4c644f222e2c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:34.493589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 123/249] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:34 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:34.500997 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbee87-4a61-44d0-9ee4-d012374a290c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:34.501919 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbee87-4a61-44d0-9ee4-d012374a290c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:34.502201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbee87-4a61-44d0-9ee4-d012374a290c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:34.502497 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbee87-4a61-44d0-9ee4-d012374a290c None admin] PATH_INFO: `/v3/users/02d77d5c69db494aac5ef45afaed7e79` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:34.504914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbee87-4a61-44d0-9ee4-d012374a290c None admin] RBAC: Authorizing `identity:get_user(user_id=02d77d5c69db494aac5ef45afaed7e79)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:34.507268 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdb557-5823-4403-88e0-4c644f222e2c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:34.507825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbee87-4a61-44d0-9ee4-d012374a290c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:34.509727 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 127/250] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:34 2022] GET /identity/v3/users/02d77d5c69db494aac5ef45afaed7e79 => generated 297 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:34.516196 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbee87-4a61-44d0-9ee4-d012374a290c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:34.608605 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:34.753112 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbee87-4a61-44d0-9ee4-d012374a290c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:34.796505 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b61e0-3f6b-4906-8532-c31279a5ea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:34.798237 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b61e0-3f6b-4906-8532-c31279a5ea5a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:34.798747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b61e0-3f6b-4906-8532-c31279a5ea5a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:34.799217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b61e0-3f6b-4906-8532-c31279a5ea5a None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:34.800887 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b61e0-3f6b-4906-8532-c31279a5ea5a None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:34.802768 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b61e0-3f6b-4906-8532-c31279a5ea5a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:34.805017 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 128/251] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:34 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:34.808541 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdb557-5823-4403-88e0-4c644f222e2c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:34.810748 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b61e0-3f6b-4906-8532-c31279a5ea5a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:34.888504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17161aef-7ce9-4126-ad28-3512bf9b954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:34.889238 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17161aef-7ce9-4126-ad28-3512bf9b954d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:34.889473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17161aef-7ce9-4126-ad28-3512bf9b954d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:34.889760 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17161aef-7ce9-4126-ad28-3512bf9b954d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:34.890746 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17161aef-7ce9-4126-ad28-3512bf9b954d None admin] RBAC: Adding query filter params (role.id=084af5d7b08e4468a0c81c61f14c51eb, scope.project.id=2ef691ae767340c29a30ccdea323f352, user.id=f9fd086837254437b545ee481e08c31b) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:34.891067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17161aef-7ce9-4126-ad28-3512bf9b954d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:34.892667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17161aef-7ce9-4126-ad28-3512bf9b954d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:34.904748 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 124/252] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:34 2022] GET /identity/v3/role_assignments?user.id=f9fd086837254437b545ee481e08c31b&scope.project.id=2ef691ae767340c29a30ccdea323f352&role.id=084af5d7b08e4468a0c81c61f14c51eb => generated 259 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:34.948655 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:34.963949 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b61e0-3f6b-4906-8532-c31279a5ea5a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:35.020489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e638a61-0a46-496f-bbe0-1e4610442263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:35.021432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e638a61-0a46-496f-bbe0-1e4610442263 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:35.021719 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e638a61-0a46-496f-bbe0-1e4610442263 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:35.022000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e638a61-0a46-496f-bbe0-1e4610442263 None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352/users/02d77d5c69db494aac5ef45afaed7e79/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:35.024213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e638a61-0a46-496f-bbe0-1e4610442263 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ef691ae767340c29a30ccdea323f352, user_id=02d77d5c69db494aac5ef45afaed7e79, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:35.025742 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e638a61-0a46-496f-bbe0-1e4610442263 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:35.044510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 129/253] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:11:34 2022] PUT /identity/v3/projects/2ef691ae767340c29a30ccdea323f352/users/02d77d5c69db494aac5ef45afaed7e79/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:11:35.205293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42f840-4672-479b-9ddb-c6fc4335c0d3 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:35.205666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42f840-4672-479b-9ddb-c6fc4335c0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:35.205939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42f840-4672-479b-9ddb-c6fc4335c0d3 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:35.207760 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 125/254] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:35.213370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd430b0-6523-4f15-85ce-282856098522 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:35.213669 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd430b0-6523-4f15-85ce-282856098522 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:35.213947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd430b0-6523-4f15-85ce-282856098522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:35.236106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4dd430b0-6523-4f15-85ce-282856098522 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:35.237373 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4dd430b0-6523-4f15-85ce-282856098522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:35.335735 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 130/255] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:35.361331 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42f840-4672-479b-9ddb-c6fc4335c0d3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:35.377884 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:35.487300 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42f840-4672-479b-9ddb-c6fc4335c0d3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:35.538636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9b12e-6fd9-44e1-9459-2df2914d8d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:35.539576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9b12e-6fd9-44e1-9459-2df2914d8d3c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:35.539869 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9b12e-6fd9-44e1-9459-2df2914d8d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:35.540147 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9b12e-6fd9-44e1-9459-2df2914d8d3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:35.553956 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9b12e-6fd9-44e1-9459-2df2914d8d3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:35.562166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-afb9b12e-6fd9-44e1-9459-2df2914d8d3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:35.562166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:35.562166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:35.562166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:35.562166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:35.562166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:35.562166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:35.562166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:35.562166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:35.562166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:35.562166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:35.562166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:35.562166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:35.562166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:35.562166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:35.562166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:35.563072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:35.563072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:35.563072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:35.563072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:35.563072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:35.563072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:35.563072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:35.563072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:35.563072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:35.563072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:35.563072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:35.563072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:35.563072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:35.563072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:35.563072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:35.563072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:35.563871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:35.563871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:35.563871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:35.563871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:35.563871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:35.563871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:35.563871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:35.563871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:35.563871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:35.563871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:35.563871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:35.563871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:35.563871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 126/256] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:11:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:35.569893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd430b0-6523-4f15-85ce-282856098522 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:35.696567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:35.721498 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd430b0-6523-4f15-85ce-282856098522 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:35.767800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbd0e3-aad0-4e7b-a0c4-c12fa5affebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:35.768426 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbd0e3-aad0-4e7b-a0c4-c12fa5affebf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:35.768709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbd0e3-aad0-4e7b-a0c4-c12fa5affebf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:35.769050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbd0e3-aad0-4e7b-a0c4-c12fa5affebf None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:35.769847 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbd0e3-aad0-4e7b-a0c4-c12fa5affebf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:35.770163 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbd0e3-aad0-4e7b-a0c4-c12fa5affebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:35.771609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbd0e3-aad0-4e7b-a0c4-c12fa5affebf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:35.784316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 131/257] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:35.790890 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9b12e-6fd9-44e1-9459-2df2914d8d3c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:35.886262 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:35.896531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a1251-acc6-416c-9606-cc85f1f323cc None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:35.897161 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a1251-acc6-416c-9606-cc85f1f323cc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:35.897641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a1251-acc6-416c-9606-cc85f1f323cc None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:35.899262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 132/258] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:11:35.904800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65dfa1-e431-4ac3-97e6-729423f13c8e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:35.905385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65dfa1-e431-4ac3-97e6-729423f13c8e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:35.905861 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65dfa1-e431-4ac3-97e6-729423f13c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:35.936684 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3c65dfa1-e431-4ac3-97e6-729423f13c8e None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:35.938282 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3c65dfa1-e431-4ac3-97e6-729423f13c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:35.939442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9b12e-6fd9-44e1-9459-2df2914d8d3c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:35.995560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053b2b5-bb47-4c3d-8ef6-3e9d6cbfa8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:35.996481 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053b2b5-bb47-4c3d-8ef6-3e9d6cbfa8cd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:35.996763 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053b2b5-bb47-4c3d-8ef6-3e9d6cbfa8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:35.997042 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053b2b5-bb47-4c3d-8ef6-3e9d6cbfa8cd None admin] PATH_INFO: `/v3/users/d87877ba120a42d693721bf80967f89a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:35.998332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053b2b5-bb47-4c3d-8ef6-3e9d6cbfa8cd None admin] RBAC: Authorizing `identity:get_user(user_id=d87877ba120a42d693721bf80967f89a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:35.999840 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053b2b5-bb47-4c3d-8ef6-3e9d6cbfa8cd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:36.001845 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 127/259] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:35 2022] GET /identity/v3/users/d87877ba120a42d693721bf80967f89a => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:36.010877 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053b2b5-bb47-4c3d-8ef6-3e9d6cbfa8cd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:36.093177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 133/260] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:36.133967 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65dfa1-e431-4ac3-97e6-729423f13c8e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:36.179794 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053b2b5-bb47-4c3d-8ef6-3e9d6cbfa8cd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:36.215937 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30ac24-8671-4b2d-8aed-3e16512efe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:36.216609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ac24-8671-4b2d-8aed-3e16512efe32 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:36.217114 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ac24-8671-4b2d-8aed-3e16512efe32 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:36.217560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ac24-8671-4b2d-8aed-3e16512efe32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:36.223061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:36.318649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:36.321297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30ac24-8671-4b2d-8aed-3e16512efe32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:36.323066 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30ac24-8671-4b2d-8aed-3e16512efe32 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:36.400540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65dfa1-e431-4ac3-97e6-729423f13c8e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:36.495319 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 128/261] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:36.504403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30ac24-8671-4b2d-8aed-3e16512efe32 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:36.552116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c85265-b9ce-44cf-84e2-5cbe0ef6932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:36.554006 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c85265-b9ce-44cf-84e2-5cbe0ef6932e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:36.554692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c85265-b9ce-44cf-84e2-5cbe0ef6932e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:36.555357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c85265-b9ce-44cf-84e2-5cbe0ef6932e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:36.595538 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c85265-b9ce-44cf-84e2-5cbe0ef6932e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:36.611089 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:36.616970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a2c85265-b9ce-44cf-84e2-5cbe0ef6932e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:36.616970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:36.616970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:36.616970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:36.616970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:36.616970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:36.616970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:36.616970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:36.616970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:36.616970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:36.616970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:36.616970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:36.616970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:36.616970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:36.616970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:36.616970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:36.618864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:36.618864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:36.618864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:36.618864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:36.618864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:36.618864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:36.618864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:36.618864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:36.618864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:36.618864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:36.618864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:36.618864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:36.618864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:36.618864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:36.618864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:36.618864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:36.621049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:36.621049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:36.621049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:36.621049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:36.621049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:36.621049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:36.621049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:36.621049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:36.621049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:36.621049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:36.621049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:36.621049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:36.622262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 134/262] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:11:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 488 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:36.642006 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c85265-b9ce-44cf-84e2-5cbe0ef6932e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:36.805991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30ac24-8671-4b2d-8aed-3e16512efe32 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:36.877786 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c85265-b9ce-44cf-84e2-5cbe0ef6932e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:36.924058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc9683-6b6e-4012-8edb-d9ef2a4b9c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:36.925003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d37e8d-f21f-46a3-a456-dcc5e099f8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:36.926184 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc9683-6b6e-4012-8edb-d9ef2a4b9c3b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:36.927042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d37e8d-f21f-46a3-a456-dcc5e099f8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:36.927469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d37e8d-f21f-46a3-a456-dcc5e099f8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:36.927889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc9683-6b6e-4012-8edb-d9ef2a4b9c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:36.928334 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d37e8d-f21f-46a3-a456-dcc5e099f8a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:36.928747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc9683-6b6e-4012-8edb-d9ef2a4b9c3b None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:36.930432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d37e8d-f21f-46a3-a456-dcc5e099f8a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:36.930797 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d37e8d-f21f-46a3-a456-dcc5e099f8a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:36.931457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc9683-6b6e-4012-8edb-d9ef2a4b9c3b None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:36.932243 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d37e8d-f21f-46a3-a456-dcc5e099f8a2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:36.933711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc9683-6b6e-4012-8edb-d9ef2a4b9c3b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:36.934244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:36.936637 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 129/263] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:36 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:36.938183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944b500-e2a1-46c3-974f-9cadb748aed5 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:36.938754 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944b500-e2a1-46c3-974f-9cadb748aed5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:36.939539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944b500-e2a1-46c3-974f-9cadb748aed5 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:36.941107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 130/264] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:36.942040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944b500-e2a1-46c3-974f-9cadb748aed5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:36.964360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 135/265] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:11:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:36.966119 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ed52d-46e1-4cf3-9f8f-de6bfb685c2a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:36.966668 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ed52d-46e1-4cf3-9f8f-de6bfb685c2a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:36.967157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ed52d-46e1-4cf3-9f8f-de6bfb685c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:37.006345 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d03ed52d-46e1-4cf3-9f8f-de6bfb685c2a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:37.009294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d03ed52d-46e1-4cf3-9f8f-de6bfb685c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:37.139803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 136/266] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:37.140680 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ed52d-46e1-4cf3-9f8f-de6bfb685c2a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:37.153637 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944b500-e2a1-46c3-974f-9cadb748aed5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:37.161932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:37.210378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a21ef0-a21d-4941-bd44-1bd8d253928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:37.211062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a21ef0-a21d-4941-bd44-1bd8d253928f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:37.211372 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a21ef0-a21d-4941-bd44-1bd8d253928f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:37.211652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a21ef0-a21d-4941-bd44-1bd8d253928f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:37.212507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a21ef0-a21d-4941-bd44-1bd8d253928f None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=2ef691ae767340c29a30ccdea323f352, user.id=d87877ba120a42d693721bf80967f89a) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:37.212873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a21ef0-a21d-4941-bd44-1bd8d253928f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:37.214427 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a21ef0-a21d-4941-bd44-1bd8d253928f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:37.222192 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 131/267] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:36 2022] GET /identity/v3/role_assignments?user.id=d87877ba120a42d693721bf80967f89a&scope.project.id=2ef691ae767340c29a30ccdea323f352&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:37.223060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a21ef0-a21d-4941-bd44-1bd8d253928f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:37.330323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ed52d-46e1-4cf3-9f8f-de6bfb685c2a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:37.361824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:37.371238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca745e1d-5ce1-4262-a9b4-43a7bc7df3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:37.372717 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca745e1d-5ce1-4262-a9b4-43a7bc7df3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:37.373152 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca745e1d-5ce1-4262-a9b4-43a7bc7df3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:37.373562 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca745e1d-5ce1-4262-a9b4-43a7bc7df3a9 None admin] PATH_INFO: `/v3/users/d87877ba120a42d693721bf80967f89a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:37.375297 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca745e1d-5ce1-4262-a9b4-43a7bc7df3a9 None admin] RBAC: Authorizing `identity:get_user(user_id=d87877ba120a42d693721bf80967f89a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:37.376988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca745e1d-5ce1-4262-a9b4-43a7bc7df3a9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:37.379602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 137/268] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:37 2022] GET /identity/v3/users/d87877ba120a42d693721bf80967f89a => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:37.385889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca745e1d-5ce1-4262-a9b4-43a7bc7df3a9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:37.453647 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a21ef0-a21d-4941-bd44-1bd8d253928f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:37.495318 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68129a81-16de-407c-88cb-a1cc9b65699b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:37.496539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68129a81-16de-407c-88cb-a1cc9b65699b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:37.497506 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68129a81-16de-407c-88cb-a1cc9b65699b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:37.497963 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68129a81-16de-407c-88cb-a1cc9b65699b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:37.499579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68129a81-16de-407c-88cb-a1cc9b65699b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:37.501286 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68129a81-16de-407c-88cb-a1cc9b65699b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:37.503806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 132/269] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:11:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:37.505698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d579f-a06f-40e8-badf-52493b0907fb None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:37.506298 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d579f-a06f-40e8-badf-52493b0907fb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:37.506752 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d579f-a06f-40e8-badf-52493b0907fb None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:37.508667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 133/270] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:37.514322 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d579f-a06f-40e8-badf-52493b0907fb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:37.526670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca745e1d-5ce1-4262-a9b4-43a7bc7df3a9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:37.558121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:37.578468 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3eba0-a864-4719-a6a6-2de0fb908d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:37.579151 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3eba0-a864-4719-a6a6-2de0fb908d07 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:37.579439 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3eba0-a864-4719-a6a6-2de0fb908d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:37.579722 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3eba0-a864-4719-a6a6-2de0fb908d07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:37.648111 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d579f-a06f-40e8-badf-52493b0907fb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:37.651038 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:37.660233 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3eba0-a864-4719-a6a6-2de0fb908d07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:37.662203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3eba0-a864-4719-a6a6-2de0fb908d07 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:37.689365 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34d4fd-9fb3-4bd4-ac7d-0ce8f16f6ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:37.690114 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34d4fd-9fb3-4bd4-ac7d-0ce8f16f6ed7 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:37.690436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34d4fd-9fb3-4bd4-ac7d-0ce8f16f6ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:37.690806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34d4fd-9fb3-4bd4-ac7d-0ce8f16f6ed7 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:37.691546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34d4fd-9fb3-4bd4-ac7d-0ce8f16f6ed7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:37.693093 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34d4fd-9fb3-4bd4-ac7d-0ce8f16f6ed7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:37.722628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 134/271] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:11:37 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:11:37.725107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dc80b-ac0b-4b46-a12f-920d6cde2537 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:37.725485 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dc80b-ac0b-4b46-a12f-920d6cde2537 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:37.725839 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dc80b-ac0b-4b46-a12f-920d6cde2537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:37.749751 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-018dc80b-ac0b-4b46-a12f-920d6cde2537 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:37.751111 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-018dc80b-ac0b-4b46-a12f-920d6cde2537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:37.789040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 138/272] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:37.794776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3eba0-a864-4719-a6a6-2de0fb908d07 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:37.856056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 135/273] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:37.919184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:37.919369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dc80b-ac0b-4b46-a12f-920d6cde2537 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:37.929492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3eba0-a864-4719-a6a6-2de0fb908d07 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:37.977143 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:37.992448 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d3a40-efae-4ccf-9521-0268f8197c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:37.993749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d3a40-efae-4ccf-9521-0268f8197c89 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:37.994492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d3a40-efae-4ccf-9521-0268f8197c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:37.996102 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d3a40-efae-4ccf-9521-0268f8197c89 None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:37.997723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d3a40-efae-4ccf-9521-0268f8197c89 None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:37.999517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d3a40-efae-4ccf-9521-0268f8197c89 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:38.002593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 139/274] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:37 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:38.010862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d3a40-efae-4ccf-9521-0268f8197c89 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:38.089861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dc80b-ac0b-4b46-a12f-920d6cde2537 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:38.145007 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b41038-952e-475f-9210-f509c7c4cecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:38.145932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b41038-952e-475f-9210-f509c7c4cecb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:38.146258 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b41038-952e-475f-9210-f509c7c4cecb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:38.146653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b41038-952e-475f-9210-f509c7c4cecb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:38.158731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b41038-952e-475f-9210-f509c7c4cecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:38.168348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a3b41038-952e-475f-9210-f509c7c4cecb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:38.168348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:38.168348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:38.168348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:38.168348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:38.168348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:38.168348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:38.168348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:38.168348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:38.168348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:38.168348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:38.168348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:38.168348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:38.168348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:38.168348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:38.168348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:38.169330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:38.169330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:38.169330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:38.169330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:38.169330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:38.169330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:38.169330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:38.169330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:38.169330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:38.169330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:38.169330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:38.169330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:38.169330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:38.169330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:38.169330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:38.169330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:38.171232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:38.171232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:38.171232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:38.171232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:38.171232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:38.171232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:38.171232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:38.171232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:38.171232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:38.171232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:38.171232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:38.171232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:38.171232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 136/275] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:38.171232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d31990-338a-4f7c-94d2-fc0aa51d510f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:38.172671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d31990-338a-4f7c-94d2-fc0aa51d510f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:38.172671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d31990-338a-4f7c-94d2-fc0aa51d510f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:38.172909 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 137/276] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:38.178316 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d31990-338a-4f7c-94d2-fc0aa51d510f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:38.180156 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d3a40-efae-4ccf-9521-0268f8197c89 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:38.234782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a9581-658e-4be5-990c-9b463b9aadeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:38.235456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a9581-658e-4be5-990c-9b463b9aadeb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:38.235745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a9581-658e-4be5-990c-9b463b9aadeb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:38.236023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a9581-658e-4be5-990c-9b463b9aadeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:38.236876 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a9581-658e-4be5-990c-9b463b9aadeb None admin] RBAC: Adding query filter params (role.id=0763e374972f4ce29ab449e27fd89355, scope.project.id=2ef691ae767340c29a30ccdea323f352, user.id=d87877ba120a42d693721bf80967f89a) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:38.237200 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a9581-658e-4be5-990c-9b463b9aadeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:38.239642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a9581-658e-4be5-990c-9b463b9aadeb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:38.248757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 140/277] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:38 2022] GET /identity/v3/role_assignments?user.id=d87877ba120a42d693721bf80967f89a&scope.project.id=2ef691ae767340c29a30ccdea323f352&role.id=0763e374972f4ce29ab449e27fd89355 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:38.250472 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da0925-9cde-4afe-a1b3-bfc89078675c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:38.250990 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da0925-9cde-4afe-a1b3-bfc89078675c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:38.251467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da0925-9cde-4afe-a1b3-bfc89078675c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:38.275905 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-92da0925-9cde-4afe-a1b3-bfc89078675c None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:38.278285 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-92da0925-9cde-4afe-a1b3-bfc89078675c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:38.310368 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:38.311802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:38.341778 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d31990-338a-4f7c-94d2-fc0aa51d510f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:38.382389 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 141/278] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:38.384468 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1c626-d0ed-4d5e-b646-f8bba4c476ed None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:38.385087 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1c626-d0ed-4d5e-b646-f8bba4c476ed None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:38.385908 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1c626-d0ed-4d5e-b646-f8bba4c476ed None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:38.388155 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 142/279] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:38.394320 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f11684-3b67-40b1-9db5-6ce5f9eaa459 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:38.394983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f11684-3b67-40b1-9db5-6ce5f9eaa459 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:38.395438 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f11684-3b67-40b1-9db5-6ce5f9eaa459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:38.395886 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b4720-19d4-4776-a6d9-e5d55497e768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:38.396704 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b4720-19d4-4776-a6d9-e5d55497e768 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:38.397062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b4720-19d4-4776-a6d9-e5d55497e768 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:38.397412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b4720-19d4-4776-a6d9-e5d55497e768 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:38.398512 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b4720-19d4-4776-a6d9-e5d55497e768 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:38.398983 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b4720-19d4-4776-a6d9-e5d55497e768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:38.400664 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b4720-19d4-4776-a6d9-e5d55497e768 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:38.413919 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 138/280] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:38.420739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d5f11684-3b67-40b1-9db5-6ce5f9eaa459 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:38.421978 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b4720-19d4-4776-a6d9-e5d55497e768 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:38.423791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d5f11684-3b67-40b1-9db5-6ce5f9eaa459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:38.522485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 143/281] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:38.524034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f11684-3b67-40b1-9db5-6ce5f9eaa459 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:38.549125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b4720-19d4-4776-a6d9-e5d55497e768 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:38.590401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdc78e-834a-49c9-9be4-01de72b8326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:38.591570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdc78e-834a-49c9-9be4-01de72b8326a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:38.592020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdc78e-834a-49c9-9be4-01de72b8326a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:38.592438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdc78e-834a-49c9-9be4-01de72b8326a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:38.606952 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdc78e-834a-49c9-9be4-01de72b8326a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:38.616916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-fcfdc78e-834a-49c9-9be4-01de72b8326a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:38.616916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:38.616916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:38.616916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:38.616916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:38.616916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:38.616916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:38.616916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:38.616916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:38.616916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:38.616916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:38.616916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:38.616916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:38.616916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:38.616916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:38.616916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:38.618106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:38.618106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:38.618106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:38.618106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:38.618106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:38.618106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:38.618106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:38.618106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:38.618106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:38.618106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:38.618106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:38.618106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:38.618106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:38.618106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:38.618106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:38.618106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:38.619146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:38.619146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:38.619146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:38.619146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:38.619146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:38.619146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:38.619146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:38.619146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:38.619146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:38.619146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:38.619146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:38.619146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:38.621278 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 139/282] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:38.622377 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdc78e-834a-49c9-9be4-01de72b8326a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:38.626626 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:38.652304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f11684-3b67-40b1-9db5-6ce5f9eaa459 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:38.694332 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c945e-e09f-48cc-8b74-3fbb2f3ac661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:38.695500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c945e-e09f-48cc-8b74-3fbb2f3ac661 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:38.695500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c945e-e09f-48cc-8b74-3fbb2f3ac661 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:38.695799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c945e-e09f-48cc-8b74-3fbb2f3ac661 None admin] PATH_INFO: `/v3/users/3286db4f82214fbf94467bb57a0612a0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:38.706791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:38.714695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c945e-e09f-48cc-8b74-3fbb2f3ac661 None admin] RBAC: Authorizing `identity:get_user(user_id=3286db4f82214fbf94467bb57a0612a0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:38.717052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c945e-e09f-48cc-8b74-3fbb2f3ac661 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:38.718511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 144/283] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:38 2022] GET /identity/v3/users/3286db4f82214fbf94467bb57a0612a0 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:38.719603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c945e-e09f-48cc-8b74-3fbb2f3ac661 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:38.765033 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdc78e-834a-49c9-9be4-01de72b8326a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:38.805728 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f93fff-ed71-46d5-8e5f-6ecc5f04ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:38.806680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f93fff-ed71-46d5-8e5f-6ecc5f04ae93 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:38.807112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f93fff-ed71-46d5-8e5f-6ecc5f04ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:38.807765 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f93fff-ed71-46d5-8e5f-6ecc5f04ae93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:38.819724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f93fff-ed71-46d5-8e5f-6ecc5f04ae93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:38.828486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-10f93fff-ed71-46d5-8e5f-6ecc5f04ae93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:38.828486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:38.828486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:38.828486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:38.828486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:38.828486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:38.828486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:38.828486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:38.828486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:38.828486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:38.828486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:38.828486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:38.828486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:38.828486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:38.828486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:38.828486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:38.829498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:38.829498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:38.829498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:38.829498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:38.829498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:38.829498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:38.829498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:38.829498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:38.829498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:38.829498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:38.829498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:38.829498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:38.829498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:38.829498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:38.829498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:38.829498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:38.830398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:38.830398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:38.830398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:38.830398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:38.830398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:38.830398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:38.830398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:38.830398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:38.830398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:38.830398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:38.830398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:38.830398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:38.831004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 140/284] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:38.832667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f93fff-ed71-46d5-8e5f-6ecc5f04ae93 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:38.851001 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c945e-e09f-48cc-8b74-3fbb2f3ac661 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:38.902586 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:38.903549 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e70b5-94dd-431b-a69d-76bed7d58f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:38.904705 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e70b5-94dd-431b-a69d-76bed7d58f69 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:38.905132 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e70b5-94dd-431b-a69d-76bed7d58f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:38.905548 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e70b5-94dd-431b-a69d-76bed7d58f69 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:38.906634 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e70b5-94dd-431b-a69d-76bed7d58f69 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:38.907085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e70b5-94dd-431b-a69d-76bed7d58f69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:38.908819 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e70b5-94dd-431b-a69d-76bed7d58f69 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:38.919698 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 145/285] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:38.920739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e70b5-94dd-431b-a69d-76bed7d58f69 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:38.931564 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:38.956527 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f93fff-ed71-46d5-8e5f-6ecc5f04ae93 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:38.992874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccfdcc-fbf8-41a2-91af-271aceea23a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:38.993779 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfdcc-fbf8-41a2-91af-271aceea23a9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:38.994135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfdcc-fbf8-41a2-91af-271aceea23a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:38.994668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfdcc-fbf8-41a2-91af-271aceea23a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:38.995612 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccfdcc-fbf8-41a2-91af-271aceea23a9 None admin] RBAC: Adding query filter params (role.id=bb946622ce1842cba751c5f862237f14, user.id=3286db4f82214fbf94467bb57a0612a0, scope.system=all) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:38.995994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccfdcc-fbf8-41a2-91af-271aceea23a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:38.997639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccfdcc-fbf8-41a2-91af-271aceea23a9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:39.003770 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 141/286] 10.222.0.33 () {56 vars in 1308 bytes} [Mon Jun 27 15:11:38 2022] GET /identity/v3/role_assignments?user.id=3286db4f82214fbf94467bb57a0612a0&scope.system=all&role.id=bb946622ce1842cba751c5f862237f14 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:39.004598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccfdcc-fbf8-41a2-91af-271aceea23a9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:39.047922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e70b5-94dd-431b-a69d-76bed7d58f69 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:39.094595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c36c9e-dfa2-4d16-8879-615809f0a3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:39.095671 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c36c9e-dfa2-4d16-8879-615809f0a3fe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:39.096441 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c36c9e-dfa2-4d16-8879-615809f0a3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:39.098540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c36c9e-dfa2-4d16-8879-615809f0a3fe None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:39.099572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c36c9e-dfa2-4d16-8879-615809f0a3fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:39.101396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c36c9e-dfa2-4d16-8879-615809f0a3fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:39.104084 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c36c9e-dfa2-4d16-8879-615809f0a3fe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:39.134273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 146/287] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:39.140244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c36c9e-dfa2-4d16-8879-615809f0a3fe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:39.207194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccfdcc-fbf8-41a2-91af-271aceea23a9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:39.242668 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:39.247107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:39.257679 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1b499-b39e-453f-9a41-85d30853fd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:39.258737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1b499-b39e-453f-9a41-85d30853fd3d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:39.259119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1b499-b39e-453f-9a41-85d30853fd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:39.259384 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1b499-b39e-453f-9a41-85d30853fd3d None admin] PATH_INFO: `/v3/users/02d77d5c69db494aac5ef45afaed7e79` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:39.260701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1b499-b39e-453f-9a41-85d30853fd3d None admin] RBAC: Authorizing `identity:get_user(user_id=02d77d5c69db494aac5ef45afaed7e79)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:39.262368 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1b499-b39e-453f-9a41-85d30853fd3d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:39.264161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 142/288] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:39 2022] GET /identity/v3/users/02d77d5c69db494aac5ef45afaed7e79 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:39.270046 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1b499-b39e-453f-9a41-85d30853fd3d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:39.283539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c36c9e-dfa2-4d16-8879-615809f0a3fe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:39.351068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f9f7e-e42b-4e18-bffa-470afba8267d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:39.353165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f9f7e-e42b-4e18-bffa-470afba8267d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:39.353453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f9f7e-e42b-4e18-bffa-470afba8267d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:39.353730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f9f7e-e42b-4e18-bffa-470afba8267d None admin] PATH_INFO: `/v3/users/f9fd086837254437b545ee481e08c31b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:39.355159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f9f7e-e42b-4e18-bffa-470afba8267d None admin] RBAC: Authorizing `identity:get_user(user_id=f9fd086837254437b545ee481e08c31b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:39.357487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f9f7e-e42b-4e18-bffa-470afba8267d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:39.362549 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 147/289] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:39 2022] GET /identity/v3/users/f9fd086837254437b545ee481e08c31b => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:39.366344 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f9f7e-e42b-4e18-bffa-470afba8267d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:39.430246 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1b499-b39e-453f-9a41-85d30853fd3d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:39.477574 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a63e3-b816-4ced-bb85-42e0e21f9922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:39.478170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a63e3-b816-4ced-bb85-42e0e21f9922 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:39.478545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a63e3-b816-4ced-bb85-42e0e21f9922 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:39.478835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a63e3-b816-4ced-bb85-42e0e21f9922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:39.563999 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f9f7e-e42b-4e18-bffa-470afba8267d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:39.594014 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:39.606210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9fc07-9c6c-4b42-911f-b241ca6e141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:39.607443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9fc07-9c6c-4b42-911f-b241ca6e141f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:39.608609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a63e3-b816-4ced-bb85-42e0e21f9922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:39.609103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9fc07-9c6c-4b42-911f-b241ca6e141f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:39.609600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9fc07-9c6c-4b42-911f-b241ca6e141f None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:39.612216 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a63e3-b816-4ced-bb85-42e0e21f9922 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:39.613130 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9fc07-9c6c-4b42-911f-b241ca6e141f None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:39.615830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9fc07-9c6c-4b42-911f-b241ca6e141f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:39.619044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 148/290] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:39 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:39.626946 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9fc07-9c6c-4b42-911f-b241ca6e141f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:39.650638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:39.752330 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9fc07-9c6c-4b42-911f-b241ca6e141f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:39.792146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa12047-161a-4786-9dfc-67a44b1e968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:39.793428 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa12047-161a-4786-9dfc-67a44b1e968e None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:39.793908 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa12047-161a-4786-9dfc-67a44b1e968e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:39.794480 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa12047-161a-4786-9dfc-67a44b1e968e None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352/users/f9fd086837254437b545ee481e08c31b/roles/084af5d7b08e4468a0c81c61f14c51eb` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:39.797343 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa12047-161a-4786-9dfc-67a44b1e968e None admin] RBAC: Authorizing `identity:create_grant(project_id=2ef691ae767340c29a30ccdea323f352, user_id=f9fd086837254437b545ee481e08c31b, role_id=084af5d7b08e4468a0c81c61f14c51eb)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:39.799168 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa12047-161a-4786-9dfc-67a44b1e968e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:39.805861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 143/291] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:39.814321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a63e3-b816-4ced-bb85-42e0e21f9922 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:39.829162 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 149/292] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:11:39 2022] PUT /identity/v3/projects/2ef691ae767340c29a30ccdea323f352/users/f9fd086837254437b545ee481e08c31b/roles/084af5d7b08e4468a0c81c61f14c51eb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:11:39.921352 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:39.928749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a63e3-b816-4ced-bb85-42e0e21f9922 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:39.969465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ec6f8-cc20-4832-b4f5-dadd8cde68fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:39.970773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ec6f8-cc20-4832-b4f5-dadd8cde68fb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:39.971264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ec6f8-cc20-4832-b4f5-dadd8cde68fb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:39.971708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ec6f8-cc20-4832-b4f5-dadd8cde68fb None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:39.973316 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ec6f8-cc20-4832-b4f5-dadd8cde68fb None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:39.975025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ec6f8-cc20-4832-b4f5-dadd8cde68fb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:39.982329 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 144/293] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:39 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:39.987555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa12047-161a-4786-9dfc-67a44b1e968e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:40.085515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:40.129321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa12047-161a-4786-9dfc-67a44b1e968e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:40.173448 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84c70c-2495-44e9-bf3b-3563e75a6df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:40.174140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84c70c-2495-44e9-bf3b-3563e75a6df5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:40.174477 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84c70c-2495-44e9-bf3b-3563e75a6df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:40.174760 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84c70c-2495-44e9-bf3b-3563e75a6df5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:40.175695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84c70c-2495-44e9-bf3b-3563e75a6df5 None admin] RBAC: Adding query filter params (role.id=bb946622ce1842cba751c5f862237f14, scope.project.id=2ef691ae767340c29a30ccdea323f352, user.id=02d77d5c69db494aac5ef45afaed7e79) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:40.176015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84c70c-2495-44e9-bf3b-3563e75a6df5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:40.177474 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84c70c-2495-44e9-bf3b-3563e75a6df5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:40.192602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 150/294] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:39 2022] GET /identity/v3/role_assignments?user.id=02d77d5c69db494aac5ef45afaed7e79&scope.project.id=2ef691ae767340c29a30ccdea323f352&role.id=bb946622ce1842cba751c5f862237f14 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:40.493084 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b4277-64fe-41b0-a22e-062371fa3925 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:40.493491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b4277-64fe-41b0-a22e-062371fa3925 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:40.493665 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b4277-64fe-41b0-a22e-062371fa3925 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:40.495367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 145/295] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:40.498349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54876e-8e72-4c91-b871-556544f92769 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:40.498649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54876e-8e72-4c91-b871-556544f92769 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:40.498935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54876e-8e72-4c91-b871-556544f92769 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:40.500446 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 151/296] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:40.501589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29421294-e01c-4cc5-9132-73d7fe670547 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:40.501893 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29421294-e01c-4cc5-9132-73d7fe670547 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:40.502181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29421294-e01c-4cc5-9132-73d7fe670547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:40.505919 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab0da9-4969-4657-ac47-d52cbc37e9ca None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:40.506575 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab0da9-4969-4657-ac47-d52cbc37e9ca None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:40.506858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab0da9-4969-4657-ac47-d52cbc37e9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:40.524757 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-29421294-e01c-4cc5-9132-73d7fe670547 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:40.526786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-29421294-e01c-4cc5-9132-73d7fe670547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:40.529531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7eab0da9-4969-4657-ac47-d52cbc37e9ca None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:40.531147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7eab0da9-4969-4657-ac47-d52cbc37e9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:40.603305 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 146/297] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:40.610844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 152/298] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:40.626894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29421294-e01c-4cc5-9132-73d7fe670547 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:40.636354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab0da9-4969-4657-ac47-d52cbc37e9ca None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:40.704613 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:40.727830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:40.734177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29421294-e01c-4cc5-9132-73d7fe670547 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:40.760010 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab0da9-4969-4657-ac47-d52cbc37e9ca None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:40.787123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb5fdb-87a4-447e-a4c8-98c349caa7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:40.787961 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb5fdb-87a4-447e-a4c8-98c349caa7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:40.788254 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb5fdb-87a4-447e-a4c8-98c349caa7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:40.788532 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb5fdb-87a4-447e-a4c8-98c349caa7d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:40.790987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb5fdb-87a4-447e-a4c8-98c349caa7d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:40.792824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb5fdb-87a4-447e-a4c8-98c349caa7d8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:40.795062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 147/299] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:11:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:40.801365 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb5fdb-87a4-447e-a4c8-98c349caa7d8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:40.828937 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9ffc6-ef1f-48e1-ba00-d5b4555b9012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:40.829769 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9ffc6-ef1f-48e1-ba00-d5b4555b9012 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:40.830100 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9ffc6-ef1f-48e1-ba00-d5b4555b9012 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:40.830428 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9ffc6-ef1f-48e1-ba00-d5b4555b9012 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:40.849178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9ffc6-ef1f-48e1-ba00-d5b4555b9012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:40.859375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-daa9ffc6-ef1f-48e1-ba00-d5b4555b9012 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:40.859375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:40.859375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:40.859375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:40.859375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:40.859375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:40.859375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:40.859375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:40.859375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:40.859375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:40.859375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:40.859375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:40.859375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:40.859375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:40.859375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:40.859375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:40.860315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:40.860315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:40.860315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:40.860315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:40.860315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:40.860315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:40.860315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:40.860315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:40.860315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:40.860315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:40.860315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:40.860315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:40.860315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:40.860315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:40.860315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:40.860315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:40.861111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:40.861111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:40.861111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:40.861111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:40.861111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:40.861111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:40.861111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:40.861111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:40.861111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:40.861111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:40.861111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:40.861111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:40.861111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 153/300] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:11:40.868192 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9ffc6-ef1f-48e1-ba00-d5b4555b9012 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:40.948447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb5fdb-87a4-447e-a4c8-98c349caa7d8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:40.987921 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c1d07-261c-4522-9957-f8cba606215c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:40.988277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9ffc6-ef1f-48e1-ba00-d5b4555b9012 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:40.989180 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c1d07-261c-4522-9957-f8cba606215c None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:40.989663 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c1d07-261c-4522-9957-f8cba606215c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:40.990134 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c1d07-261c-4522-9957-f8cba606215c None admin] PATH_INFO: `/v3/groups` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:40.991083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c1d07-261c-4522-9957-f8cba606215c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:40.992767 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c1d07-261c-4522-9957-f8cba606215c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:41.008450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:41.011125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 148/301] 10.222.0.33 () {60 vars in 1134 bytes} [Mon Jun 27 15:11:40 2022] POST /identity/v3/groups => generated 229 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:11:41.033794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922e811-2ace-4198-9711-afb56a5b9d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:41.035320 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e811-2ace-4198-9711-afb56a5b9d09 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:41.035852 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e811-2ace-4198-9711-afb56a5b9d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:41.036346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e811-2ace-4198-9711-afb56a5b9d09 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:41.037357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922e811-2ace-4198-9711-afb56a5b9d09 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:41.037898 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922e811-2ace-4198-9711-afb56a5b9d09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:41.039605 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922e811-2ace-4198-9711-afb56a5b9d09 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:41.050314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 154/302] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:41.056459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c1d07-261c-4522-9957-f8cba606215c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:41.087697 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:41.180293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c1d07-261c-4522-9957-f8cba606215c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:41.218552 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e1c6d-551f-4e5b-968c-e08c65995d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:41.219472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e1c6d-551f-4e5b-968c-e08c65995d91 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:41.219759 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e1c6d-551f-4e5b-968c-e08c65995d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:41.220041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e1c6d-551f-4e5b-968c-e08c65995d91 None admin] PATH_INFO: `/v3/users/4a7a86a284fb41538cb56734a1c69276` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:41.236082 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e1c6d-551f-4e5b-968c-e08c65995d91 None admin] RBAC: Authorizing `identity:get_user(user_id=4a7a86a284fb41538cb56734a1c69276)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:41.237729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e1c6d-551f-4e5b-968c-e08c65995d91 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:41.239480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 149/303] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:41 2022] GET /identity/v3/users/4a7a86a284fb41538cb56734a1c69276 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:41.245358 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922e811-2ace-4198-9711-afb56a5b9d09 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:41.352536 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922e811-2ace-4198-9711-afb56a5b9d09 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:41.386586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5765ee-8c38-475b-97c7-7a3a00d618c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:41.387257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5765ee-8c38-475b-97c7-7a3a00d618c7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:41.387551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5765ee-8c38-475b-97c7-7a3a00d618c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:41.387833 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5765ee-8c38-475b-97c7-7a3a00d618c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:41.388681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5765ee-8c38-475b-97c7-7a3a00d618c7 None admin] RBAC: Adding query filter params (role.id=084af5d7b08e4468a0c81c61f14c51eb, user.id=4a7a86a284fb41538cb56734a1c69276, scope.system=all) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:41.388999 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5765ee-8c38-475b-97c7-7a3a00d618c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:41.390479 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5765ee-8c38-475b-97c7-7a3a00d618c7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:41.396360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 155/304] 10.222.0.33 () {56 vars in 1308 bytes} [Mon Jun 27 15:11:41 2022] GET /identity/v3/role_assignments?user.id=4a7a86a284fb41538cb56734a1c69276&scope.system=all&role.id=084af5d7b08e4468a0c81c61f14c51eb => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:41.551607 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241a0b0-efa2-41c3-91cc-345e37c06569 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:41.551945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241a0b0-efa2-41c3-91cc-345e37c06569 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:41.552177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241a0b0-efa2-41c3-91cc-345e37c06569 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:41.553735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 150/305] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:41.559703 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13510fbe-86f6-4b76-9ec0-42ecb08e8971 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:41.559994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13510fbe-86f6-4b76-9ec0-42ecb08e8971 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:41.560270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13510fbe-86f6-4b76-9ec0-42ecb08e8971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:41.577782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-13510fbe-86f6-4b76-9ec0-42ecb08e8971 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:41.579032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-13510fbe-86f6-4b76-9ec0-42ecb08e8971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:41.621473 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:41.650602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 156/306] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:41.673214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241a0b0-efa2-41c3-91cc-345e37c06569 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:41.763045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:41.784778 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241a0b0-efa2-41c3-91cc-345e37c06569 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:41.821364 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0f435-5f62-4bce-a250-18d16833cf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:41.822193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0f435-5f62-4bce-a250-18d16833cf30 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:41.822680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0f435-5f62-4bce-a250-18d16833cf30 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:41.823234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0f435-5f62-4bce-a250-18d16833cf30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:41.838775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0f435-5f62-4bce-a250-18d16833cf30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:41.848675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-23e0f435-5f62-4bce-a250-18d16833cf30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:41.848675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:41.848675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:41.848675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:41.848675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:41.848675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:41.848675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:41.848675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:41.848675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:41.848675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:41.848675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:41.848675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:41.848675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:41.848675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:41.848675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:41.848675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:41.849638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:41.849638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:41.849638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:41.849638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:41.849638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:41.849638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:41.849638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:41.849638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:41.849638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:41.849638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:41.849638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:41.849638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:41.849638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:41.849638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:41.849638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:41.849638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:41.850461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:41.850461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:41.850461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:41.850461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:41.850461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:41.850461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:41.850461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:41.850461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:41.850461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:41.850461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:41.850461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:41.850461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:41.850461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 151/307] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:41.856266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13510fbe-86f6-4b76-9ec0-42ecb08e8971 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:41.978517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13510fbe-86f6-4b76-9ec0-42ecb08e8971 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:42.012987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e6c2c-2572-4943-a2bc-af92070d60cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:42.013666 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e6c2c-2572-4943-a2bc-af92070d60cb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:42.013947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e6c2c-2572-4943-a2bc-af92070d60cb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:42.014233 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e6c2c-2572-4943-a2bc-af92070d60cb None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:42.014995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e6c2c-2572-4943-a2bc-af92070d60cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:42.015298 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e6c2c-2572-4943-a2bc-af92070d60cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:42.016677 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e6c2c-2572-4943-a2bc-af92070d60cb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:42.029545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 157/308] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:42.035222 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0f435-5f62-4bce-a250-18d16833cf30 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:42.129067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9399e-01c0-48cc-8604-b8c8aa7968b1 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:42.129349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9399e-01c0-48cc-8604-b8c8aa7968b1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:42.129756 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9399e-01c0-48cc-8604-b8c8aa7968b1 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:42.131432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 158/309] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:11:42.138100 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49191cc7-9d85-41c6-ad07-176e9b7e5300 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:42.138531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49191cc7-9d85-41c6-ad07-176e9b7e5300 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:42.138897 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49191cc7-9d85-41c6-ad07-176e9b7e5300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:42.146873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0f435-5f62-4bce-a250-18d16833cf30 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:42.158252 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-49191cc7-9d85-41c6-ad07-176e9b7e5300 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:42.159670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-49191cc7-9d85-41c6-ad07-176e9b7e5300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:42.183319 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecf6bf-43d0-4571-ad0c-ba4434b4052b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:42.184504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecf6bf-43d0-4571-ad0c-ba4434b4052b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:42.184935 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecf6bf-43d0-4571-ad0c-ba4434b4052b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:42.185354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecf6bf-43d0-4571-ad0c-ba4434b4052b None admin] PATH_INFO: `/v3/users/3286db4f82214fbf94467bb57a0612a0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:42.186783 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecf6bf-43d0-4571-ad0c-ba4434b4052b None admin] RBAC: Authorizing `identity:get_user(user_id=3286db4f82214fbf94467bb57a0612a0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:42.188287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecf6bf-43d0-4571-ad0c-ba4434b4052b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:42.190200 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 152/310] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:42 2022] GET /identity/v3/users/3286db4f82214fbf94467bb57a0612a0 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:42.196886 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecf6bf-43d0-4571-ad0c-ba4434b4052b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:42.206783 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:42.209171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:42.252581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 159/311] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:42.283789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49191cc7-9d85-41c6-ad07-176e9b7e5300 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:42.319504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecf6bf-43d0-4571-ad0c-ba4434b4052b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:42.374477 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1724a7-7ff2-4eb2-98b0-e566db842b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:42.375839 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1724a7-7ff2-4eb2-98b0-e566db842b64 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:42.376321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1724a7-7ff2-4eb2-98b0-e566db842b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:42.376796 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1724a7-7ff2-4eb2-98b0-e566db842b64 None admin] PATH_INFO: `/v3/system/users/3286db4f82214fbf94467bb57a0612a0/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:42.379271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1724a7-7ff2-4eb2-98b0-e566db842b64 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3286db4f82214fbf94467bb57a0612a0, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:42.381643 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1724a7-7ff2-4eb2-98b0-e566db842b64 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:42.402244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 153/312] 10.222.0.33 () {58 vars in 1334 bytes} [Mon Jun 27 15:11:42 2022] PUT /identity/v3/system/users/3286db4f82214fbf94467bb57a0612a0/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:11:42.456823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49191cc7-9d85-41c6-ad07-176e9b7e5300 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:42.514172 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9031367-f6f9-4ec2-8a36-94cc0f18bac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:42.515389 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9031367-f6f9-4ec2-8a36-94cc0f18bac7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:42.515850 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9031367-f6f9-4ec2-8a36-94cc0f18bac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:42.516302 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9031367-f6f9-4ec2-8a36-94cc0f18bac7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:42.541645 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9031367-f6f9-4ec2-8a36-94cc0f18bac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:42.556198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c9031367-f6f9-4ec2-8a36-94cc0f18bac7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:42.556198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:42.556198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:42.556198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:42.556198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:42.556198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:42.556198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:42.556198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:42.556198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:42.556198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:42.556198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:42.556198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:42.556198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:42.556198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:42.556198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:42.556198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:42.558333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:42.558333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:42.558333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:42.558333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:42.558333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:42.558333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:42.558333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:42.558333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:42.558333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:42.558333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:42.558333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:42.558333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:42.558333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:42.558333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:42.558333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:42.558333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:42.559561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:42.559561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:42.559561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:42.559561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:42.559561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:42.559561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:42.559561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:42.559561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:42.559561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:42.559561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:42.559561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:42.559561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:42.559561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 160/313] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:11:42.566684 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1724a7-7ff2-4eb2-98b0-e566db842b64 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:42.649987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:42.685152 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1724a7-7ff2-4eb2-98b0-e566db842b64 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:42.720542 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d343a-a6b9-4d2f-99b2-390b456b7bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:42.721230 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d343a-a6b9-4d2f-99b2-390b456b7bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:42.721519 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d343a-a6b9-4d2f-99b2-390b456b7bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:42.721983 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d343a-a6b9-4d2f-99b2-390b456b7bf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:42.722780 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d343a-a6b9-4d2f-99b2-390b456b7bf1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:42.723092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d343a-a6b9-4d2f-99b2-390b456b7bf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:42.724495 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d343a-a6b9-4d2f-99b2-390b456b7bf1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:42.733398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 154/314] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:42.739695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9031367-f6f9-4ec2-8a36-94cc0f18bac7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:42.775947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:42.855163 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9031367-f6f9-4ec2-8a36-94cc0f18bac7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:42.891982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab3dfd-2095-4ec9-b4f0-f6cd22e78ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:42.892889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab3dfd-2095-4ec9-b4f0-f6cd22e78ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:42.893177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab3dfd-2095-4ec9-b4f0-f6cd22e78ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:42.893460 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab3dfd-2095-4ec9-b4f0-f6cd22e78ee6 None admin] PATH_INFO: `/v3/users/f9fd086837254437b545ee481e08c31b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:42.894860 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab3dfd-2095-4ec9-b4f0-f6cd22e78ee6 None admin] RBAC: Authorizing `identity:get_user(user_id=f9fd086837254437b545ee481e08c31b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:42.896327 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab3dfd-2095-4ec9-b4f0-f6cd22e78ee6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:42.898294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 161/315] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:42 2022] GET /identity/v3/users/f9fd086837254437b545ee481e08c31b => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:42.903817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d343a-a6b9-4d2f-99b2-390b456b7bf1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:43.016383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d343a-a6b9-4d2f-99b2-390b456b7bf1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:43.056968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17791b3f-9bbf-4514-b4d8-8fc2e5a86feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:43.057915 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17791b3f-9bbf-4514-b4d8-8fc2e5a86feb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:43.058207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17791b3f-9bbf-4514-b4d8-8fc2e5a86feb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:43.058516 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17791b3f-9bbf-4514-b4d8-8fc2e5a86feb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:43.061265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:43.130741 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17791b3f-9bbf-4514-b4d8-8fc2e5a86feb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:43.132234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17791b3f-9bbf-4514-b4d8-8fc2e5a86feb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:43.235069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 155/316] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:43.241294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab3dfd-2095-4ec9-b4f0-f6cd22e78ee6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:43.343977 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:43.359630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab3dfd-2095-4ec9-b4f0-f6cd22e78ee6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:43.395019 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e371d6e-61f5-4696-aa76-43c5a3485840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:43.395915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e371d6e-61f5-4696-aa76-43c5a3485840 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:43.396204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e371d6e-61f5-4696-aa76-43c5a3485840 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:43.396485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e371d6e-61f5-4696-aa76-43c5a3485840 None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:43.397685 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e371d6e-61f5-4696-aa76-43c5a3485840 None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:43.399196 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e371d6e-61f5-4696-aa76-43c5a3485840 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:43.401232 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 162/317] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:43 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:43.407213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17791b3f-9bbf-4514-b4d8-8fc2e5a86feb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:43.448598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:43.511596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17791b3f-9bbf-4514-b4d8-8fc2e5a86feb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:43.549009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788955b9-2b22-4bcf-9190-9b40970aed80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:43.549689 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788955b9-2b22-4bcf-9190-9b40970aed80 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:43.550020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788955b9-2b22-4bcf-9190-9b40970aed80 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:43.550329 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788955b9-2b22-4bcf-9190-9b40970aed80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:43.551188 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788955b9-2b22-4bcf-9190-9b40970aed80 None admin] RBAC: Adding query filter params (role.id=084af5d7b08e4468a0c81c61f14c51eb, scope.project.id=2ef691ae767340c29a30ccdea323f352, user.id=f9fd086837254437b545ee481e08c31b) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:43.551510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788955b9-2b22-4bcf-9190-9b40970aed80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:43.552991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788955b9-2b22-4bcf-9190-9b40970aed80 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:43.560291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 156/318] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:11:43 2022] GET /identity/v3/role_assignments?user.id=f9fd086837254437b545ee481e08c31b&scope.project.id=2ef691ae767340c29a30ccdea323f352&role.id=084af5d7b08e4468a0c81c61f14c51eb => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:43.680701 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5d487-c0ec-44ae-9707-d78e2353712e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:43.680892 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5d487-c0ec-44ae-9707-d78e2353712e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:43.681170 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5d487-c0ec-44ae-9707-d78e2353712e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:43.683525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 163/319] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:43.689882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beab961-a7b0-4cfd-b84a-ef2f9ece575e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:43.690512 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beab961-a7b0-4cfd-b84a-ef2f9ece575e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:43.690648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beab961-a7b0-4cfd-b84a-ef2f9ece575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:43.709869 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8beab961-a7b0-4cfd-b84a-ef2f9ece575e None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:43.711262 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8beab961-a7b0-4cfd-b84a-ef2f9ece575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:43.792557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 157/320] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:43.816317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5d487-c0ec-44ae-9707-d78e2353712e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:43.937954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5d487-c0ec-44ae-9707-d78e2353712e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:43.972798 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e8826-3949-454a-8a1a-1ef5f1a5812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:43.973617 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e8826-3949-454a-8a1a-1ef5f1a5812c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:43.973899 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e8826-3949-454a-8a1a-1ef5f1a5812c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:43.974172 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e8826-3949-454a-8a1a-1ef5f1a5812c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:43.975381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e8826-3949-454a-8a1a-1ef5f1a5812c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:43.976858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e8826-3949-454a-8a1a-1ef5f1a5812c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:43.978530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 164/321] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:11:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:43.984290 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beab961-a7b0-4cfd-b84a-ef2f9ece575e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:44.015152 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:44.049602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467000cf-75f1-4827-ba0d-d5f4a820d626 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:44.049976 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467000cf-75f1-4827-ba0d-d5f4a820d626 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:44.050210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467000cf-75f1-4827-ba0d-d5f4a820d626 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:44.051783 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 165/322] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:11:44.057488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e07fa1-1f06-4125-8dab-fd8faad783b8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:44.057854 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e07fa1-1f06-4125-8dab-fd8faad783b8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:44.058069 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e07fa1-1f06-4125-8dab-fd8faad783b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:44.075945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-84e07fa1-1f06-4125-8dab-fd8faad783b8 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:44.077148 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-84e07fa1-1f06-4125-8dab-fd8faad783b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:44.098631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beab961-a7b0-4cfd-b84a-ef2f9ece575e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:44.106557 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:44.148049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796518d-d68d-42cc-b839-c13abca9ddd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:44.148751 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796518d-d68d-42cc-b839-c13abca9ddd7 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:44.149045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796518d-d68d-42cc-b839-c13abca9ddd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:44.149329 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796518d-d68d-42cc-b839-c13abca9ddd7 None admin] PATH_INFO: `/v3/groups` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:44.150057 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796518d-d68d-42cc-b839-c13abca9ddd7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:44.151557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796518d-d68d-42cc-b839-c13abca9ddd7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:44.157409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 166/323] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:44.177148 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 158/324] 10.222.0.33 () {60 vars in 1134 bytes} [Mon Jun 27 15:11:43 2022] POST /identity/v3/groups => generated 226 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:11:44.181676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e07fa1-1f06-4125-8dab-fd8faad783b8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:44.321407 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e07fa1-1f06-4125-8dab-fd8faad783b8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:44.368755 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040affc-3ad9-46dc-b574-b7c7ce46a0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:44.369572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040affc-3ad9-46dc-b574-b7c7ce46a0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:44.369862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040affc-3ad9-46dc-b574-b7c7ce46a0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:44.370129 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040affc-3ad9-46dc-b574-b7c7ce46a0a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:44.380853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040affc-3ad9-46dc-b574-b7c7ce46a0a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:44.388609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c040affc-3ad9-46dc-b574-b7c7ce46a0a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:44.388609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:44.388609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:44.388609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:44.388609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:44.388609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:44.388609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:44.388609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:44.388609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:44.388609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:44.388609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:44.388609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:44.388609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:44.388609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:44.388609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:44.388609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:44.389499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:44.389499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:44.389499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:44.389499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:44.389499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:44.389499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:44.389499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:44.389499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:44.389499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:44.389499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:44.389499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:44.389499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:44.389499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:44.389499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:44.389499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:44.389499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:44.390551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:44.390551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:44.390551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:44.390551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:44.390551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:44.390551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:44.390551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:44.390551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:44.390551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:44.390551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:44.390551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:44.390551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:44.390551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 167/325] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:44.397613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796518d-d68d-42cc-b839-c13abca9ddd7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:44.502576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:44.516224 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796518d-d68d-42cc-b839-c13abca9ddd7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:44.559707 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f6919-87f4-4f14-8fc5-b6251bf14e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:44.561380 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f6919-87f4-4f14-8fc5-b6251bf14e1f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:44.563030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f6919-87f4-4f14-8fc5-b6251bf14e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:44.563030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f6919-87f4-4f14-8fc5-b6251bf14e1f None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:44.563030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f6919-87f4-4f14-8fc5-b6251bf14e1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:44.563283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f6919-87f4-4f14-8fc5-b6251bf14e1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:44.566569 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f6919-87f4-4f14-8fc5-b6251bf14e1f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:44.579196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 159/326] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:44.588453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040affc-3ad9-46dc-b574-b7c7ce46a0a2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:44.616968 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:44.647092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a9367-113c-44c4-9758-03d704c6f83f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:44.647736 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a9367-113c-44c4-9758-03d704c6f83f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:44.648178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a9367-113c-44c4-9758-03d704c6f83f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:44.649667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 160/327] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:11:44.657740 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba133002-0d69-403c-b4b9-b47043a70499 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:44.658409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba133002-0d69-403c-b4b9-b47043a70499 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:44.658762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba133002-0d69-403c-b4b9-b47043a70499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:44.682594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ba133002-0d69-403c-b4b9-b47043a70499 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:44.683806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ba133002-0d69-403c-b4b9-b47043a70499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:44.720138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040affc-3ad9-46dc-b574-b7c7ce46a0a2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:44.778816 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab781b7d-8e6e-4829-8fc6-98f3403b8703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:44.780062 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab781b7d-8e6e-4829-8fc6-98f3403b8703 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:44.783002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab781b7d-8e6e-4829-8fc6-98f3403b8703 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:44.783482 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab781b7d-8e6e-4829-8fc6-98f3403b8703 None admin] PATH_INFO: `/v3/users/4a7a86a284fb41538cb56734a1c69276` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:44.791166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab781b7d-8e6e-4829-8fc6-98f3403b8703 None admin] RBAC: Authorizing `identity:get_user(user_id=4a7a86a284fb41538cb56734a1c69276)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:44.792650 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab781b7d-8e6e-4829-8fc6-98f3403b8703 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:44.794311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 161/328] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:44.794730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 168/329] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:44 2022] GET /identity/v3/users/4a7a86a284fb41538cb56734a1c69276 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:44.800004 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab781b7d-8e6e-4829-8fc6-98f3403b8703 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:44.815083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba133002-0d69-403c-b4b9-b47043a70499 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:44.929195 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:44.938151 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:44.962766 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab781b7d-8e6e-4829-8fc6-98f3403b8703 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:44.963517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba133002-0d69-403c-b4b9-b47043a70499 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:45.026971 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2d1ca-7556-448a-a173-85ec1f035649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:45.027814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2d1ca-7556-448a-a173-85ec1f035649 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:45.028466 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2d1ca-7556-448a-a173-85ec1f035649 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:45.028466 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2d1ca-7556-448a-a173-85ec1f035649 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:45.029495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f664209-05d8-4eab-89d0-33ecbb788606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:45.030506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f664209-05d8-4eab-89d0-33ecbb788606 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:45.030805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f664209-05d8-4eab-89d0-33ecbb788606 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:45.031068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f664209-05d8-4eab-89d0-33ecbb788606 None admin] PATH_INFO: `/v3/system/users/4a7a86a284fb41538cb56734a1c69276/roles/084af5d7b08e4468a0c81c61f14c51eb` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:45.032730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f664209-05d8-4eab-89d0-33ecbb788606 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4a7a86a284fb41538cb56734a1c69276, role_id=084af5d7b08e4468a0c81c61f14c51eb)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:45.034341 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f664209-05d8-4eab-89d0-33ecbb788606 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:45.045283 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 169/330] 10.222.0.33 () {58 vars in 1334 bytes} [Mon Jun 27 15:11:44 2022] PUT /identity/v3/system/users/4a7a86a284fb41538cb56734a1c69276/roles/084af5d7b08e4468a0c81c61f14c51eb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:11:45.052013 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2d1ca-7556-448a-a173-85ec1f035649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:45.060989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-93d2d1ca-7556-448a-a173-85ec1f035649 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:45.060989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:45.060989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:45.060989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:45.060989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:45.060989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:45.060989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:45.060989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:45.060989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:45.060989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:45.060989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:45.060989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:45.060989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:45.060989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:45.060989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:45.060989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:45.062164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:45.062164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:45.062164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:45.062164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:45.062164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:45.062164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:45.062164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:45.062164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:45.062164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:45.062164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:45.062164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:45.062164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:45.062164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:45.062164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:45.062164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:45.062164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:45.063252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:45.063252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:45.063252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:45.063252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:45.063252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:45.063252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:45.063252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:45.063252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:45.063252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:45.063252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:45.063252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:45.063252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:45.065926 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 162/331] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:11:45.071646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f664209-05d8-4eab-89d0-33ecbb788606 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:45.210874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f664209-05d8-4eab-89d0-33ecbb788606 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:45.259732 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2097a3-c705-49b0-b604-19e00fcf8450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:45.260439 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2097a3-c705-49b0-b604-19e00fcf8450 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:45.260725 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2097a3-c705-49b0-b604-19e00fcf8450 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:45.261008 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2097a3-c705-49b0-b604-19e00fcf8450 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:45.261782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2097a3-c705-49b0-b604-19e00fcf8450 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:45.262098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2097a3-c705-49b0-b604-19e00fcf8450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:45.263662 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2097a3-c705-49b0-b604-19e00fcf8450 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:45.275777 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 170/332] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:45.281503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2d1ca-7556-448a-a173-85ec1f035649 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:45.436013 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2d1ca-7556-448a-a173-85ec1f035649 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:45.481481 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06011a10-e3c6-408d-b9fd-f73ceb0e676d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:45.482779 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06011a10-e3c6-408d-b9fd-f73ceb0e676d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:45.483247 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06011a10-e3c6-408d-b9fd-f73ceb0e676d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:45.483747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06011a10-e3c6-408d-b9fd-f73ceb0e676d None admin] PATH_INFO: `/v3/users/3286db4f82214fbf94467bb57a0612a0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:45.485264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06011a10-e3c6-408d-b9fd-f73ceb0e676d None admin] RBAC: Authorizing `identity:get_user(user_id=3286db4f82214fbf94467bb57a0612a0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:45.487055 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06011a10-e3c6-408d-b9fd-f73ceb0e676d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:45.489310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 163/333] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:45 2022] GET /identity/v3/users/3286db4f82214fbf94467bb57a0612a0 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:45.495370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2097a3-c705-49b0-b604-19e00fcf8450 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:45.513882 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:45.629603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2097a3-c705-49b0-b604-19e00fcf8450 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:45.681738 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c8457-2e3c-402f-9670-aa1cd05d1af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:45.683110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c8457-2e3c-402f-9670-aa1cd05d1af5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:45.683573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c8457-2e3c-402f-9670-aa1cd05d1af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:45.684024 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c8457-2e3c-402f-9670-aa1cd05d1af5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:45.685149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c8457-2e3c-402f-9670-aa1cd05d1af5 None admin] RBAC: Adding query filter params (role.id=bb946622ce1842cba751c5f862237f14, user.id=3286db4f82214fbf94467bb57a0612a0, scope.system=all) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:45.685642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c8457-2e3c-402f-9670-aa1cd05d1af5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:45.687318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c8457-2e3c-402f-9670-aa1cd05d1af5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:45.705220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 171/334] 10.222.0.33 () {56 vars in 1308 bytes} [Mon Jun 27 15:11:45 2022] GET /identity/v3/role_assignments?user.id=3286db4f82214fbf94467bb57a0612a0&scope.system=all&role.id=bb946622ce1842cba751c5f862237f14 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:46.626573 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa059857-75e5-43a7-9352-680c89a0a546 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:46.627082 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa059857-75e5-43a7-9352-680c89a0a546 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:46.627157 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa059857-75e5-43a7-9352-680c89a0a546 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:46.628889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 164/335] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:46.634603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42597297-2637-48fb-9963-b040654b8ff5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:46.635052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42597297-2637-48fb-9963-b040654b8ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:46.635150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42597297-2637-48fb-9963-b040654b8ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:46.652740 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-42597297-2637-48fb-9963-b040654b8ff5 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:46.653951 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-42597297-2637-48fb-9963-b040654b8ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:46.753710 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 172/336] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:46.797636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa059857-75e5-43a7-9352-680c89a0a546 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:46.812595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:46.945164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa059857-75e5-43a7-9352-680c89a0a546 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:46.999859 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fb05b-bf89-4b6c-8e2f-2bef5726dcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:47.001049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fb05b-bf89-4b6c-8e2f-2bef5726dcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:47.001552 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fb05b-bf89-4b6c-8e2f-2bef5726dcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:47.002047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fb05b-bf89-4b6c-8e2f-2bef5726dcf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:47.023638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fb05b-bf89-4b6c-8e2f-2bef5726dcf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:47.032035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b50fb05b-bf89-4b6c-8e2f-2bef5726dcf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:47.032035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:47.032035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:47.032035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:47.032035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:47.032035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:47.032035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:47.032035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:47.032035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:47.032035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:47.032035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:47.032035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:47.032035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:47.032035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:47.032035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:47.032035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:47.033011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:47.033011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:47.033011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:47.033011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:47.033011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:47.033011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:47.033011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:47.033011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:47.033011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:47.033011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:47.033011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:47.033011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:47.033011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:47.033011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:47.033011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:47.033011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:47.033814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:47.033814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:47.033814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:47.033814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:47.033814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:47.033814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:47.033814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:47.033814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:47.033814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:47.033814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:47.033814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:47.033814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:47.041661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 165/337] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:47.047523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42597297-2637-48fb-9963-b040654b8ff5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:47.050025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:47.187940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42597297-2637-48fb-9963-b040654b8ff5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:47.225842 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5052be-95b3-4bc3-902b-a793c7a1ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:47.226490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5052be-95b3-4bc3-902b-a793c7a1ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:47.226777 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5052be-95b3-4bc3-902b-a793c7a1ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:47.227142 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5052be-95b3-4bc3-902b-a793c7a1ffe5 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:47.227907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5052be-95b3-4bc3-902b-a793c7a1ffe5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:47.228217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5052be-95b3-4bc3-902b-a793c7a1ffe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:47.229609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5052be-95b3-4bc3-902b-a793c7a1ffe5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:47.240899 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 173/338] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:47.247058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fb05b-bf89-4b6c-8e2f-2bef5726dcf6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:47.344646 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:47.381444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fb05b-bf89-4b6c-8e2f-2bef5726dcf6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:47.417443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dcd53-99e3-4ae9-995b-4f9d6341b253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:47.418558 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dcd53-99e3-4ae9-995b-4f9d6341b253 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:47.419046 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dcd53-99e3-4ae9-995b-4f9d6341b253 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:47.419519 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dcd53-99e3-4ae9-995b-4f9d6341b253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:47.507503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dcd53-99e3-4ae9-995b-4f9d6341b253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:47.509327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dcd53-99e3-4ae9-995b-4f9d6341b253 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:47.587492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:47.629182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 166/339] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:47.634813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5052be-95b3-4bc3-902b-a793c7a1ffe5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:47.735963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:47.781382 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5052be-95b3-4bc3-902b-a793c7a1ffe5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:47.830189 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9321b4-3d7b-4067-a216-5fd722914ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:47.831700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9321b4-3d7b-4067-a216-5fd722914ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:47.832206 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9321b4-3d7b-4067-a216-5fd722914ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:47.832680 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9321b4-3d7b-4067-a216-5fd722914ec4 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:47.839065 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9321b4-3d7b-4067-a216-5fd722914ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:47.840823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9321b4-3d7b-4067-a216-5fd722914ec4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:47.843234 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 174/340] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:47 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:47.848828 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dcd53-99e3-4ae9-995b-4f9d6341b253 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:47.981747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dcd53-99e3-4ae9-995b-4f9d6341b253 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:48.023601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c85f1b-12b6-48be-bab2-6ec3db723d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:48.024482 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85f1b-12b6-48be-bab2-6ec3db723d37 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:48.024768 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85f1b-12b6-48be-bab2-6ec3db723d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:48.025044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85f1b-12b6-48be-bab2-6ec3db723d37 None admin] PATH_INFO: `/v3/groups/69a5e68c68c0446bb577c4aff6555ce7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:48.032088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c85f1b-12b6-48be-bab2-6ec3db723d37 None admin] RBAC: Authorizing `identity:get_group(group_id=69a5e68c68c0446bb577c4aff6555ce7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:48.033500 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c85f1b-12b6-48be-bab2-6ec3db723d37 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:48.035680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 167/341] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 27 15:11:47 2022] GET /identity/v3/groups/69a5e68c68c0446bb577c4aff6555ce7 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:48.041202 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9321b4-3d7b-4067-a216-5fd722914ec4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:48.188897 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9321b4-3d7b-4067-a216-5fd722914ec4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:48.189944 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c989224-1984-4064-8b5d-8e9853729043 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:48.190315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c989224-1984-4064-8b5d-8e9853729043 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:48.190601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c989224-1984-4064-8b5d-8e9853729043 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:48.192303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 168/342] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:48.198487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4a156-4619-426c-8cff-3dc35f33ba57 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:48.198779 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4a156-4619-426c-8cff-3dc35f33ba57 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:48.199063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4a156-4619-426c-8cff-3dc35f33ba57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:48.221549 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cae4a156-4619-426c-8cff-3dc35f33ba57 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:48.222919 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cae4a156-4619-426c-8cff-3dc35f33ba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:48.235581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:48.244892 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafef23-2aa8-4e16-803f-aa355c5b00fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:48.245932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafef23-2aa8-4e16-803f-aa355c5b00fe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:48.246103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafef23-2aa8-4e16-803f-aa355c5b00fe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:48.246499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafef23-2aa8-4e16-803f-aa355c5b00fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:48.247428 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafef23-2aa8-4e16-803f-aa355c5b00fe None admin] RBAC: Adding query filter params (group.id=69a5e68c68c0446bb577c4aff6555ce7, role.id=bb946622ce1842cba751c5f862237f14, scope.project.id=0b20137a36384531941036a989526bd2) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:48.247883 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafef23-2aa8-4e16-803f-aa355c5b00fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:48.249340 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafef23-2aa8-4e16-803f-aa355c5b00fe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:48.260603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:48.261240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 175/343] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 27 15:11:48 2022] GET /identity/v3/role_assignments?group.id=69a5e68c68c0446bb577c4aff6555ce7&scope.project.id=0b20137a36384531941036a989526bd2&role.id=bb946622ce1842cba751c5f862237f14 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:48.292793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4546ede-1fe8-4355-97c6-18e85138c1a1 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:48.292976 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4546ede-1fe8-4355-97c6-18e85138c1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:48.293266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4546ede-1fe8-4355-97c6-18e85138c1a1 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:48.296484 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 176/344] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:48.301480 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442361e7-ffdb-4597-ae6c-d1a267618afd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:48.301686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442361e7-ffdb-4597-ae6c-d1a267618afd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:48.301898 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442361e7-ffdb-4597-ae6c-d1a267618afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:48.317320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 169/345] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 27 15:11:48.323660 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-442361e7-ffdb-4597-ae6c-d1a267618afd None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:48.324921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-442361e7-ffdb-4597-ae6c-d1a267618afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:48.331843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ec40a-025e-45c5-948f-4b3529fb4740 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:48.332180 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ec40a-025e-45c5-948f-4b3529fb4740 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:48.332400 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ec40a-025e-45c5-948f-4b3529fb4740 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:48.334052 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 170/346] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:11:48.340735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71993956-30fa-45c4-a7d3-9d0215c0569a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:48.341028 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71993956-30fa-45c4-a7d3-9d0215c0569a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:48.341338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71993956-30fa-45c4-a7d3-9d0215c0569a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:48.364635 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-71993956-30fa-45c4-a7d3-9d0215c0569a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:48.365912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-71993956-30fa-45c4-a7d3-9d0215c0569a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:48.463354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 177/347] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:48.464256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442361e7-ffdb-4597-ae6c-d1a267618afd None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:48.516394 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 171/348] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:48.518092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71993956-30fa-45c4-a7d3-9d0215c0569a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:48.613859 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442361e7-ffdb-4597-ae6c-d1a267618afd None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:48.643058 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:48.651364 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:48.654618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a945c-23c3-4c95-a45b-0b3dbc2f40e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:48.656551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a945c-23c3-4c95-a45b-0b3dbc2f40e0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:48.656813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a945c-23c3-4c95-a45b-0b3dbc2f40e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:48.657091 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a945c-23c3-4c95-a45b-0b3dbc2f40e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:48.663266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71993956-30fa-45c4-a7d3-9d0215c0569a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:48.668832 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a945c-23c3-4c95-a45b-0b3dbc2f40e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:48.677250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f91a945c-23c3-4c95-a45b-0b3dbc2f40e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:48.677250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:48.677250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:48.677250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:48.677250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:48.677250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:48.677250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:48.677250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:48.677250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:48.677250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:48.677250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:48.677250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:48.677250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:48.677250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:48.677250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:48.677250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:48.678213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:48.678213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:48.678213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:48.678213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:48.678213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:48.678213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:48.678213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:48.678213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:48.678213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:48.678213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:48.678213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:48.678213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:48.678213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:48.678213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:48.678213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:48.678213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:48.679074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:48.679074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:48.679074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:48.679074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:48.679074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:48.679074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:48.679074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:48.679074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:48.679074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:48.679074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:48.679074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:48.679074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:48.679074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 178/349] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:11:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:48.679759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a945c-23c3-4c95-a45b-0b3dbc2f40e0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:48.704010 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe49eae-b765-48ba-be6f-5d45cbf55d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:48.705232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe49eae-b765-48ba-be6f-5d45cbf55d12 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:48.706050 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe49eae-b765-48ba-be6f-5d45cbf55d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:48.706590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe49eae-b765-48ba-be6f-5d45cbf55d12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:48.718486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe49eae-b765-48ba-be6f-5d45cbf55d12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:48.729528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-9fe49eae-b765-48ba-be6f-5d45cbf55d12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:48.729528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:48.729528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:48.729528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:48.729528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:48.729528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:48.729528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:48.729528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:48.729528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:48.729528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:48.729528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:48.729528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:48.729528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:48.729528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:48.729528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:48.729528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:48.730524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:48.730524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:48.730524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:48.730524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:48.730524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:48.730524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:48.730524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:48.730524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:48.730524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:48.730524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:48.730524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:48.730524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:48.730524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:48.730524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:48.730524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:48.730524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:48.731332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:48.731332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:48.731332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:48.731332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:48.731332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:48.731332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:48.731332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:48.731332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:48.731332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:48.731332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:48.731332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:48.731332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:48.734288 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 172/350] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:48.735392 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe49eae-b765-48ba-be6f-5d45cbf55d12 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:48.798818 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a945c-23c3-4c95-a45b-0b3dbc2f40e0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:48.839745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a5a22-fd9e-4ad8-8fa6-f348d613f83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:48.840599 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a5a22-fd9e-4ad8-8fa6-f348d613f83b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:48.841085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a5a22-fd9e-4ad8-8fa6-f348d613f83b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:48.841199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a5a22-fd9e-4ad8-8fa6-f348d613f83b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:48.851605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe49eae-b765-48ba-be6f-5d45cbf55d12 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:48.855694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a5a22-fd9e-4ad8-8fa6-f348d613f83b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:48.863730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-fd4a5a22-fd9e-4ad8-8fa6-f348d613f83b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:48.863730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:48.863730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:48.863730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:48.863730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:48.863730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:48.863730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:48.863730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:48.863730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:48.863730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:48.863730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:48.863730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:48.863730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:48.863730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:48.863730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:48.863730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:48.864720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:48.864720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:48.864720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:48.864720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:48.864720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:48.864720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:48.864720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:48.864720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:48.864720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:48.864720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:48.864720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:48.864720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:48.864720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:48.864720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:48.864720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:48.864720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:48.865565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:48.865565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:48.865565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:48.865565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:48.865565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:48.865565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:48.865565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:48.865565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:48.865565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:48.865565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:48.865565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 15:11:48.865565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:48.869896 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 179/351] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:48.871450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520b1bb-88a3-46f3-a866-381f7953481c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:48.871746 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520b1bb-88a3-46f3-a866-381f7953481c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:48.872091 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520b1bb-88a3-46f3-a866-381f7953481c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:48.878002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 180/352] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:48.879143 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520b1bb-88a3-46f3-a866-381f7953481c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:48.900417 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a814ac-39dd-4e8a-ab80-afffc30514e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:48.901487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a814ac-39dd-4e8a-ab80-afffc30514e2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:48.902075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a814ac-39dd-4e8a-ab80-afffc30514e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:48.902628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a814ac-39dd-4e8a-ab80-afffc30514e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:48.903636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a814ac-39dd-4e8a-ab80-afffc30514e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:48.904125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a814ac-39dd-4e8a-ab80-afffc30514e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:48.905719 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a814ac-39dd-4e8a-ab80-afffc30514e2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:48.917065 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 173/353] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:11:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:48.918265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a814ac-39dd-4e8a-ab80-afffc30514e2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:48.935781 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:48.945239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:49.011067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520b1bb-88a3-46f3-a866-381f7953481c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:49.059945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152f346-3e72-4813-8f6b-d40fb848fc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:49.060787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152f346-3e72-4813-8f6b-d40fb848fc01 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:49.061149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152f346-3e72-4813-8f6b-d40fb848fc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:49.061903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152f346-3e72-4813-8f6b-d40fb848fc01 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:49.064241 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152f346-3e72-4813-8f6b-d40fb848fc01 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:49.064565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152f346-3e72-4813-8f6b-d40fb848fc01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:49.065695 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a814ac-39dd-4e8a-ab80-afffc30514e2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:49.066090 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152f346-3e72-4813-8f6b-d40fb848fc01 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:49.078753 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 181/354] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:49.084566 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de8320-9341-48d8-9439-0102d0e93dea None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:49.084868 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de8320-9341-48d8-9439-0102d0e93dea None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:49.085514 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de8320-9341-48d8-9439-0102d0e93dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:49.111921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-23de8320-9341-48d8-9439-0102d0e93dea None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:49.116850 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-23de8320-9341-48d8-9439-0102d0e93dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:49.121189 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c8209-7c61-4f93-867b-1afb95716e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:49.124494 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c8209-7c61-4f93-867b-1afb95716e7c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:49.124781 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c8209-7c61-4f93-867b-1afb95716e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:49.125062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c8209-7c61-4f93-867b-1afb95716e7c None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:49.125837 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c8209-7c61-4f93-867b-1afb95716e7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:49.126148 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c8209-7c61-4f93-867b-1afb95716e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:49.128663 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c8209-7c61-4f93-867b-1afb95716e7c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:49.140519 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 174/355] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:49.141452 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c8209-7c61-4f93-867b-1afb95716e7c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:49.216813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 182/356] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:49.216813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de8320-9341-48d8-9439-0102d0e93dea None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:49.238807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:49.284808 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c8209-7c61-4f93-867b-1afb95716e7c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:49.288456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:49.331055 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291badbc-5a80-48cc-987e-db2646ebc8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:49.332120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291badbc-5a80-48cc-987e-db2646ebc8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:49.332604 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291badbc-5a80-48cc-987e-db2646ebc8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:49.333592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291badbc-5a80-48cc-987e-db2646ebc8a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:49.364242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de8320-9341-48d8-9439-0102d0e93dea None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:49.415434 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f293ed6-5e71-4aa5-993b-44d1925c7e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:49.415636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f293ed6-5e71-4aa5-993b-44d1925c7e15 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:49.415853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f293ed6-5e71-4aa5-993b-44d1925c7e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:49.416019 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f293ed6-5e71-4aa5-993b-44d1925c7e15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:49.441906 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291badbc-5a80-48cc-987e-db2646ebc8a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:49.443633 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291badbc-5a80-48cc-987e-db2646ebc8a8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:49.493202 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f293ed6-5e71-4aa5-993b-44d1925c7e15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:49.495110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f293ed6-5e71-4aa5-993b-44d1925c7e15 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:49.536153 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:49.554140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:49.570564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 175/357] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:49.574330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291badbc-5a80-48cc-987e-db2646ebc8a8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:49.640697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 183/358] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:49.641655 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f293ed6-5e71-4aa5-993b-44d1925c7e15 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:49.723609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291badbc-5a80-48cc-987e-db2646ebc8a8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:49.772766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff5355-8df4-4665-b337-c797a6452096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:49.774006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff5355-8df4-4665-b337-c797a6452096 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:49.774512 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff5355-8df4-4665-b337-c797a6452096 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:49.774984 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff5355-8df4-4665-b337-c797a6452096 None admin] PATH_INFO: `/v3/users/4a7a86a284fb41538cb56734a1c69276` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:49.776487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff5355-8df4-4665-b337-c797a6452096 None admin] RBAC: Authorizing `identity:get_user(user_id=4a7a86a284fb41538cb56734a1c69276)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:49.778309 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff5355-8df4-4665-b337-c797a6452096 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:49.781025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 176/359] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:11:49 2022] GET /identity/v3/users/4a7a86a284fb41538cb56734a1c69276 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:49.783226 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a315063-e63b-45c1-9354-73703d88b829 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:49.783610 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a315063-e63b-45c1-9354-73703d88b829 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:49.784369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a315063-e63b-45c1-9354-73703d88b829 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:49.787493 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 177/360] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:49.788257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a315063-e63b-45c1-9354-73703d88b829 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:49.795067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f293ed6-5e71-4aa5-993b-44d1925c7e15 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:49.844724 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796f4c1-acc0-4909-9809-21fc56d09c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:49.846078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796f4c1-acc0-4909-9809-21fc56d09c31 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:49.846806 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796f4c1-acc0-4909-9809-21fc56d09c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:49.847298 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796f4c1-acc0-4909-9809-21fc56d09c31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:49.856820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:49.861325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:49.868693 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796f4c1-acc0-4909-9809-21fc56d09c31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:49.879182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5796f4c1-acc0-4909-9809-21fc56d09c31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:49.879182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:49.879182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:49.879182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:49.879182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:49.879182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:49.879182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:49.879182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:49.879182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:49.879182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:49.879182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:49.879182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:49.879182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:49.879182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:49.879182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:49.879182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:49.880160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:49.880160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:49.880160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:49.880160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:49.880160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:49.880160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:49.880160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:49.880160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:49.880160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:49.880160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:49.880160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:49.880160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:49.880160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:49.880160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:49.880160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:49.880160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:49.880962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:49.880962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:49.880962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:49.880962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:49.880962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:49.880962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:49.880962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:49.880962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:49.880962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:49.880962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:49.880962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:49.880962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:49.883639 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 184/361] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:11:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:49.884771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796f4c1-acc0-4909-9809-21fc56d09c31 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:49.939542 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a315063-e63b-45c1-9354-73703d88b829 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:49.990826 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42713c-614e-4034-bc4a-499aec7f1b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:49.991904 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42713c-614e-4034-bc4a-499aec7f1b79 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:49.993068 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42713c-614e-4034-bc4a-499aec7f1b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:49.993356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42713c-614e-4034-bc4a-499aec7f1b79 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:49.995348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42713c-614e-4034-bc4a-499aec7f1b79 None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:49.996276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42713c-614e-4034-bc4a-499aec7f1b79 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:49.998863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 178/362] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:49 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:50.003454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42713c-614e-4034-bc4a-499aec7f1b79 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:50.034385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796f4c1-acc0-4909-9809-21fc56d09c31 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:50.072931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285097a9-3a46-4928-b694-a262ea83fadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:50.073835 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285097a9-3a46-4928-b694-a262ea83fadb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:50.074128 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285097a9-3a46-4928-b694-a262ea83fadb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:50.074437 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285097a9-3a46-4928-b694-a262ea83fadb None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:50.075685 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285097a9-3a46-4928-b694-a262ea83fadb None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:50.077177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285097a9-3a46-4928-b694-a262ea83fadb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:50.079140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 185/363] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:49 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:50.080399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3f8cc-1fa9-4e3c-a368-4ebabc874e96 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:50.080736 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3f8cc-1fa9-4e3c-a368-4ebabc874e96 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:50.081023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3f8cc-1fa9-4e3c-a368-4ebabc874e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:50.107710 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8af3f8cc-1fa9-4e3c-a368-4ebabc874e96 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:50.109643 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8af3f8cc-1fa9-4e3c-a368-4ebabc874e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:50.168825 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42713c-614e-4034-bc4a-499aec7f1b79 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:50.187425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:50.201086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:50.210012 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 186/364] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:50.211277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3f8cc-1fa9-4e3c-a368-4ebabc874e96 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:50.220475 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166cbb5-7ff7-4f74-9b47-d8c9f534a360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:50.221399 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166cbb5-7ff7-4f74-9b47-d8c9f534a360 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:50.222339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166cbb5-7ff7-4f74-9b47-d8c9f534a360 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:50.222852 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166cbb5-7ff7-4f74-9b47-d8c9f534a360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:50.223752 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166cbb5-7ff7-4f74-9b47-d8c9f534a360 None admin] RBAC: Adding query filter params (role.id=084af5d7b08e4468a0c81c61f14c51eb, user.id=4a7a86a284fb41538cb56734a1c69276, scope.system=all) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:50.224084 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166cbb5-7ff7-4f74-9b47-d8c9f534a360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:50.227678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166cbb5-7ff7-4f74-9b47-d8c9f534a360 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:50.245519 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 179/365] 10.222.0.33 () {56 vars in 1308 bytes} [Mon Jun 27 15:11:49 2022] GET /identity/v3/role_assignments?user.id=4a7a86a284fb41538cb56734a1c69276&scope.system=all&role.id=084af5d7b08e4468a0c81c61f14c51eb => generated 510 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:50.247637 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166cbb5-7ff7-4f74-9b47-d8c9f534a360 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:50.371860 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3f8cc-1fa9-4e3c-a368-4ebabc874e96 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:50.417409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166cbb5-7ff7-4f74-9b47-d8c9f534a360 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:50.418095 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cd605-d24f-4c07-9938-97b65161f2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:50.418853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cd605-d24f-4c07-9938-97b65161f2fe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:50.419140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cd605-d24f-4c07-9938-97b65161f2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:50.419421 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cd605-d24f-4c07-9938-97b65161f2fe None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:50.420213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cd605-d24f-4c07-9938-97b65161f2fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:50.420521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cd605-d24f-4c07-9938-97b65161f2fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:50.421956 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cd605-d24f-4c07-9938-97b65161f2fe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:50.439768 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 187/366] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:11:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:50.439768 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cd605-d24f-4c07-9938-97b65161f2fe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:50.475387 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193525f0-a9b3-4283-8393-6e0f87559536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:50.477415 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193525f0-a9b3-4283-8393-6e0f87559536 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:50.478046 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193525f0-a9b3-4283-8393-6e0f87559536 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:50.478682 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193525f0-a9b3-4283-8393-6e0f87559536 None admin] PATH_INFO: `/v3/groups/69a5e68c68c0446bb577c4aff6555ce7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:50.480602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193525f0-a9b3-4283-8393-6e0f87559536 None admin] RBAC: Authorizing `identity:get_group(group_id=69a5e68c68c0446bb577c4aff6555ce7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:50.483027 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193525f0-a9b3-4283-8393-6e0f87559536 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:50.485796 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 180/367] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 27 15:11:50 2022] GET /identity/v3/groups/69a5e68c68c0446bb577c4aff6555ce7 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:50.487448 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193525f0-a9b3-4283-8393-6e0f87559536 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:50.517217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:50.551481 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:50.580960 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cd605-d24f-4c07-9938-97b65161f2fe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:50.620628 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c0253-3688-4ad4-8fe2-95781bb8e8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:50.621921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c0253-3688-4ad4-8fe2-95781bb8e8fb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:50.622407 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c0253-3688-4ad4-8fe2-95781bb8e8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:50.622690 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c0253-3688-4ad4-8fe2-95781bb8e8fb None admin] PATH_INFO: `/v3/groups/69a5e68c68c0446bb577c4aff6555ce7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:50.623948 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c0253-3688-4ad4-8fe2-95781bb8e8fb None admin] RBAC: Authorizing `identity:get_group(group_id=69a5e68c68c0446bb577c4aff6555ce7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:50.625420 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c0253-3688-4ad4-8fe2-95781bb8e8fb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:50.627716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 188/368] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 27 15:11:50 2022] GET /identity/v3/groups/69a5e68c68c0446bb577c4aff6555ce7 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:50.628088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c0253-3688-4ad4-8fe2-95781bb8e8fb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:50.642063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193525f0-a9b3-4283-8393-6e0f87559536 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:50.695670 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c50ef0-834c-47b2-9525-addc2bd1d30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:50.696486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c50ef0-834c-47b2-9525-addc2bd1d30d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:50.696771 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c50ef0-834c-47b2-9525-addc2bd1d30d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:50.697048 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c50ef0-834c-47b2-9525-addc2bd1d30d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:50.710528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c50ef0-834c-47b2-9525-addc2bd1d30d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:50.718285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f5c50ef0-834c-47b2-9525-addc2bd1d30d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:50.718285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:50.718285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:50.718285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:50.718285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:50.718285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:50.718285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:50.718285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:50.718285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:50.718285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:50.718285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:50.718285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:50.718285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:50.718285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:50.718285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:50.718285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:50.719194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:50.719194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:50.719194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:50.719194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:50.719194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:50.719194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:50.719194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:50.719194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:50.719194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:50.719194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:50.719194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:50.719194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:50.719194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:50.719194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:50.719194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:50.719194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:50.720004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:50.720004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:50.720004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:50.720004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:50.720004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:50.720004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:50.720004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:50.720004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:50.720004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:50.720004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:50.720004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:50.720004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:50.720004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 181/369] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:11:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:50.720661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c50ef0-834c-47b2-9525-addc2bd1d30d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:50.753683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c0253-3688-4ad4-8fe2-95781bb8e8fb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:50.781618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:50.791863 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3ce49-47ba-43f4-8eae-3d1e934ab254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:50.792800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3ce49-47ba-43f4-8eae-3d1e934ab254 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:50.793247 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3ce49-47ba-43f4-8eae-3d1e934ab254 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:50.793670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3ce49-47ba-43f4-8eae-3d1e934ab254 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:50.848535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:50.853501 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c50ef0-834c-47b2-9525-addc2bd1d30d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:50.880837 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3ce49-47ba-43f4-8eae-3d1e934ab254 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:50.882486 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3ce49-47ba-43f4-8eae-3d1e934ab254 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:50.898991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab5fec-f939-43f1-b2d9-c444bc2cf0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:50.900037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab5fec-f939-43f1-b2d9-c444bc2cf0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:50.900569 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab5fec-f939-43f1-b2d9-c444bc2cf0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:50.900908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab5fec-f939-43f1-b2d9-c444bc2cf0f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:50.901705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab5fec-f939-43f1-b2d9-c444bc2cf0f0 None admin] RBAC: Adding query filter params (group.id=69a5e68c68c0446bb577c4aff6555ce7, role.id=0763e374972f4ce29ab449e27fd89355, scope.project.id=0b20137a36384531941036a989526bd2) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:50.902018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab5fec-f939-43f1-b2d9-c444bc2cf0f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:50.903518 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab5fec-f939-43f1-b2d9-c444bc2cf0f0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:50.910660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 182/370] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 27 15:11:50 2022] GET /identity/v3/role_assignments?group.id=69a5e68c68c0446bb577c4aff6555ce7&scope.project.id=0b20137a36384531941036a989526bd2&role.id=0763e374972f4ce29ab449e27fd89355 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:50.911532 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab5fec-f939-43f1-b2d9-c444bc2cf0f0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:51.018262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 189/371] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:51.019694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166e605-4918-4413-a128-62e4759a3071 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:51.019980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166e605-4918-4413-a128-62e4759a3071 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:51.020256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166e605-4918-4413-a128-62e4759a3071 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:51.022134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 190/372] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:51.022825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166e605-4918-4413-a128-62e4759a3071 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:51.068272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab5fec-f939-43f1-b2d9-c444bc2cf0f0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:51.069614 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:51.127154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c80a89-3010-4a90-b5e0-9f61d7ab3c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:51.127154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c80a89-3010-4a90-b5e0-9f61d7ab3c44 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:51.127948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c80a89-3010-4a90-b5e0-9f61d7ab3c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:51.128247 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c80a89-3010-4a90-b5e0-9f61d7ab3c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:51.129950 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c80a89-3010-4a90-b5e0-9f61d7ab3c44 None admin] RBAC: Adding query filter params (group.id=69a5e68c68c0446bb577c4aff6555ce7, role.id=bb946622ce1842cba751c5f862237f14, scope.project.id=2ef691ae767340c29a30ccdea323f352) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:51.129950 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c80a89-3010-4a90-b5e0-9f61d7ab3c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:51.130964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c80a89-3010-4a90-b5e0-9f61d7ab3c44 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:51.137248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 183/373] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 27 15:11:50 2022] GET /identity/v3/role_assignments?group.id=69a5e68c68c0446bb577c4aff6555ce7&scope.project.id=2ef691ae767340c29a30ccdea323f352&role.id=bb946622ce1842cba751c5f862237f14 => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:51.138450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c80a89-3010-4a90-b5e0-9f61d7ab3c44 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:51.167695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166e605-4918-4413-a128-62e4759a3071 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:51.178708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:51.215972 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bbabd-adcd-4d4d-a746-98ee019887f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:51.216675 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bbabd-adcd-4d4d-a746-98ee019887f4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:51.216954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bbabd-adcd-4d4d-a746-98ee019887f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:51.217224 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bbabd-adcd-4d4d-a746-98ee019887f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:51.218858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bbabd-adcd-4d4d-a746-98ee019887f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:51.218858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bbabd-adcd-4d4d-a746-98ee019887f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:51.220382 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bbabd-adcd-4d4d-a746-98ee019887f4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:51.232351 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 191/374] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:51.234519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8b0ee-0d47-4f98-ab26-b704cd305dae None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:51.234815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8b0ee-0d47-4f98-ab26-b704cd305dae None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:51.235097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8b0ee-0d47-4f98-ab26-b704cd305dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:51.258549 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d7c8b0ee-0d47-4f98-ab26-b704cd305dae None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:51.259987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d7c8b0ee-0d47-4f98-ab26-b704cd305dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:51.279393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c80a89-3010-4a90-b5e0-9f61d7ab3c44 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:51.342929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef881889-1b3d-4c3f-abb9-5e5dbdefc6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:51.343749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef881889-1b3d-4c3f-abb9-5e5dbdefc6cf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:51.344033 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef881889-1b3d-4c3f-abb9-5e5dbdefc6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:51.344318 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef881889-1b3d-4c3f-abb9-5e5dbdefc6cf None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:51.348824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef881889-1b3d-4c3f-abb9-5e5dbdefc6cf None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:51.350336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef881889-1b3d-4c3f-abb9-5e5dbdefc6cf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:51.352161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 184/375] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:51 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:51.354081 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef881889-1b3d-4c3f-abb9-5e5dbdefc6cf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:51.380108 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 192/376] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:51.381027 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8b0ee-0d47-4f98-ab26-b704cd305dae None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:51.412636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:51.470938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:51.478445 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef881889-1b3d-4c3f-abb9-5e5dbdefc6cf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:51.519018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfee34-781d-4eca-9423-a99eb956b801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:51.519706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfee34-781d-4eca-9423-a99eb956b801 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:51.520004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfee34-781d-4eca-9423-a99eb956b801 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:51.520244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfee34-781d-4eca-9423-a99eb956b801 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:51.522649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8b0ee-0d47-4f98-ab26-b704cd305dae None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:51.580323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa75650-30f4-4c29-94bf-52c7c5033393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:51.582460 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa75650-30f4-4c29-94bf-52c7c5033393 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:51.582964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa75650-30f4-4c29-94bf-52c7c5033393 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:51.584586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa75650-30f4-4c29-94bf-52c7c5033393 None admin] PATH_INFO: `/v3/groups/69a5e68c68c0446bb577c4aff6555ce7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:51.586479 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa75650-30f4-4c29-94bf-52c7c5033393 None admin] RBAC: Authorizing `identity:get_group(group_id=69a5e68c68c0446bb577c4aff6555ce7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:51.588963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa75650-30f4-4c29-94bf-52c7c5033393 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:51.591803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 193/377] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 27 15:11:51 2022] GET /identity/v3/groups/69a5e68c68c0446bb577c4aff6555ce7 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:51.593284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa75650-30f4-4c29-94bf-52c7c5033393 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:51.613090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfee34-781d-4eca-9423-a99eb956b801 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:51.615415 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfee34-781d-4eca-9423-a99eb956b801 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:51.706718 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:51.735731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa75650-30f4-4c29-94bf-52c7c5033393 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:51.738262 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:51.749776 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 185/378] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:51.750726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfee34-781d-4eca-9423-a99eb956b801 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:51.788436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8e30a-3895-4016-a16f-34b544370100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:51.789266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8e30a-3895-4016-a16f-34b544370100 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:51.789550 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8e30a-3895-4016-a16f-34b544370100 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:51.789826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8e30a-3895-4016-a16f-34b544370100 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:51.802512 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8e30a-3895-4016-a16f-34b544370100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:51.810761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-bde8e30a-3895-4016-a16f-34b544370100 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:51.810761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:51.810761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:51.810761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:51.810761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:51.810761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:51.810761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:51.810761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:51.810761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:51.810761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:51.810761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:51.810761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:51.810761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:51.810761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:51.810761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:51.810761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:51.811681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:51.811681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:51.811681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:51.811681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:51.811681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:51.811681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:51.811681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:51.811681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:51.811681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:51.811681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:51.811681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:51.811681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:51.811681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:51.811681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:51.811681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:51.811681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:51.812456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:51.812456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:51.812456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:51.812456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:51.812456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:51.812456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:51.812456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:51.812456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:51.812456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:51.812456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:51.812456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:51.812456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:51.812456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 194/379] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:51.813600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8e30a-3895-4016-a16f-34b544370100 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:51.887869 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfee34-781d-4eca-9423-a99eb956b801 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:51.927732 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8e30a-3895-4016-a16f-34b544370100 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:51.934286 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01545de-402e-49ff-ac05-86b0172e3120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:51.935281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01545de-402e-49ff-ac05-86b0172e3120 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:51.935777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01545de-402e-49ff-ac05-86b0172e3120 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:51.936253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01545de-402e-49ff-ac05-86b0172e3120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:51.937308 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01545de-402e-49ff-ac05-86b0172e3120 None admin] RBAC: Adding query filter params (group.id=69a5e68c68c0446bb577c4aff6555ce7, role.id=0763e374972f4ce29ab449e27fd89355, scope.project.id=2ef691ae767340c29a30ccdea323f352) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:51.939012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01545de-402e-49ff-ac05-86b0172e3120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:51.941173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01545de-402e-49ff-ac05-86b0172e3120 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:51.949711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 186/380] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 27 15:11:51 2022] GET /identity/v3/role_assignments?group.id=69a5e68c68c0446bb577c4aff6555ce7&scope.project.id=2ef691ae767340c29a30ccdea323f352&role.id=0763e374972f4ce29ab449e27fd89355 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:51.951011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01545de-402e-49ff-ac05-86b0172e3120 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:51.974486 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8b23a-5bfb-45f1-89a2-47cbb482a987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:51.975811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8b23a-5bfb-45f1-89a2-47cbb482a987 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:51.976292 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8b23a-5bfb-45f1-89a2-47cbb482a987 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:51.976829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8b23a-5bfb-45f1-89a2-47cbb482a987 None admin] PATH_INFO: `/v3/projects/ad42af4f268b41b59ed4e25b5dbf310e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:51.978302 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8b23a-5bfb-45f1-89a2-47cbb482a987 None admin] RBAC: Authorizing `identity:get_project(project_id=ad42af4f268b41b59ed4e25b5dbf310e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:51.980122 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8b23a-5bfb-45f1-89a2-47cbb482a987 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:51.982577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 195/381] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:51 2022] GET /identity/v3/projects/ad42af4f268b41b59ed4e25b5dbf310e => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:51.989451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8b23a-5bfb-45f1-89a2-47cbb482a987 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:52.022624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:52.091624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:52.196518 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01545de-402e-49ff-ac05-86b0172e3120 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:52.202846 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8b23a-5bfb-45f1-89a2-47cbb482a987 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:52.246183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37903579-cf88-44ef-a650-e75545ea22f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:52.247361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37903579-cf88-44ef-a650-e75545ea22f6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:52.247658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37903579-cf88-44ef-a650-e75545ea22f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:52.247940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37903579-cf88-44ef-a650-e75545ea22f6 None admin] PATH_INFO: `/v3/groups/ff26e3c7fc7a425f970f94ec2da081a1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:52.249538 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37bd0c-278f-481d-bf93-db76bd7d8d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:52.250361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37bd0c-278f-481d-bf93-db76bd7d8d9a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:52.250653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37bd0c-278f-481d-bf93-db76bd7d8d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:52.250935 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37bd0c-278f-481d-bf93-db76bd7d8d9a None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:52.251711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37bd0c-278f-481d-bf93-db76bd7d8d9a None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:52.252117 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37bd0c-278f-481d-bf93-db76bd7d8d9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:52.253631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37bd0c-278f-481d-bf93-db76bd7d8d9a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:52.256261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37903579-cf88-44ef-a650-e75545ea22f6 None admin] RBAC: Authorizing `identity:get_group(group_id=ff26e3c7fc7a425f970f94ec2da081a1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:52.257827 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37903579-cf88-44ef-a650-e75545ea22f6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:52.260055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 196/382] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 27 15:11:51 2022] GET /identity/v3/groups/ff26e3c7fc7a425f970f94ec2da081a1 => generated 229 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:52.262932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 187/383] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:52.267484 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37903579-cf88-44ef-a650-e75545ea22f6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:52.269125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37bd0c-278f-481d-bf93-db76bd7d8d9a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:52.381804 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:52.399011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37bd0c-278f-481d-bf93-db76bd7d8d9a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:52.414669 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37903579-cf88-44ef-a650-e75545ea22f6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:52.421780 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:52.438531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ba881-72a3-4573-890f-2182d84775cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:52.439516 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ba881-72a3-4573-890f-2182d84775cf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:52.439809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ba881-72a3-4573-890f-2182d84775cf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:52.440155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ba881-72a3-4573-890f-2182d84775cf None admin] PATH_INFO: `/v3/groups/69a5e68c68c0446bb577c4aff6555ce7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:52.441553 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ba881-72a3-4573-890f-2182d84775cf None admin] RBAC: Authorizing `identity:get_group(group_id=69a5e68c68c0446bb577c4aff6555ce7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:52.443267 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ba881-72a3-4573-890f-2182d84775cf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:52.450083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 188/384] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 27 15:11:52 2022] GET /identity/v3/groups/69a5e68c68c0446bb577c4aff6555ce7 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:52.451045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ba881-72a3-4573-890f-2182d84775cf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:52.453466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e235503-e7ae-429d-bede-a7ac78fa09c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:52.454285 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e235503-e7ae-429d-bede-a7ac78fa09c8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:52.454947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e235503-e7ae-429d-bede-a7ac78fa09c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:52.455419 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e235503-e7ae-429d-bede-a7ac78fa09c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:52.457022 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e235503-e7ae-429d-bede-a7ac78fa09c8 None admin] RBAC: Adding query filter params (group.id=ff26e3c7fc7a425f970f94ec2da081a1, role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=ad42af4f268b41b59ed4e25b5dbf310e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:52.457557 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e235503-e7ae-429d-bede-a7ac78fa09c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:52.459386 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e235503-e7ae-429d-bede-a7ac78fa09c8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:52.474666 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 197/385] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 27 15:11:52 2022] GET /identity/v3/role_assignments?group.id=ff26e3c7fc7a425f970f94ec2da081a1&scope.project.id=ad42af4f268b41b59ed4e25b5dbf310e&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:52.570107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ba881-72a3-4573-890f-2182d84775cf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:52.607615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd813bd-e55d-4645-9c35-ea9e1997f8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:52.608518 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd813bd-e55d-4645-9c35-ea9e1997f8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:52.608805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd813bd-e55d-4645-9c35-ea9e1997f8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:52.609090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd813bd-e55d-4645-9c35-ea9e1997f8b8 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:52.610432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd813bd-e55d-4645-9c35-ea9e1997f8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:52.612003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd813bd-e55d-4645-9c35-ea9e1997f8b8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:52.618367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 189/386] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:52 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:52.620728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e235503-e7ae-429d-bede-a7ac78fa09c8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:52.758446 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e235503-e7ae-429d-bede-a7ac78fa09c8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:52.805658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee3810-7c87-44e0-a7a6-f584cc5260c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:52.806673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee3810-7c87-44e0-a7a6-f584cc5260c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:52.807318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee3810-7c87-44e0-a7a6-f584cc5260c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:52.807581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee3810-7c87-44e0-a7a6-f584cc5260c1 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2/groups/69a5e68c68c0446bb577c4aff6555ce7/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:52.809572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee3810-7c87-44e0-a7a6-f584cc5260c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b20137a36384531941036a989526bd2, group_id=69a5e68c68c0446bb577c4aff6555ce7, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:52.811066 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee3810-7c87-44e0-a7a6-f584cc5260c1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:52.831726 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 198/387] 10.222.0.33 () {58 vars in 1442 bytes} [Mon Jun 27 15:11:52 2022] PUT /identity/v3/projects/0b20137a36384531941036a989526bd2/groups/69a5e68c68c0446bb577c4aff6555ce7/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:11:53.325701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71072158-8d4c-4388-858b-8d6aa4fc0113 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:53.326778 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71072158-8d4c-4388-858b-8d6aa4fc0113 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:53.327267 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71072158-8d4c-4388-858b-8d6aa4fc0113 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:53.329157 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 190/388] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:53.340289 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c968b50-2889-42d3-bb56-c097d6c04c21 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:53.341280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c968b50-2889-42d3-bb56-c097d6c04c21 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:53.341760 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c968b50-2889-42d3-bb56-c097d6c04c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:53.352334 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:53.371399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6c968b50-2889-42d3-bb56-c097d6c04c21 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:53.373002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6c968b50-2889-42d3-bb56-c097d6c04c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:53.473350 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 199/389] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:53.483682 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa44d7d-9aa5-492c-abf3-0b04741d6033 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:53.484218 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa44d7d-9aa5-492c-abf3-0b04741d6033 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:53.484674 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa44d7d-9aa5-492c-abf3-0b04741d6033 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:53.486584 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 191/390] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:53.492841 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e87231-48c0-439b-8949-25393a7d4d2a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:53.493137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e87231-48c0-439b-8949-25393a7d4d2a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:53.493427 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e87231-48c0-439b-8949-25393a7d4d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:53.516392 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-33e87231-48c0-439b-8949-25393a7d4d2a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:53.517606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-33e87231-48c0-439b-8949-25393a7d4d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:53.525153 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa44d7d-9aa5-492c-abf3-0b04741d6033 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:53.617979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 200/391] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:53.637644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:53.663826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e87231-48c0-439b-8949-25393a7d4d2a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:53.738888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:53.739320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa44d7d-9aa5-492c-abf3-0b04741d6033 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:53.803612 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb175b2-1868-433d-85da-b8e8aac744ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:53.805561 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb175b2-1868-433d-85da-b8e8aac744ff None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:53.805851 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb175b2-1868-433d-85da-b8e8aac744ff None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:53.806130 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb175b2-1868-433d-85da-b8e8aac744ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:53.817167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e87231-48c0-439b-8949-25393a7d4d2a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:53.824229 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb175b2-1868-433d-85da-b8e8aac744ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:53.835700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-3bb175b2-1868-433d-85da-b8e8aac744ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:53.835700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:53.835700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:53.835700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:53.835700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:53.835700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:53.835700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:53.835700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:53.835700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:53.835700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:53.835700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:53.835700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:53.835700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:53.835700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:53.835700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:53.835700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:53.836640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:53.836640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:53.836640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:53.836640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:53.836640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:53.836640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:53.836640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:53.836640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:53.836640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:53.836640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:53.836640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:53.836640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:53.836640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:53.836640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:53.836640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:53.836640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:53.837457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:53.837457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:53.837457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:53.837457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:53.837457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:53.837457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:53.837457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:53.837457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:53.837457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:53.837457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:53.837457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:53.837457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:53.845050 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 192/392] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:11:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:53.846993 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb175b2-1868-433d-85da-b8e8aac744ff None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:53.906507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fd11e-3885-439b-839d-a5020d5c5967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:53.907340 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fd11e-3885-439b-839d-a5020d5c5967 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:53.907623 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fd11e-3885-439b-839d-a5020d5c5967 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:53.907895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fd11e-3885-439b-839d-a5020d5c5967 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:53.947214 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fd11e-3885-439b-839d-a5020d5c5967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:53.962398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb175b2-1868-433d-85da-b8e8aac744ff None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:53.964554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-474fd11e-3885-439b-839d-a5020d5c5967 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:53.964554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:53.964554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:53.964554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:53.964554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:53.964554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:53.964554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:53.964554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:53.964554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:53.964554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:53.964554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:53.964554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:53.964554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:53.964554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:53.964554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:53.964554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:53.965432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:53.965432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:53.965432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:53.965432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:53.965432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:53.965432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:53.965432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:53.965432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:53.965432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:53.965432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:53.965432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:53.965432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:53.965432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:53.965432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:53.965432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:53.965432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:53.966697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:53.966697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:53.966697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:53.966697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:53.966697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:53.966697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:53.966697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:53.966697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:53.966697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:53.966697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:53.966697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:53.966697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:53.966697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 201/393] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:53.972102 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fd11e-3885-439b-839d-a5020d5c5967 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:53.988111 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:54.014542 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83555be1-a5e4-4de5-b790-70ce0ed02eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:54.016938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83555be1-a5e4-4de5-b790-70ce0ed02eee None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:54.019120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83555be1-a5e4-4de5-b790-70ce0ed02eee None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:54.019630 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83555be1-a5e4-4de5-b790-70ce0ed02eee None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:54.020606 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83555be1-a5e4-4de5-b790-70ce0ed02eee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:54.022121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83555be1-a5e4-4de5-b790-70ce0ed02eee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:54.023763 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83555be1-a5e4-4de5-b790-70ce0ed02eee None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:54.043963 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 193/394] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:11:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:54.067825 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83555be1-a5e4-4de5-b790-70ce0ed02eee None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:54.153585 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fd11e-3885-439b-839d-a5020d5c5967 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:54.178935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:54.202591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04673540-8a99-439b-b249-07f86144a996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:54.203770 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04673540-8a99-439b-b249-07f86144a996 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:54.204275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04673540-8a99-439b-b249-07f86144a996 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:54.204746 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04673540-8a99-439b-b249-07f86144a996 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:54.205773 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04673540-8a99-439b-b249-07f86144a996 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:54.206419 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04673540-8a99-439b-b249-07f86144a996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:54.208203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04673540-8a99-439b-b249-07f86144a996 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:54.218132 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 202/395] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:54.225092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04673540-8a99-439b-b249-07f86144a996 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:54.230878 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83555be1-a5e4-4de5-b790-70ce0ed02eee None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:54.265726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f151c-0a58-454f-93d1-c0e0441d4d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:54.266567 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f151c-0a58-454f-93d1-c0e0441d4d86 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:54.267029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f151c-0a58-454f-93d1-c0e0441d4d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:54.267559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f151c-0a58-454f-93d1-c0e0441d4d86 None admin] PATH_INFO: `/v3/groups/69a5e68c68c0446bb577c4aff6555ce7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:54.269602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f151c-0a58-454f-93d1-c0e0441d4d86 None admin] RBAC: Authorizing `identity:get_group(group_id=69a5e68c68c0446bb577c4aff6555ce7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:54.271605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f151c-0a58-454f-93d1-c0e0441d4d86 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:54.273726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 194/396] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 27 15:11:54 2022] GET /identity/v3/groups/69a5e68c68c0446bb577c4aff6555ce7 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:54.279469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f151c-0a58-454f-93d1-c0e0441d4d86 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:54.370761 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:54.403731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f151c-0a58-454f-93d1-c0e0441d4d86 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:54.430154 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04673540-8a99-439b-b249-07f86144a996 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:54.460057 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd44f3-a1ae-4f1c-914c-47fa0d4da21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:54.460959 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd44f3-a1ae-4f1c-914c-47fa0d4da21b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:54.461243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd44f3-a1ae-4f1c-914c-47fa0d4da21b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:54.461525 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd44f3-a1ae-4f1c-914c-47fa0d4da21b None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:54.462845 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd44f3-a1ae-4f1c-914c-47fa0d4da21b None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:54.464333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd44f3-a1ae-4f1c-914c-47fa0d4da21b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:54.466397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 195/397] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:54 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:54.473083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd44f3-a1ae-4f1c-914c-47fa0d4da21b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:54.490617 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f19dd-000e-4b56-bdf3-2f88b7a7fa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:54.491508 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f19dd-000e-4b56-bdf3-2f88b7a7fa54 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:54.491793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f19dd-000e-4b56-bdf3-2f88b7a7fa54 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:54.492070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f19dd-000e-4b56-bdf3-2f88b7a7fa54 None admin] PATH_INFO: `/v3/groups/69a5e68c68c0446bb577c4aff6555ce7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:54.493275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f19dd-000e-4b56-bdf3-2f88b7a7fa54 None admin] RBAC: Authorizing `identity:get_group(group_id=69a5e68c68c0446bb577c4aff6555ce7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:54.496234 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f19dd-000e-4b56-bdf3-2f88b7a7fa54 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:54.498017 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 203/398] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 27 15:11:54 2022] GET /identity/v3/groups/69a5e68c68c0446bb577c4aff6555ce7 => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:54.499314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e29cb6-37e8-4275-8092-167d0da95811 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:54.499603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e29cb6-37e8-4275-8092-167d0da95811 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:54.499882 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e29cb6-37e8-4275-8092-167d0da95811 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:54.501373 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 204/399] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:54.506471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e29cb6-37e8-4275-8092-167d0da95811 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:54.574360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:54.589869 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd44f3-a1ae-4f1c-914c-47fa0d4da21b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:54.618674 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:54.633009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32da3a1-9e18-481a-982e-425fd82156b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:54.633983 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32da3a1-9e18-481a-982e-425fd82156b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:54.634320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32da3a1-9e18-481a-982e-425fd82156b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:54.634662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32da3a1-9e18-481a-982e-425fd82156b8 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2/groups/69a5e68c68c0446bb577c4aff6555ce7/roles/0763e374972f4ce29ab449e27fd89355` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:54.635398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e29cb6-37e8-4275-8092-167d0da95811 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:54.637229 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32da3a1-9e18-481a-982e-425fd82156b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b20137a36384531941036a989526bd2, group_id=69a5e68c68c0446bb577c4aff6555ce7, role_id=0763e374972f4ce29ab449e27fd89355)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:54.639847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32da3a1-9e18-481a-982e-425fd82156b8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:54.657044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 196/400] 10.222.0.33 () {58 vars in 1442 bytes} [Mon Jun 27 15:11:54 2022] PUT /identity/v3/projects/0b20137a36384531941036a989526bd2/groups/69a5e68c68c0446bb577c4aff6555ce7/roles/0763e374972f4ce29ab449e27fd89355 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:11:54.658395 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e95b64-8cd9-4c92-83d4-6c525516b794 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:54.658799 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e95b64-8cd9-4c92-83d4-6c525516b794 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:54.659091 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e95b64-8cd9-4c92-83d4-6c525516b794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:54.678842 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f6a20-8d90-4586-8024-b95514408322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:54.679741 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f6a20-8d90-4586-8024-b95514408322 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:54.680026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f6a20-8d90-4586-8024-b95514408322 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:54.680304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f6a20-8d90-4586-8024-b95514408322 None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:54.681496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f6a20-8d90-4586-8024-b95514408322 None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:54.683010 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-91e95b64-8cd9-4c92-83d4-6c525516b794 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:54.683331 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f6a20-8d90-4586-8024-b95514408322 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:54.684621 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-91e95b64-8cd9-4c92-83d4-6c525516b794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:54.685356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 205/401] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:54 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:54.692015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f6a20-8d90-4586-8024-b95514408322 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:54.814871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f6a20-8d90-4586-8024-b95514408322 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:54.837689 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:54.854327 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650ffeb-280c-47a3-8e71-bfb6f791c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:54.855606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ffeb-280c-47a3-8e71-bfb6f791c9b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:54.856042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ffeb-280c-47a3-8e71-bfb6f791c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:54.856464 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ffeb-280c-47a3-8e71-bfb6f791c9b7 None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352/groups/69a5e68c68c0446bb577c4aff6555ce7/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:54.858755 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650ffeb-280c-47a3-8e71-bfb6f791c9b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ef691ae767340c29a30ccdea323f352, group_id=69a5e68c68c0446bb577c4aff6555ce7, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:54.860396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650ffeb-280c-47a3-8e71-bfb6f791c9b7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:54.879026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 206/402] 10.222.0.33 () {58 vars in 1442 bytes} [Mon Jun 27 15:11:54 2022] PUT /identity/v3/projects/2ef691ae767340c29a30ccdea323f352/groups/69a5e68c68c0446bb577c4aff6555ce7/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:11:54.883334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 197/403] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:54.911432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650ffeb-280c-47a3-8e71-bfb6f791c9b7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:55.026717 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650ffeb-280c-47a3-8e71-bfb6f791c9b7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:55.065499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2d054-96af-4aac-a140-84a89182543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:55.066830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2d054-96af-4aac-a140-84a89182543e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:55.067317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2d054-96af-4aac-a140-84a89182543e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:55.067789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2d054-96af-4aac-a140-84a89182543e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:55.083253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2d054-96af-4aac-a140-84a89182543e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:55.091471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c3c2d054-96af-4aac-a140-84a89182543e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:55.091471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:55.091471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:55.091471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:55.091471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:55.091471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:55.091471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:55.091471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:55.091471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:55.091471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:55.091471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:55.091471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:55.091471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:55.091471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:55.091471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:55.091471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:55.092370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:55.092370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:55.092370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:55.092370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:55.092370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:55.092370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:55.092370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:55.092370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:55.092370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:55.092370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:55.092370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:55.092370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:55.092370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:55.092370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:55.092370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:55.092370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:55.093178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:55.093178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:55.093178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:55.093178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:55.093178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:55.093178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:55.093178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:55.093178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:55.093178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:55.093178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:55.093178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:55.093178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:55.093178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 207/404] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:11:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:55.103394 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e95b64-8cd9-4c92-83d4-6c525516b794 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:55.158273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879cd13-d16b-42d2-8f78-a22c48c49a59 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:55.158273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879cd13-d16b-42d2-8f78-a22c48c49a59 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:55.158273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879cd13-d16b-42d2-8f78-a22c48c49a59 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:55.158273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 208/405] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:55.166367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ff4df-0b80-4006-8151-3369cb0c7e84 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:55.166367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ff4df-0b80-4006-8151-3369cb0c7e84 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:55.166367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ff4df-0b80-4006-8151-3369cb0c7e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:55.185654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-922ff4df-0b80-4006-8151-3369cb0c7e84 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:55.189584 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-922ff4df-0b80-4006-8151-3369cb0c7e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:55.257644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:55.282788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e95b64-8cd9-4c92-83d4-6c525516b794 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:55.287273 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:55.325297 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 209/406] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:55.345369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39129dc1-97f0-4705-aeaf-3d4341209a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:55.345972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39129dc1-97f0-4705-aeaf-3d4341209a5e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:55.346412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39129dc1-97f0-4705-aeaf-3d4341209a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:55.346692 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39129dc1-97f0-4705-aeaf-3d4341209a5e None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:55.347463 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39129dc1-97f0-4705-aeaf-3d4341209a5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:55.347762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39129dc1-97f0-4705-aeaf-3d4341209a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:55.349152 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39129dc1-97f0-4705-aeaf-3d4341209a5e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:55.358358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 198/407] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:11:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:55.365810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ff4df-0b80-4006-8151-3369cb0c7e84 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:55.370311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39129dc1-97f0-4705-aeaf-3d4341209a5e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:55.491355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ff4df-0b80-4006-8151-3369cb0c7e84 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:55.530393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ca621-5b06-4fb6-8d6d-8351dd80518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:55.531497 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ca621-5b06-4fb6-8d6d-8351dd80518c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:55.531755 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ca621-5b06-4fb6-8d6d-8351dd80518c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:55.532032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ca621-5b06-4fb6-8d6d-8351dd80518c None admin] PATH_INFO: `/v3/groups/69a5e68c68c0446bb577c4aff6555ce7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:55.534443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ca621-5b06-4fb6-8d6d-8351dd80518c None admin] RBAC: Authorizing `identity:get_group(group_id=69a5e68c68c0446bb577c4aff6555ce7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:55.535939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ca621-5b06-4fb6-8d6d-8351dd80518c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:55.537816 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 210/408] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 27 15:11:55 2022] GET /identity/v3/groups/69a5e68c68c0446bb577c4aff6555ce7 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:55.543570 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ca621-5b06-4fb6-8d6d-8351dd80518c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:55.598497 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:55.607468 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39129dc1-97f0-4705-aeaf-3d4341209a5e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:55.653221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539edec-7e3e-4df2-bd51-d5cd8d29e649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:55.654270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539edec-7e3e-4df2-bd51-d5cd8d29e649 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:55.654669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539edec-7e3e-4df2-bd51-d5cd8d29e649 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:55.654967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539edec-7e3e-4df2-bd51-d5cd8d29e649 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:55.669339 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ca621-5b06-4fb6-8d6d-8351dd80518c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:55.670678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539edec-7e3e-4df2-bd51-d5cd8d29e649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:55.682323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e539edec-7e3e-4df2-bd51-d5cd8d29e649 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:55.682323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:55.682323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:55.682323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:55.682323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:55.682323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:55.682323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:55.682323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:55.682323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:55.682323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:55.682323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:55.682323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:55.682323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:55.682323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:55.682323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:55.682323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:55.683333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:55.683333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:55.683333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:55.683333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:55.683333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:55.683333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:55.683333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:55.683333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:55.683333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:55.683333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:55.683333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:55.683333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:55.683333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:55.683333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:55.683333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:55.683333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:55.684207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:55.684207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:55.684207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:55.684207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:55.684207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:55.684207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:55.684207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:55.684207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:55.684207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:55.684207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:55.684207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:11:55.684207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:55.684207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 199/409] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:11:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:55.685574 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02a6d2-1a56-4b12-bd71-28169ac593e3 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:55.685871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02a6d2-1a56-4b12-bd71-28169ac593e3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:55.686151 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02a6d2-1a56-4b12-bd71-28169ac593e3 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:55.690324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 200/410] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:55.691613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02a6d2-1a56-4b12-bd71-28169ac593e3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:55.720076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61c7a8-11dc-46c7-8fa6-24e34b21fd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:55.721514 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61c7a8-11dc-46c7-8fa6-24e34b21fd80 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:55.722212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61c7a8-11dc-46c7-8fa6-24e34b21fd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:55.722751 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61c7a8-11dc-46c7-8fa6-24e34b21fd80 None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:55.724422 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61c7a8-11dc-46c7-8fa6-24e34b21fd80 None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:55.726248 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61c7a8-11dc-46c7-8fa6-24e34b21fd80 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:55.733463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 211/411] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:55 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:55.733463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d02b9-9e3f-43da-a3bc-c8201c836fc1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:55.733463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d02b9-9e3f-43da-a3bc-c8201c836fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:55.733463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d02b9-9e3f-43da-a3bc-c8201c836fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:55.741795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:55.753946 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-836d02b9-9e3f-43da-a3bc-c8201c836fc1 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:55.755653 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-836d02b9-9e3f-43da-a3bc-c8201c836fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:55.840244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02a6d2-1a56-4b12-bd71-28169ac593e3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:55.846162 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 212/412] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:55.847353 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d02b9-9e3f-43da-a3bc-c8201c836fc1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:55.889402 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:55.900362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d73ec-d7a1-4a81-b2dc-5bcec316ab0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:55.901391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d73ec-d7a1-4a81-b2dc-5bcec316ab0e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:55.901501 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d73ec-d7a1-4a81-b2dc-5bcec316ab0e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:55.901708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d73ec-d7a1-4a81-b2dc-5bcec316ab0e None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:55.902506 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d73ec-d7a1-4a81-b2dc-5bcec316ab0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:55.902821 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d73ec-d7a1-4a81-b2dc-5bcec316ab0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:55.904337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d73ec-d7a1-4a81-b2dc-5bcec316ab0e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:55.915639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 201/413] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:55.916856 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d73ec-d7a1-4a81-b2dc-5bcec316ab0e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:55.984776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d02b9-9e3f-43da-a3bc-c8201c836fc1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:56.024685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:56.039239 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b8bcc-d9c0-4dae-8f0e-9c3a6a95aa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:56.040149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b8bcc-d9c0-4dae-8f0e-9c3a6a95aa5f None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:56.040429 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b8bcc-d9c0-4dae-8f0e-9c3a6a95aa5f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:56.040702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b8bcc-d9c0-4dae-8f0e-9c3a6a95aa5f None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352/groups/69a5e68c68c0446bb577c4aff6555ce7/roles/0763e374972f4ce29ab449e27fd89355` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:56.044298 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b8bcc-d9c0-4dae-8f0e-9c3a6a95aa5f None admin] RBAC: Authorizing `identity:create_grant(project_id=2ef691ae767340c29a30ccdea323f352, group_id=69a5e68c68c0446bb577c4aff6555ce7, role_id=0763e374972f4ce29ab449e27fd89355)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:56.046328 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b8bcc-d9c0-4dae-8f0e-9c3a6a95aa5f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:56.047586 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d73ec-d7a1-4a81-b2dc-5bcec316ab0e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:56.067149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 213/414] 10.222.0.33 () {58 vars in 1442 bytes} [Mon Jun 27 15:11:55 2022] PUT /identity/v3/projects/2ef691ae767340c29a30ccdea323f352/groups/69a5e68c68c0446bb577c4aff6555ce7/roles/0763e374972f4ce29ab449e27fd89355 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:11:56.074634 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b8bcc-d9c0-4dae-8f0e-9c3a6a95aa5f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:56.131153 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c36ac8-38e2-4ca9-8b58-f9fc90b9e5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:56.131968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c36ac8-38e2-4ca9-8b58-f9fc90b9e5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:56.132248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c36ac8-38e2-4ca9-8b58-f9fc90b9e5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:56.132522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c36ac8-38e2-4ca9-8b58-f9fc90b9e5b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:56.158390 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c36ac8-38e2-4ca9-8b58-f9fc90b9e5b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:56.179295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-76c36ac8-38e2-4ca9-8b58-f9fc90b9e5b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:56.179295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:56.179295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:56.179295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:56.179295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:56.179295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:56.179295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:56.179295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:56.179295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:56.179295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:56.179295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:56.179295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:56.179295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:56.179295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:56.179295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:56.179295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:56.180280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:56.180280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:56.180280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:56.180280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:56.180280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:56.180280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:56.180280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:56.180280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:56.180280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:56.180280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:56.180280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:56.180280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:56.180280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:56.180280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:56.180280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:56.180280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:56.181056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:56.181056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:56.181056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:56.181056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:56.181056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:56.181056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:56.181056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:56.181056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:56.181056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:56.181056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:56.181056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:56.181056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:56.182548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 202/415] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:56.203065 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c36ac8-38e2-4ca9-8b58-f9fc90b9e5b9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:56.301726 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:56.308878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b8bcc-d9c0-4dae-8f0e-9c3a6a95aa5f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:56.359851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4686806-7026-4dad-a7b1-6b7b2a567b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:56.361003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4686806-7026-4dad-a7b1-6b7b2a567b8c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:56.361291 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4686806-7026-4dad-a7b1-6b7b2a567b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:56.361864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4686806-7026-4dad-a7b1-6b7b2a567b8c None admin] PATH_INFO: `/v3/groups/ff26e3c7fc7a425f970f94ec2da081a1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:56.363568 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4686806-7026-4dad-a7b1-6b7b2a567b8c None admin] RBAC: Authorizing `identity:get_group(group_id=ff26e3c7fc7a425f970f94ec2da081a1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:56.365676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4686806-7026-4dad-a7b1-6b7b2a567b8c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:56.368256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 214/416] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 27 15:11:56 2022] GET /identity/v3/groups/ff26e3c7fc7a425f970f94ec2da081a1 => generated 229 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:56.373298 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4686806-7026-4dad-a7b1-6b7b2a567b8c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:56.377299 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c36ac8-38e2-4ca9-8b58-f9fc90b9e5b9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:56.413767 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1fadb-0312-4f24-8102-1116fd17b83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:56.414751 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1fadb-0312-4f24-8102-1116fd17b83c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:56.414751 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1fadb-0312-4f24-8102-1116fd17b83c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:56.415252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1fadb-0312-4f24-8102-1116fd17b83c None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:56.416058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1fadb-0312-4f24-8102-1116fd17b83c None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:56.416370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1fadb-0312-4f24-8102-1116fd17b83c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:56.417757 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1fadb-0312-4f24-8102-1116fd17b83c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:56.427127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 203/417] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:56.434503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1fadb-0312-4f24-8102-1116fd17b83c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:56.457726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:56.610433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4686806-7026-4dad-a7b1-6b7b2a567b8c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:56.637868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1fadb-0312-4f24-8102-1116fd17b83c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:56.672857 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d49aad-d154-458a-8985-9bd249737f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:56.673441 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d49aad-d154-458a-8985-9bd249737f65 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:56.673730 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d49aad-d154-458a-8985-9bd249737f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:56.674006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d49aad-d154-458a-8985-9bd249737f65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:56.694868 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2b0c3-3ccc-4e5e-94b2-1f9e93a73af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:56.696428 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2b0c3-3ccc-4e5e-94b2-1f9e93a73af6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:56.696939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2b0c3-3ccc-4e5e-94b2-1f9e93a73af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:56.697581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2b0c3-3ccc-4e5e-94b2-1f9e93a73af6 None admin] PATH_INFO: `/v3/projects/ad42af4f268b41b59ed4e25b5dbf310e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:56.703874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2b0c3-3ccc-4e5e-94b2-1f9e93a73af6 None admin] RBAC: Authorizing `identity:get_project(project_id=ad42af4f268b41b59ed4e25b5dbf310e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:56.705403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2b0c3-3ccc-4e5e-94b2-1f9e93a73af6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:56.707428 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 215/418] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:56 2022] GET /identity/v3/projects/ad42af4f268b41b59ed4e25b5dbf310e => generated 344 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:56.715210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2b0c3-3ccc-4e5e-94b2-1f9e93a73af6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:56.763560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d49aad-d154-458a-8985-9bd249737f65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:56.765043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d49aad-d154-458a-8985-9bd249737f65 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:56.775263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:56.780725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:56.887698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 204/419] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:56.893426 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d49aad-d154-458a-8985-9bd249737f65 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:56.957152 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2b0c3-3ccc-4e5e-94b2-1f9e93a73af6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:57.056140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d49aad-d154-458a-8985-9bd249737f65 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:57.062879 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188b93d-b222-4411-9bc0-e2e8ec5afc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:57.064420 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188b93d-b222-4411-9bc0-e2e8ec5afc92 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:57.064992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188b93d-b222-4411-9bc0-e2e8ec5afc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:57.065485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188b93d-b222-4411-9bc0-e2e8ec5afc92 None admin] PATH_INFO: `/v3/projects/ad42af4f268b41b59ed4e25b5dbf310e/groups/ff26e3c7fc7a425f970f94ec2da081a1/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:57.075626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188b93d-b222-4411-9bc0-e2e8ec5afc92 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad42af4f268b41b59ed4e25b5dbf310e, group_id=ff26e3c7fc7a425f970f94ec2da081a1, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:57.078322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188b93d-b222-4411-9bc0-e2e8ec5afc92 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:57.086713 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:57.092891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f8d39-6e27-4ee5-9a83-54ec177104da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:57.093784 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f8d39-6e27-4ee5-9a83-54ec177104da None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:57.094071 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f8d39-6e27-4ee5-9a83-54ec177104da None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:57.094382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f8d39-6e27-4ee5-9a83-54ec177104da None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:57.095628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f8d39-6e27-4ee5-9a83-54ec177104da None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:57.097354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f8d39-6e27-4ee5-9a83-54ec177104da None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:57.099626 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 205/420] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:56 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:57.105007 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f8d39-6e27-4ee5-9a83-54ec177104da None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:57.137532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 216/421] 10.222.0.33 () {58 vars in 1442 bytes} [Mon Jun 27 15:11:56 2022] PUT /identity/v3/projects/ad42af4f268b41b59ed4e25b5dbf310e/groups/ff26e3c7fc7a425f970f94ec2da081a1/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:11:57.228407 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f8d39-6e27-4ee5-9a83-54ec177104da None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:57.266527 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45d6a-5651-483f-bb6e-e4a08f67fbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:57.267427 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45d6a-5651-483f-bb6e-e4a08f67fbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:57.267706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45d6a-5651-483f-bb6e-e4a08f67fbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:57.268106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45d6a-5651-483f-bb6e-e4a08f67fbd0 None admin] PATH_INFO: `/v3/groups/69a5e68c68c0446bb577c4aff6555ce7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:57.269365 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f45d6a-5651-483f-bb6e-e4a08f67fbd0 None admin] RBAC: Authorizing `identity:get_group(group_id=69a5e68c68c0446bb577c4aff6555ce7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:57.270943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f45d6a-5651-483f-bb6e-e4a08f67fbd0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:57.272927 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 206/422] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 27 15:11:57 2022] GET /identity/v3/groups/69a5e68c68c0446bb577c4aff6555ce7 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:57.279201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188b93d-b222-4411-9bc0-e2e8ec5afc92 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:57.461570 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:57.472058 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188b93d-b222-4411-9bc0-e2e8ec5afc92 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:57.518738 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36812db8-bd75-4ec9-8cd5-4888368199dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:57.519339 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812db8-bd75-4ec9-8cd5-4888368199dd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:57.519637 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812db8-bd75-4ec9-8cd5-4888368199dd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:57.519922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812db8-bd75-4ec9-8cd5-4888368199dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:57.520773 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36812db8-bd75-4ec9-8cd5-4888368199dd None admin] RBAC: Adding query filter params (group.id=69a5e68c68c0446bb577c4aff6555ce7, role.id=bb946622ce1842cba751c5f862237f14, scope.project.id=0b20137a36384531941036a989526bd2) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:57.521088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36812db8-bd75-4ec9-8cd5-4888368199dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:57.522583 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36812db8-bd75-4ec9-8cd5-4888368199dd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:57.535719 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 217/423] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 27 15:11:57 2022] GET /identity/v3/role_assignments?group.id=69a5e68c68c0446bb577c4aff6555ce7&scope.project.id=0b20137a36384531941036a989526bd2&role.id=bb946622ce1842cba751c5f862237f14 => generated 611 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:57.600989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca06c7-736e-491c-a454-dd4ffbd5d05f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:57.601660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca06c7-736e-491c-a454-dd4ffbd5d05f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:57.602302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca06c7-736e-491c-a454-dd4ffbd5d05f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:57.604697 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 207/424] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:57.607562 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ea6b8-dfb4-48a2-825f-9ef269cfbe06 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:57.607856 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ea6b8-dfb4-48a2-825f-9ef269cfbe06 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:57.608242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ea6b8-dfb4-48a2-825f-9ef269cfbe06 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:57.609899 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 218/425] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:57.611678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab97ea-4331-4dad-902c-24c656f7ee02 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:57.612183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab97ea-4331-4dad-902c-24c656f7ee02 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:57.612669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab97ea-4331-4dad-902c-24c656f7ee02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:57.615594 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afb26f-05dd-4b3d-91d9-5dc5458a0a73 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:57.616086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afb26f-05dd-4b3d-91d9-5dc5458a0a73 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:57.616261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afb26f-05dd-4b3d-91d9-5dc5458a0a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:57.632396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9bab97ea-4331-4dad-902c-24c656f7ee02 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:57.634060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9bab97ea-4331-4dad-902c-24c656f7ee02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:57.644197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c0afb26f-05dd-4b3d-91d9-5dc5458a0a73 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:57.644197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c0afb26f-05dd-4b3d-91d9-5dc5458a0a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:57.738799 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:57.759194 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 219/426] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:11:57.785673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afb26f-05dd-4b3d-91d9-5dc5458a0a73 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:57.797440 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 208/427] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:57.835828 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab97ea-4331-4dad-902c-24c656f7ee02 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:57.886302 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:57.905785 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afb26f-05dd-4b3d-91d9-5dc5458a0a73 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:57.958487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08d89f-3379-45b6-9105-06ff05b87cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:57.959427 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08d89f-3379-45b6-9105-06ff05b87cef None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:57.959705 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08d89f-3379-45b6-9105-06ff05b87cef None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:57.959979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08d89f-3379-45b6-9105-06ff05b87cef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:57.974341 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08d89f-3379-45b6-9105-06ff05b87cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:57.982716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6c08d89f-3379-45b6-9105-06ff05b87cef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:57.982716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:57.982716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:57.982716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:57.982716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:57.982716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:57.982716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:57.982716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:57.982716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:57.982716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:57.982716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:57.982716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:57.982716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:57.982716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:57.982716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:57.982716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:57.983670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:57.983670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:57.983670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:57.983670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:57.983670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:57.983670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:57.983670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:57.983670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:57.983670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:57.983670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:57.983670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:57.983670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:57.983670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:57.983670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:57.983670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:57.983670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:57.984454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:57.984454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:57.984454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:57.984454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:57.984454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:57.984454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:57.984454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:57.984454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:57.984454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:57.984454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:57.984454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 15:11:57.984454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:11:57.984454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 220/428] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:11:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:11:57.991562 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08d89f-3379-45b6-9105-06ff05b87cef None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:57.994968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab97ea-4331-4dad-902c-24c656f7ee02 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:58.046512 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bd5ae-d0c2-4b14-b59d-0c5c3fb6ba0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:58.047279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd5ae-d0c2-4b14-b59d-0c5c3fb6ba0d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:58.047560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd5ae-d0c2-4b14-b59d-0c5c3fb6ba0d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:58.047830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd5ae-d0c2-4b14-b59d-0c5c3fb6ba0d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:58.062277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bd5ae-d0c2-4b14-b59d-0c5c3fb6ba0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:58.071602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b62bd5ae-d0c2-4b14-b59d-0c5c3fb6ba0d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:58.071602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:58.071602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:58.071602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:58.071602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:58.071602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:58.071602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:58.071602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:58.071602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:58.071602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:58.071602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:58.071602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:58.071602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:58.071602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:58.071602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:58.071602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:58.072773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:58.072773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:58.072773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:58.072773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:58.072773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:58.072773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:58.072773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:58.072773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:58.072773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:58.072773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:58.072773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:58.072773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:58.072773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:58.072773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:58.072773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:58.072773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:58.073723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:58.073723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:58.073723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:58.073723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:58.073723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:58.073723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:58.073723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:58.073723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:58.073723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:58.073723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:58.073723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:58.073723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:58.074707 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 209/429] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:11:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:58.080276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bd5ae-d0c2-4b14-b59d-0c5c3fb6ba0d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:58.123080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08d89f-3379-45b6-9105-06ff05b87cef None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:58.144693 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:58.172590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389c208-07ab-41ba-b098-f1db172c915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:58.173312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389c208-07ab-41ba-b098-f1db172c915e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:58.173603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389c208-07ab-41ba-b098-f1db172c915e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:58.173889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389c208-07ab-41ba-b098-f1db172c915e None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:58.175149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389c208-07ab-41ba-b098-f1db172c915e None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:58.175465 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389c208-07ab-41ba-b098-f1db172c915e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:58.177178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389c208-07ab-41ba-b098-f1db172c915e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:58.193131 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 221/430] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:11:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:58.199317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389c208-07ab-41ba-b098-f1db172c915e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:58.218183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:58.240489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bd5ae-d0c2-4b14-b59d-0c5c3fb6ba0d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:58.281560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8fad7-082f-4108-938f-70c45faa786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:58.282934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8fad7-082f-4108-938f-70c45faa786d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:58.283226 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8fad7-082f-4108-938f-70c45faa786d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:58.283784 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8fad7-082f-4108-938f-70c45faa786d None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:58.285220 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8fad7-082f-4108-938f-70c45faa786d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:58.285542 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8fad7-082f-4108-938f-70c45faa786d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:58.287599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8fad7-082f-4108-938f-70c45faa786d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:58.306104 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 210/431] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:11:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:11:58.312383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8fad7-082f-4108-938f-70c45faa786d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:58.344978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389c208-07ab-41ba-b098-f1db172c915e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:58.388670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b75d-ac83-4b7e-bc3e-57ccc92d28c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:58.389593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b75d-ac83-4b7e-bc3e-57ccc92d28c1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:58.389885 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b75d-ac83-4b7e-bc3e-57ccc92d28c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:58.390170 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b75d-ac83-4b7e-bc3e-57ccc92d28c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:58.481883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:58.488643 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8fad7-082f-4108-938f-70c45faa786d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:58.532932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6b75d-ac83-4b7e-bc3e-57ccc92d28c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:58.537358 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6b75d-ac83-4b7e-bc3e-57ccc92d28c1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:58.541870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6bb4f-d8f5-4d10-a24f-2bf571b41a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:58.541870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6bb4f-d8f5-4d10-a24f-2bf571b41a1f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:58.541870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6bb4f-d8f5-4d10-a24f-2bf571b41a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:58.541870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6bb4f-d8f5-4d10-a24f-2bf571b41a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:58.558757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:58.633909 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6bb4f-d8f5-4d10-a24f-2bf571b41a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:58.635615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6bb4f-d8f5-4d10-a24f-2bf571b41a1f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:58.676290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 222/432] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:58.686586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b75d-ac83-4b7e-bc3e-57ccc92d28c1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:58.758525 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:58.764266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 211/433] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:58.765816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d4fbe-cd9a-4435-8519-12ae012a2f16 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:58.766249 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d4fbe-cd9a-4435-8519-12ae012a2f16 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:58.766529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d4fbe-cd9a-4435-8519-12ae012a2f16 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:58.768477 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 212/434] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:58.771154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d4fbe-cd9a-4435-8519-12ae012a2f16 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:58.829858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b75d-ac83-4b7e-bc3e-57ccc92d28c1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:58.858706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:58.882350 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7e43d-8ca9-4226-94c9-545877c90116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:58.883246 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e43d-8ca9-4226-94c9-545877c90116 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:58.883528 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e43d-8ca9-4226-94c9-545877c90116 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:58.883795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e43d-8ca9-4226-94c9-545877c90116 None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:58.885196 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7e43d-8ca9-4226-94c9-545877c90116 None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:58.886710 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7e43d-8ca9-4226-94c9-545877c90116 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:58.888652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 223/435] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:58 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:58.891552 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c004e-8ceb-4e56-8691-8f5365e80529 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:58.892652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c004e-8ceb-4e56-8691-8f5365e80529 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:58.893662 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c004e-8ceb-4e56-8691-8f5365e80529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:58.915197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5f0c004e-8ceb-4e56-8691-8f5365e80529 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:58.916687 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5f0c004e-8ceb-4e56-8691-8f5365e80529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:58.922126 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d4fbe-cd9a-4435-8519-12ae012a2f16 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:58.964040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38a109-e099-4004-a268-bcc962e701c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:58.964930 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38a109-e099-4004-a268-bcc962e701c7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:58.965214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38a109-e099-4004-a268-bcc962e701c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:58.965494 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38a109-e099-4004-a268-bcc962e701c7 None admin] PATH_INFO: `/v3/projects/0b20137a36384531941036a989526bd2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:58.966813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38a109-e099-4004-a268-bcc962e701c7 None admin] RBAC: Authorizing `identity:get_project(project_id=0b20137a36384531941036a989526bd2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:58.968284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38a109-e099-4004-a268-bcc962e701c7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:58.970260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 213/436] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:11:58 2022] GET /identity/v3/projects/0b20137a36384531941036a989526bd2 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:58.970938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38a109-e099-4004-a268-bcc962e701c7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:59.005359 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 224/437] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:59.006919 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c004e-8ceb-4e56-8691-8f5365e80529 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:59.055284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:59.102731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38a109-e099-4004-a268-bcc962e701c7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:59.150154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21414462-851b-473f-b704-ac02b10a7544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:59.151108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21414462-851b-473f-b704-ac02b10a7544 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:59.151397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21414462-851b-473f-b704-ac02b10a7544 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:59.151707 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21414462-851b-473f-b704-ac02b10a7544 None admin] PATH_INFO: `/v3/groups/69a5e68c68c0446bb577c4aff6555ce7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:59.153355 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21414462-851b-473f-b704-ac02b10a7544 None admin] RBAC: Authorizing `identity:get_group(group_id=69a5e68c68c0446bb577c4aff6555ce7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:59.154648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21414462-851b-473f-b704-ac02b10a7544 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:59.161807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 214/438] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 27 15:11:58 2022] GET /identity/v3/groups/69a5e68c68c0446bb577c4aff6555ce7 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:59.161807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21414462-851b-473f-b704-ac02b10a7544 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:59.176596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c004e-8ceb-4e56-8691-8f5365e80529 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:59.185874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:59.236025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044aaf21-6f55-4def-a78f-9bd70119cf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:59.237590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aaf21-6f55-4def-a78f-9bd70119cf98 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:59.237884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aaf21-6f55-4def-a78f-9bd70119cf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:59.238274 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aaf21-6f55-4def-a78f-9bd70119cf98 None admin] PATH_INFO: `/v3/groups/69a5e68c68c0446bb577c4aff6555ce7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:59.243163 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044aaf21-6f55-4def-a78f-9bd70119cf98 None admin] RBAC: Authorizing `identity:get_group(group_id=69a5e68c68c0446bb577c4aff6555ce7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:59.244669 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044aaf21-6f55-4def-a78f-9bd70119cf98 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:59.254714 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 225/439] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 27 15:11:59 2022] GET /identity/v3/groups/69a5e68c68c0446bb577c4aff6555ce7 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:59.255696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044aaf21-6f55-4def-a78f-9bd70119cf98 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:59.298247 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21414462-851b-473f-b704-ac02b10a7544 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:59.350683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8c361-6bc0-448d-b078-f0c4b5304329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:59.351861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8c361-6bc0-448d-b078-f0c4b5304329 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:59.352145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8c361-6bc0-448d-b078-f0c4b5304329 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:59.352426 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8c361-6bc0-448d-b078-f0c4b5304329 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:59.355682 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:59.369960 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8c361-6bc0-448d-b078-f0c4b5304329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:11:59.382662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-0ae8c361-6bc0-448d-b078-f0c4b5304329 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:59.382662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:11:59.382662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:11:59.382662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:11:59.382662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:11:59.382662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:11:59.382662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:11:59.382662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:11:59.382662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:11:59.382662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:11:59.382662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:11:59.382662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:11:59.382662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:11:59.382662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:11:59.382662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:11:59.382662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:11:59.383634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:11:59.383634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:11:59.383634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:11:59.383634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:11:59.383634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:11:59.383634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:11:59.383634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:11:59.383634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:11:59.383634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:11:59.383634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:11:59.383634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:11:59.383634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:11:59.383634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:11:59.383634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:11:59.383634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:11:59.383634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:11:59.384411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:11:59.384411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:11:59.384411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:11:59.384411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:11:59.384411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:11:59.384411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:11:59.384411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:11:59.384411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:11:59.384411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:11:59.384411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:11:59.384411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:11:59.384411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:11:59.385026 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 215/440] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:11:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:11:59.386121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8c361-6bc0-448d-b078-f0c4b5304329 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:59.426665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044aaf21-6f55-4def-a78f-9bd70119cf98 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:59.486413 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eae58-7110-4dcb-ae37-101366dfc5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:59.488014 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eae58-7110-4dcb-ae37-101366dfc5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:59.489292 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eae58-7110-4dcb-ae37-101366dfc5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:59.489758 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eae58-7110-4dcb-ae37-101366dfc5e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:59.490866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0eae58-7110-4dcb-ae37-101366dfc5e4 None admin] RBAC: Adding query filter params (group.id=69a5e68c68c0446bb577c4aff6555ce7, role.id=bb946622ce1842cba751c5f862237f14, scope.project.id=2ef691ae767340c29a30ccdea323f352) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:59.491315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0eae58-7110-4dcb-ae37-101366dfc5e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:59.493009 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0eae58-7110-4dcb-ae37-101366dfc5e4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:59.518280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 226/441] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 27 15:11:59 2022] GET /identity/v3/role_assignments?group.id=69a5e68c68c0446bb577c4aff6555ce7&scope.project.id=2ef691ae767340c29a30ccdea323f352&role.id=bb946622ce1842cba751c5f862237f14 => generated 611 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:59.518280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eae58-7110-4dcb-ae37-101366dfc5e4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:59.580428 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8c361-6bc0-448d-b078-f0c4b5304329 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:59.582004 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:59.666361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eae58-7110-4dcb-ae37-101366dfc5e4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:59.704673 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a051f-1de6-4b38-95ab-8f69c5c8bf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:59.706448 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a051f-1de6-4b38-95ab-8f69c5c8bf60 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:59.706885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a051f-1de6-4b38-95ab-8f69c5c8bf60 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:59.707383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a051f-1de6-4b38-95ab-8f69c5c8bf60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:59.709841 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a051f-1de6-4b38-95ab-8f69c5c8bf60 None admin] RBAC: Adding query filter params (group.id=69a5e68c68c0446bb577c4aff6555ce7, role.id=0763e374972f4ce29ab449e27fd89355, scope.project.id=0b20137a36384531941036a989526bd2) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:59.710641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a051f-1de6-4b38-95ab-8f69c5c8bf60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:59.712921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8454234-bf80-4275-890f-b3f17e937a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:59.713413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a051f-1de6-4b38-95ab-8f69c5c8bf60 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:59.714699 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8454234-bf80-4275-890f-b3f17e937a28 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:59.715192 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8454234-bf80-4275-890f-b3f17e937a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:59.715690 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8454234-bf80-4275-890f-b3f17e937a28 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:59.717106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8454234-bf80-4275-890f-b3f17e937a28 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:11:59.717636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8454234-bf80-4275-890f-b3f17e937a28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:59.720065 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8454234-bf80-4275-890f-b3f17e937a28 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:59.724225 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 216/442] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 27 15:11:59 2022] GET /identity/v3/role_assignments?group.id=69a5e68c68c0446bb577c4aff6555ce7&scope.project.id=0b20137a36384531941036a989526bd2&role.id=0763e374972f4ce29ab449e27fd89355 => generated 611 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:59.734478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa747783-c38a-4784-bc42-d70fc409c6ff None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:59.734478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa747783-c38a-4784-bc42-d70fc409c6ff None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:59.734478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa747783-c38a-4784-bc42-d70fc409c6ff None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:59.734478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 217/443] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:11:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:11:59.735894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cda6f-f01b-419d-a196-819b299eb1df None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:59.736358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cda6f-f01b-419d-a196-819b299eb1df None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:59.737090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cda6f-f01b-419d-a196-819b299eb1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:59.753993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 227/444] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:11:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:11:59.771696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8454234-bf80-4275-890f-b3f17e937a28 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:59.776302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2b5cda6f-f01b-419d-a196-819b299eb1df None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:59.778750 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2b5cda6f-f01b-419d-a196-819b299eb1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:59.861181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:59.888201 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 218/445] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:11:59.915868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cda6f-f01b-419d-a196-819b299eb1df None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:59.937880 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:59.941943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8454234-bf80-4275-890f-b3f17e937a28 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:00.000528 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8b6c7-caef-4615-a5a4-4d1b25a16906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:00.001587 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8b6c7-caef-4615-a5a4-4d1b25a16906 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:00.002061 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8b6c7-caef-4615-a5a4-4d1b25a16906 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:00.003623 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8b6c7-caef-4615-a5a4-4d1b25a16906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:00.050341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cda6f-f01b-419d-a196-819b299eb1df None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:00.102179 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8b6c7-caef-4615-a5a4-4d1b25a16906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:00.103254 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c70bdf-7e6e-425a-8a6c-7dd5f67bbee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:00.103767 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8b6c7-caef-4615-a5a4-4d1b25a16906 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:00.104067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c70bdf-7e6e-425a-8a6c-7dd5f67bbee0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:00.104348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c70bdf-7e6e-425a-8a6c-7dd5f67bbee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:00.104620 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c70bdf-7e6e-425a-8a6c-7dd5f67bbee0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:00.120372 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c70bdf-7e6e-425a-8a6c-7dd5f67bbee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:00.129369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-57c70bdf-7e6e-425a-8a6c-7dd5f67bbee0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:12:00.129369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:00.129369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:00.129369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:00.129369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:00.129369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:00.129369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:00.129369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:00.129369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:00.129369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:00.129369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:00.129369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:00.129369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:00.129369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:00.129369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:00.129369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:00.130622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:00.130622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:00.130622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:00.130622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:00.130622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:00.130622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:00.130622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:00.130622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:00.130622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:00.130622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:00.130622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:00.130622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:00.130622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:00.130622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:00.130622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:00.130622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:00.131615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:00.131615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:00.131615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:00.131615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:00.131615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:00.131615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:00.131615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:00.131615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:00.131615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:00.131615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:00.131615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:12:00.131615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:00.131615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 219/446] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:11:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:12:00.139059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c70bdf-7e6e-425a-8a6c-7dd5f67bbee0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:00.201102 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:00.230155 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:00.234723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 228/447] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:12:00.240442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8b6c7-caef-4615-a5a4-4d1b25a16906 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:00.266872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c70bdf-7e6e-425a-8a6c-7dd5f67bbee0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:00.312421 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5fbca-e918-4ba8-8e7b-899b728f4721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:00.313130 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5fbca-e918-4ba8-8e7b-899b728f4721 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:00.313411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5fbca-e918-4ba8-8e7b-899b728f4721 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:00.313685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5fbca-e918-4ba8-8e7b-899b728f4721 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:00.314520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5fbca-e918-4ba8-8e7b-899b728f4721 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:00.314882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5fbca-e918-4ba8-8e7b-899b728f4721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:00.316354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5fbca-e918-4ba8-8e7b-899b728f4721 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:00.328260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 220/448] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:12:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:00.334288 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5fbca-e918-4ba8-8e7b-899b728f4721 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:00.364134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8b6c7-caef-4615-a5a4-4d1b25a16906 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:00.399255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fdd0a-2e6a-4801-af0b-a9e76cf4b0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:00.400149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fdd0a-2e6a-4801-af0b-a9e76cf4b0ca None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:00.400424 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fdd0a-2e6a-4801-af0b-a9e76cf4b0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:00.400699 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fdd0a-2e6a-4801-af0b-a9e76cf4b0ca None admin] PATH_INFO: `/v3/projects/2ef691ae767340c29a30ccdea323f352` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:00.401900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fdd0a-2e6a-4801-af0b-a9e76cf4b0ca None admin] RBAC: Authorizing `identity:get_project(project_id=2ef691ae767340c29a30ccdea323f352)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:00.403402 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fdd0a-2e6a-4801-af0b-a9e76cf4b0ca None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:00.405286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 229/449] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:12:00 2022] GET /identity/v3/projects/2ef691ae767340c29a30ccdea323f352 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:00.411145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fdd0a-2e6a-4801-af0b-a9e76cf4b0ca None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:00.439975 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5fbca-e918-4ba8-8e7b-899b728f4721 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:00.450859 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:00.476148 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0b28b-b03c-4286-9ff3-99280da981c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:00.476725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0b28b-b03c-4286-9ff3-99280da981c7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:00.477016 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0b28b-b03c-4286-9ff3-99280da981c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:00.477297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0b28b-b03c-4286-9ff3-99280da981c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:00.481110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:00.515272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fdd0a-2e6a-4801-af0b-a9e76cf4b0ca None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:00.550560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0b28b-b03c-4286-9ff3-99280da981c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:00.552043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0b28b-b03c-4286-9ff3-99280da981c7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:00.552319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c2ebe-f489-4f86-95b2-537cfcbf262d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:00.553198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c2ebe-f489-4f86-95b2-537cfcbf262d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:00.553479 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c2ebe-f489-4f86-95b2-537cfcbf262d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:00.553752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c2ebe-f489-4f86-95b2-537cfcbf262d None admin] PATH_INFO: `/v3/groups/69a5e68c68c0446bb577c4aff6555ce7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:00.554973 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c2ebe-f489-4f86-95b2-537cfcbf262d None admin] RBAC: Authorizing `identity:get_group(group_id=69a5e68c68c0446bb577c4aff6555ce7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:00.556779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c2ebe-f489-4f86-95b2-537cfcbf262d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:00.558459 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 230/450] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 27 15:12:00 2022] GET /identity/v3/groups/69a5e68c68c0446bb577c4aff6555ce7 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:00.564255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c2ebe-f489-4f86-95b2-537cfcbf262d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:00.653834 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 221/451] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:12:00.659679 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0b28b-b03c-4286-9ff3-99280da981c7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:00.671434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:00.672331 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c2ebe-f489-4f86-95b2-537cfcbf262d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:00.709710 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d5b45-e111-443c-91bf-ba4471a7dc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:00.710446 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d5b45-e111-443c-91bf-ba4471a7dc11 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:00.710713 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d5b45-e111-443c-91bf-ba4471a7dc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:00.710989 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d5b45-e111-443c-91bf-ba4471a7dc11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:00.711843 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d5b45-e111-443c-91bf-ba4471a7dc11 None admin] RBAC: Adding query filter params (group.id=69a5e68c68c0446bb577c4aff6555ce7, role.id=0763e374972f4ce29ab449e27fd89355, scope.project.id=2ef691ae767340c29a30ccdea323f352) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:00.712158 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d5b45-e111-443c-91bf-ba4471a7dc11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:00.713618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d5b45-e111-443c-91bf-ba4471a7dc11 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:00.717248 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:00.721391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 231/452] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 27 15:12:00 2022] GET /identity/v3/role_assignments?group.id=69a5e68c68c0446bb577c4aff6555ce7&scope.project.id=2ef691ae767340c29a30ccdea323f352&role.id=0763e374972f4ce29ab449e27fd89355 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:00.771602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0b28b-b03c-4286-9ff3-99280da981c7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:00.817019 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e9c51-77c9-4a77-a3c3-dc9354553b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:00.817909 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e9c51-77c9-4a77-a3c3-dc9354553b03 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:00.818184 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e9c51-77c9-4a77-a3c3-dc9354553b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:00.818485 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e9c51-77c9-4a77-a3c3-dc9354553b03 None admin] PATH_INFO: `/v3/projects/ad42af4f268b41b59ed4e25b5dbf310e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:00.819953 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e9c51-77c9-4a77-a3c3-dc9354553b03 None admin] RBAC: Authorizing `identity:get_project(project_id=ad42af4f268b41b59ed4e25b5dbf310e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:00.821461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e9c51-77c9-4a77-a3c3-dc9354553b03 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:00.823588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 222/453] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:12:00 2022] GET /identity/v3/projects/ad42af4f268b41b59ed4e25b5dbf310e => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:00.829356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d5b45-e111-443c-91bf-ba4471a7dc11 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:00.961006 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d5b45-e111-443c-91bf-ba4471a7dc11 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:01.004951 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5992b07-229c-412b-a53a-04c4a705ecf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:01.005932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5992b07-229c-412b-a53a-04c4a705ecf1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:01.006329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5992b07-229c-412b-a53a-04c4a705ecf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:01.006675 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5992b07-229c-412b-a53a-04c4a705ecf1 None admin] PATH_INFO: `/v3/groups/ff26e3c7fc7a425f970f94ec2da081a1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:01.008027 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5992b07-229c-412b-a53a-04c4a705ecf1 None admin] RBAC: Authorizing `identity:get_group(group_id=ff26e3c7fc7a425f970f94ec2da081a1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:01.010524 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5992b07-229c-412b-a53a-04c4a705ecf1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:01.013053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 232/454] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 27 15:12:00 2022] GET /identity/v3/groups/ff26e3c7fc7a425f970f94ec2da081a1 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:01.022087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e9c51-77c9-4a77-a3c3-dc9354553b03 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:01.149462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:01.180084 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e9c51-77c9-4a77-a3c3-dc9354553b03 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:01.217454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69425e55-6ad5-47ed-99e7-1402903cf5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:01.218189 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69425e55-6ad5-47ed-99e7-1402903cf5db None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:01.218561 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69425e55-6ad5-47ed-99e7-1402903cf5db None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:01.218988 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69425e55-6ad5-47ed-99e7-1402903cf5db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:01.220561 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69425e55-6ad5-47ed-99e7-1402903cf5db None admin] RBAC: Adding query filter params (group.id=ff26e3c7fc7a425f970f94ec2da081a1, role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=ad42af4f268b41b59ed4e25b5dbf310e) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:01.221125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69425e55-6ad5-47ed-99e7-1402903cf5db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:01.222828 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69425e55-6ad5-47ed-99e7-1402903cf5db None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:01.230806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 223/455] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 27 15:12:01 2022] GET /identity/v3/role_assignments?group.id=ff26e3c7fc7a425f970f94ec2da081a1&scope.project.id=ad42af4f268b41b59ed4e25b5dbf310e&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 611 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:04.434839 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a23f3b-707e-4496-be2a-c93e780a91ad None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:04.435765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a23f3b-707e-4496-be2a-c93e780a91ad None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:04.436228 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a23f3b-707e-4496-be2a-c93e780a91ad None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:04.438264 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 233/456] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:04.443990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f760bb-809f-486b-b8e6-01d689d61569 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:04.445135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f760bb-809f-486b-b8e6-01d689d61569 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:04.445595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f760bb-809f-486b-b8e6-01d689d61569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:04.471567 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a0f760bb-809f-486b-b8e6-01d689d61569 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:04.473146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a0f760bb-809f-486b-b8e6-01d689d61569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:04.568986 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 224/457] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:12:04.603779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb2d53-be37-44f9-8552-569afebf5fa9 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:04.604360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb2d53-be37-44f9-8552-569afebf5fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:04.604813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb2d53-be37-44f9-8552-569afebf5fa9 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:04.606771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 234/458] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:04.609786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f760bb-809f-486b-b8e6-01d689d61569 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:04.631013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ecffe-7a19-4552-8efd-a49e283c0f1f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:04.631641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ecffe-7a19-4552-8efd-a49e283c0f1f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:04.632098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ecffe-7a19-4552-8efd-a49e283c0f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:04.667324 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c72ecffe-7a19-4552-8efd-a49e283c0f1f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:04.670177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c72ecffe-7a19-4552-8efd-a49e283c0f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:04.730620 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:04.748113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f760bb-809f-486b-b8e6-01d689d61569 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:04.812599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decda0d-fc10-40b5-9a8c-973d962a7ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:04.813885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decda0d-fc10-40b5-9a8c-973d962a7ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:04.814343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decda0d-fc10-40b5-9a8c-973d962a7ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:04.814849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decda0d-fc10-40b5-9a8c-973d962a7ae9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:04.832637 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:04.849941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 235/459] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:12:04.860373 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6decda0d-fc10-40b5-9a8c-973d962a7ae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:04.863340 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6decda0d-fc10-40b5-9a8c-973d962a7ae9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:04.877170 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ecffe-7a19-4552-8efd-a49e283c0f1f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:04.887145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-6decda0d-fc10-40b5-9a8c-973d962a7ae9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:04.887145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:04.887145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:04.887145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:04.887145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:04.887145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:04.887145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:04.887145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:04.887145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:04.887145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:04.887145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:04.887145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:04.887145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:04.887145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:04.887145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:04.888112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:04.888959 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:04.888959 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:04.888959 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:04.888959 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:04.891344 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 225/460] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:04.908444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decda0d-fc10-40b5-9a8c-973d962a7ae9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:05.115087 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ecffe-7a19-4552-8efd-a49e283c0f1f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:05.177752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa9325-627a-4baa-9858-d8c8d3724a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:05.179180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa9325-627a-4baa-9858-d8c8d3724a80 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:05.179669 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa9325-627a-4baa-9858-d8c8d3724a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:05.180150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa9325-627a-4baa-9858-d8c8d3724a80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:05.197478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decda0d-fc10-40b5-9a8c-973d962a7ae9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:05.212572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa9325-627a-4baa-9858-d8c8d3724a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:05.216763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa9325-627a-4baa-9858-d8c8d3724a80 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:05.229104 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:05.243936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d678e60-cde9-4d2f-92b0-6272d035f0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:05.244992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d678e60-cde9-4d2f-92b0-6272d035f0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:05.245488 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d678e60-cde9-4d2f-92b0-6272d035f0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:05.246201 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d678e60-cde9-4d2f-92b0-6272d035f0d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:05.247339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d678e60-cde9-4d2f-92b0-6272d035f0d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:05.247848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d678e60-cde9-4d2f-92b0-6272d035f0d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:05.249452 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d678e60-cde9-4d2f-92b0-6272d035f0d6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:05.261432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-26aa9325-627a-4baa-9858-d8c8d3724a80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:05.261432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:05.261432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:05.261432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:05.261432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:05.261432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:05.261432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:05.261432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:05.261432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:05.261432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:05.261432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:05.261432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:05.261432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:05.261432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:05.261432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:05.262641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:05.263502 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:05.263502 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:05.263502 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:05.263502 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:05.263712 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 236/461] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:05.266146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 226/462] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:05.266373 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810aa84-2abd-4d00-b65b-4f68a4292657 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:05.266803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810aa84-2abd-4d00-b65b-4f68a4292657 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:05.267428 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810aa84-2abd-4d00-b65b-4f68a4292657 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:05.270036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d678e60-cde9-4d2f-92b0-6272d035f0d6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:05.270537 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 237/463] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:05.274972 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810aa84-2abd-4d00-b65b-4f68a4292657 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:05.382398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:05.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d678e60-cde9-4d2f-92b0-6272d035f0d6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:05.444993 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18fcc4-12a5-4d58-91c8-26dfbb7b8b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:05.447013 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18fcc4-12a5-4d58-91c8-26dfbb7b8b53 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:05.447789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18fcc4-12a5-4d58-91c8-26dfbb7b8b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:05.448454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18fcc4-12a5-4d58-91c8-26dfbb7b8b53 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:05.449938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18fcc4-12a5-4d58-91c8-26dfbb7b8b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:05.450564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18fcc4-12a5-4d58-91c8-26dfbb7b8b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:05.452191 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18fcc4-12a5-4d58-91c8-26dfbb7b8b53 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:05.455798 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810aa84-2abd-4d00-b65b-4f68a4292657 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:05.466376 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 227/464] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:05.468054 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7b5ea-0cab-480e-b225-2be799ec78bc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:05.468551 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7b5ea-0cab-480e-b225-2be799ec78bc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:05.469025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7b5ea-0cab-480e-b225-2be799ec78bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:05.487566 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7be7b5ea-0cab-480e-b225-2be799ec78bc None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:05.489120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7be7b5ea-0cab-480e-b225-2be799ec78bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:05.498528 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc34eb2-e4e4-4d08-81e8-ce089d2564c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:05.499228 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc34eb2-e4e4-4d08-81e8-ce089d2564c3 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:05.499559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc34eb2-e4e4-4d08-81e8-ce089d2564c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:05.499870 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc34eb2-e4e4-4d08-81e8-ce089d2564c3 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:05.500600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc34eb2-e4e4-4d08-81e8-ce089d2564c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:05.502623 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc34eb2-e4e4-4d08-81e8-ce089d2564c3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:05.531367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 238/465] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:12:05 2022] POST /identity/v3/users => generated 248 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:12:05.533484 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc34eb2-e4e4-4d08-81e8-ce089d2564c3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:05.539874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:05.577647 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 228/466] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:05.627368 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7b5ea-0cab-480e-b225-2be799ec78bc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:05.664645 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc34eb2-e4e4-4d08-81e8-ce089d2564c3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:05.675264 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:05.718705 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b07474-fb0a-42e2-b313-114d2d434937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:05.719448 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b07474-fb0a-42e2-b313-114d2d434937 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:05.719771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b07474-fb0a-42e2-b313-114d2d434937 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:05.720455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b07474-fb0a-42e2-b313-114d2d434937 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:05.721704 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b07474-fb0a-42e2-b313-114d2d434937 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:05.723473 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b07474-fb0a-42e2-b313-114d2d434937 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:05.750722 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 239/467] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:12:05 2022] POST /identity/v3/users => generated 246 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:12:05.751700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b685d2e-1655-4475-bce9-fec6933202ac None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:05.752080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b685d2e-1655-4475-bce9-fec6933202ac None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:05.752364 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b685d2e-1655-4475-bce9-fec6933202ac None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:05.754007 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 240/468] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:05.761779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4f1a0-7a28-4a27-bf9a-0f4c34d78bce None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:05.762091 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4f1a0-7a28-4a27-bf9a-0f4c34d78bce None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:05.762430 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4f1a0-7a28-4a27-bf9a-0f4c34d78bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:05.779387 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7b5ea-0cab-480e-b225-2be799ec78bc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:05.782571 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b9c4f1a0-7a28-4a27-bf9a-0f4c34d78bce None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:05.784137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b9c4f1a0-7a28-4a27-bf9a-0f4c34d78bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:05.826044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ced311-56ce-42c5-bca7-2524abb4f109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:05.827533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ced311-56ce-42c5-bca7-2524abb4f109 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:05.828045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ced311-56ce-42c5-bca7-2524abb4f109 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:05.828535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ced311-56ce-42c5-bca7-2524abb4f109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:05.845549 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ced311-56ce-42c5-bca7-2524abb4f109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:05.848830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ced311-56ce-42c5-bca7-2524abb4f109 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:05.869369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 241/469] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:12:05.877199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-00ced311-56ce-42c5-bca7-2524abb4f109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:05.877199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:05.877199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:05.877199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:05.877199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:05.877199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:05.877199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:05.877199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:05.877199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:05.877199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:05.877199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:05.877199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:05.877199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:05.877199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:05.877199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:05.878194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:05.879078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:05.879078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:05.879078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:05.879078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:05.881645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 229/470] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:05.887338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4f1a0-7a28-4a27-bf9a-0f4c34d78bce None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:05.904761 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ced311-56ce-42c5-bca7-2524abb4f109 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:05.949519 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:06.012811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:06.029893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4f1a0-7a28-4a27-bf9a-0f4c34d78bce None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:06.063858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ced311-56ce-42c5-bca7-2524abb4f109 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:06.088580 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459fa17-7bdd-46e7-a5bd-702fe9a49a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:06.089277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459fa17-7bdd-46e7-a5bd-702fe9a49a8d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:06.089559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459fa17-7bdd-46e7-a5bd-702fe9a49a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:06.089837 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459fa17-7bdd-46e7-a5bd-702fe9a49a8d None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:06.090608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459fa17-7bdd-46e7-a5bd-702fe9a49a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:06.090919 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459fa17-7bdd-46e7-a5bd-702fe9a49a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:06.092344 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459fa17-7bdd-46e7-a5bd-702fe9a49a8d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:06.106667 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 242/471] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:06.108370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e84463-9d53-4a43-b700-6fe01142bab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:06.109187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e84463-9d53-4a43-b700-6fe01142bab4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:06.109507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e84463-9d53-4a43-b700-6fe01142bab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:06.109788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e84463-9d53-4a43-b700-6fe01142bab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:06.111864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459fa17-7bdd-46e7-a5bd-702fe9a49a8d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:06.133096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e84463-9d53-4a43-b700-6fe01142bab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:06.134681 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e84463-9d53-4a43-b700-6fe01142bab4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:06.158872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d5e84463-9d53-4a43-b700-6fe01142bab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:06.158872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:06.158872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:06.158872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:06.158872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:06.158872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:06.158872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:06.158872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:06.158872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:06.158872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:06.158872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:06.158872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:06.158872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:06.158872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:06.158872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:06.159801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:06.160638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:06.160638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:06.160638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:06.160638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:06.160845 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 230/472] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:06.170906 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e84463-9d53-4a43-b700-6fe01142bab4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:06.309654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459fa17-7bdd-46e7-a5bd-702fe9a49a8d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:06.330715 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:06.372242 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e84463-9d53-4a43-b700-6fe01142bab4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:06.376014 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb20df3-8262-4b9c-a38c-8bbc98fc3590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:06.376789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb20df3-8262-4b9c-a38c-8bbc98fc3590 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:06.377369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb20df3-8262-4b9c-a38c-8bbc98fc3590 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:06.377768 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb20df3-8262-4b9c-a38c-8bbc98fc3590 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:06.379115 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb20df3-8262-4b9c-a38c-8bbc98fc3590 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:06.381827 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb20df3-8262-4b9c-a38c-8bbc98fc3590 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:06.424511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 243/473] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:12:06 2022] POST /identity/v3/users => generated 248 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:12:06.427995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527ecf4-9adc-413b-8fcd-a4eaa8202fce None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:06.428659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527ecf4-9adc-413b-8fcd-a4eaa8202fce None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:06.429832 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527ecf4-9adc-413b-8fcd-a4eaa8202fce None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:06.433806 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 244/474] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:06.439555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcfb4f-e32d-4d28-8196-744babb61974 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:06.440187 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcfb4f-e32d-4d28-8196-744babb61974 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:06.440699 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcfb4f-e32d-4d28-8196-744babb61974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:06.460803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec822fb8-7928-4ece-a190-694e6fee1109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:06.461679 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec822fb8-7928-4ece-a190-694e6fee1109 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:06.462037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec822fb8-7928-4ece-a190-694e6fee1109 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:06.462453 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec822fb8-7928-4ece-a190-694e6fee1109 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:06.463311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec822fb8-7928-4ece-a190-694e6fee1109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:06.463726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec822fb8-7928-4ece-a190-694e6fee1109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:06.465265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec822fb8-7928-4ece-a190-694e6fee1109 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:06.469020 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e4bcfb4f-e32d-4d28-8196-744babb61974 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:06.471208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e4bcfb4f-e32d-4d28-8196-744babb61974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:06.474324 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:06.499229 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 231/475] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:06.507749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec822fb8-7928-4ece-a190-694e6fee1109 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:06.674846 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 245/476] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:12:06.700027 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcfb4f-e32d-4d28-8196-744babb61974 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:06.719864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec822fb8-7928-4ece-a190-694e6fee1109 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:06.759313 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a18468-6954-4813-8b55-7d285d2edceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:06.760321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a18468-6954-4813-8b55-7d285d2edceb None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:06.760787 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a18468-6954-4813-8b55-7d285d2edceb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:06.761270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a18468-6954-4813-8b55-7d285d2edceb None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:06.762190 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a18468-6954-4813-8b55-7d285d2edceb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:06.763888 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a18468-6954-4813-8b55-7d285d2edceb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:06.773579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:06.791724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 232/477] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:12:06 2022] POST /identity/v3/users => generated 249 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:12:06.834200 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcfb4f-e32d-4d28-8196-744babb61974 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:06.877946 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6f5d9-3737-4b62-b98b-b52e5facb0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:06.879008 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6f5d9-3737-4b62-b98b-b52e5facb0c9 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:06.879470 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6f5d9-3737-4b62-b98b-b52e5facb0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:06.879973 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6f5d9-3737-4b62-b98b-b52e5facb0c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:06.880957 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6f5d9-3737-4b62-b98b-b52e5facb0c9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:06.882586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6f5d9-3737-4b62-b98b-b52e5facb0c9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:06.893399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.sql.core [None req-6ff6f5d9-3737-4b62-b98b-b52e5facb0c9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 27 15:12:06.893399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 27 15:12:06.893399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [parameters: {'id': 'ce5d16191794408eafa655d4c81412fa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 27 15:12:06.893399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80192) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 27 15:12:06.912259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6ff6f5d9-3737-4b62-b98b-b52e5facb0c9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 27 15:12:06.912259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:06.912259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 15:12:06.912259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 15:12:06.912259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 15:12:06.912259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 15:12:06.912259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 15:12:06.912259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 15:12:06.912259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 15:12:06.912259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application conn.query(q) Jun 27 15:12:06.912259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 15:12:06.912259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 15:12:06.912259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 15:12:06.912259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application result.read() Jun 27 15:12:06.912259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return ref.to_dict() Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 15:12:06.913368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application next(self.gen) Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application yield resource Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application next(self.gen) Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.session.rollback() Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.force_reraise() Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise self.value Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application session.commit() Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 27 15:12:06.914573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._prepare_impl() Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.session.flush() Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._flush(objects) Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application compat.raise_( Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application flush_context.execute() Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rec.execute(self) Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 27 15:12:06.915565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 27 15:12:06.916565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 27 15:12:06.916565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 27 15:12:06.916565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 27 15:12:06.916565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 27 15:12:06.916565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 27 15:12:06.916565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 27 15:12:06.916565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 27 15:12:06.916565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 27 15:12:06.916565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 27 15:12:06.916565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 27 15:12:06.916565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 27 15:12:06.916565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 27 15:12:06.916565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 27 15:12:06.916565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 27 15:12:06.916565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 15:12:06.916565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception Jun 27 15:12:06.917366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 15:12:06.917366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 15:12:06.917366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 15:12:06.917366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 15:12:06.917366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 15:12:06.917366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 15:12:06.917366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 15:12:06.917366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application conn.query(q) Jun 27 15:12:06.917366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 15:12:06.917366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 15:12:06.917366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 15:12:06.917366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application result.read() Jun 27 15:12:06.917366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 15:12:06.917366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 15:12:06.917366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 15:12:06.917366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 15:12:06.918149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 15:12:06.918149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 15:12:06.918149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 15:12:06.918149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 15:12:06.918149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 27 15:12:06.918149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 27 15:12:06.918149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [parameters: {'id': 'ce5d16191794408eafa655d4c81412fa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 27 15:12:06.918149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 27 15:12:06.918149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:06.918149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:12:06.918149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:06.918149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:06.918149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:06.918149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:06.918149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:06.918149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:06.919081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:06.919081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:06.919081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:06.919081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:06.919081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:06.919081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:06.919081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 27 15:12:06.919081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 27 15:12:06.919081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:06.919081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:06.919081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 27 15:12:06.919081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 27 15:12:06.919081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 27 15:12:06.919081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 27 15:12:06.919081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 27 15:12:06.919081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:06.921905 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 246/478] 10.222.0.33 () {60 vars in 1131 bytes} [Mon Jun 27 15:12:06 2022] POST /identity/v3/roles => generated 144 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:06.932589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a18468-6954-4813-8b55-7d285d2edceb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:07.124344 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a18468-6954-4813-8b55-7d285d2edceb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:07.187341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6f513-4e89-4c54-b06c-0d9852da248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:07.188697 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6f513-4e89-4c54-b06c-0d9852da248c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:07.189175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6f513-4e89-4c54-b06c-0d9852da248c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:07.189728 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6f513-4e89-4c54-b06c-0d9852da248c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:07.209748 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6f513-4e89-4c54-b06c-0d9852da248c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:07.225866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b7a6f513-4e89-4c54-b06c-0d9852da248c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:12:07.225866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:07.225866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:07.225866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:07.225866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:07.225866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:07.225866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:07.225866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:07.225866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:07.225866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:07.225866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:07.225866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:07.225866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:07.225866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:07.225866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:07.225866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:07.226849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:07.226849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:07.226849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:07.226849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:07.226849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:07.226849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:07.226849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:07.226849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:07.226849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:07.226849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:07.226849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:07.226849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:07.226849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:07.226849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:07.226849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:07.226849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:07.227654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:07.227654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:07.227654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:07.227654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:07.227654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:07.227654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:07.227654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:07.227654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:07.227654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:07.227654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:07.227654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 15:12:07.227654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:07.228762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 233/479] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:12:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:07.237644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6f5d9-3737-4b62-b98b-b52e5facb0c9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:07.242562 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:07.405263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6f5d9-3737-4b62-b98b-b52e5facb0c9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:07.472382 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2af37-4571-47e7-85b0-8aa49307fe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:07.473353 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2af37-4571-47e7-85b0-8aa49307fe23 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:07.473856 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2af37-4571-47e7-85b0-8aa49307fe23 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:07.474371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2af37-4571-47e7-85b0-8aa49307fe23 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:07.475709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2af37-4571-47e7-85b0-8aa49307fe23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:07.476255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2af37-4571-47e7-85b0-8aa49307fe23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:07.478833 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2af37-4571-47e7-85b0-8aa49307fe23 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:07.497772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 247/480] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:08.241753 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa2e0c-2d55-407a-b6ff-c07f57fe3e3f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:08.242335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa2e0c-2d55-407a-b6ff-c07f57fe3e3f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:08.242335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa2e0c-2d55-407a-b6ff-c07f57fe3e3f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:08.243996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 234/481] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:08.250467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeff8ce-e760-40a7-8c62-30afa6617882 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:08.251064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeff8ce-e760-40a7-8c62-30afa6617882 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:08.251541 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeff8ce-e760-40a7-8c62-30afa6617882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:08.274049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0aeff8ce-e760-40a7-8c62-30afa6617882 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:08.275614 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0aeff8ce-e760-40a7-8c62-30afa6617882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:08.336651 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a996e-3fac-48d6-87ba-548ea2c173a1 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:08.336965 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a996e-3fac-48d6-87ba-548ea2c173a1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:08.337210 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a996e-3fac-48d6-87ba-548ea2c173a1 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:08.338891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 235/482] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:08.345348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088bdf5-ee77-4836-a114-c060f995baba None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:08.346088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088bdf5-ee77-4836-a114-c060f995baba None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:08.346821 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088bdf5-ee77-4836-a114-c060f995baba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:08.360252 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:08.367866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 248/483] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:08.372670 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6088bdf5-ee77-4836-a114-c060f995baba None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:08.373877 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6088bdf5-ee77-4836-a114-c060f995baba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:08.415810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeff8ce-e760-40a7-8c62-30afa6617882 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:08.427634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:08.446358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 236/484] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:12:08.482180 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088bdf5-ee77-4836-a114-c060f995baba None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:08.599503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088bdf5-ee77-4836-a114-c060f995baba None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:08.638947 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e521f00-8864-4e14-ae4b-812770d94297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:08.640327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e521f00-8864-4e14-ae4b-812770d94297 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:08.640707 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e521f00-8864-4e14-ae4b-812770d94297 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:08.641078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e521f00-8864-4e14-ae4b-812770d94297 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:08.654151 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e521f00-8864-4e14-ae4b-812770d94297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:08.657255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeff8ce-e760-40a7-8c62-30afa6617882 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:08.664136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-1e521f00-8864-4e14-ae4b-812770d94297 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:08.664136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:08.664136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:08.664136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:08.664136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:08.664136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:08.664136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:08.664136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:08.664136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:08.664136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:08.664136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:08.664136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:08.664136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:08.664136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:08.664136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:08.664136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:08.665150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:08.665150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:08.665150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:08.665150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:08.665150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:08.665150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:08.665150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:08.665150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:08.665150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:08.665150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:08.665150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:08.665150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:08.665150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:08.665150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:08.665150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:08.665150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:08.665997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:08.665997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:08.665997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:08.665997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:08.665997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:08.665997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:08.665997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:08.665997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:08.665997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:08.665997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:08.665997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:08.665997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:08.665997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 237/485] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:08.675867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e521f00-8864-4e14-ae4b-812770d94297 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:08.710287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7ce25-c4ea-4a4e-9242-0d097efcd64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:08.711500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7ce25-c4ea-4a4e-9242-0d097efcd64d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:08.711991 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7ce25-c4ea-4a4e-9242-0d097efcd64d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:08.712466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7ce25-c4ea-4a4e-9242-0d097efcd64d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:08.733391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7ce25-c4ea-4a4e-9242-0d097efcd64d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:08.741862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2fc7ce25-c4ea-4a4e-9242-0d097efcd64d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:08.741862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:08.741862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:08.741862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:08.741862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:08.741862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:08.741862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:08.741862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:08.741862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:08.741862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:08.741862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:08.741862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:08.741862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:08.741862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:08.741862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:08.741862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:08.742800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:08.742800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:08.742800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:08.742800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:08.742800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:08.742800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:08.742800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:08.742800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:08.742800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:08.742800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:08.742800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:08.742800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:08.742800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:08.742800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:08.742800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:08.742800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:08.743602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:08.743602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:08.743602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:08.743602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:08.743602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:08.743602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:08.743602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:08.743602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:08.743602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:08.743602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:08.743602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:08.743602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:08.754904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 249/486] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:12:08.761206 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7ce25-c4ea-4a4e-9242-0d097efcd64d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:08.784903 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:08.831553 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:08.897846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e521f00-8864-4e14-ae4b-812770d94297 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:08.917260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7ce25-c4ea-4a4e-9242-0d097efcd64d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:08.951307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa22988-eadb-4209-8029-8a36e5ee4012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:08.951999 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa22988-eadb-4209-8029-8a36e5ee4012 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:08.952284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa22988-eadb-4209-8029-8a36e5ee4012 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:08.952562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa22988-eadb-4209-8029-8a36e5ee4012 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:08.953771 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa22988-eadb-4209-8029-8a36e5ee4012 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:08.954086 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa22988-eadb-4209-8029-8a36e5ee4012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:08.955961 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa22988-eadb-4209-8029-8a36e5ee4012 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:08.967200 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082052b-0ba8-4b06-8263-88dcc2391302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:08.967833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 238/487] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:08.967941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082052b-0ba8-4b06-8263-88dcc2391302 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:08.968145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082052b-0ba8-4b06-8263-88dcc2391302 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:08.968420 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082052b-0ba8-4b06-8263-88dcc2391302 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:08.969179 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082052b-0ba8-4b06-8263-88dcc2391302 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:08.969488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082052b-0ba8-4b06-8263-88dcc2391302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:08.971541 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082052b-0ba8-4b06-8263-88dcc2391302 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:08.973766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa22988-eadb-4209-8029-8a36e5ee4012 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:08.980516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 250/488] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:08.985928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082052b-0ba8-4b06-8263-88dcc2391302 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:09.094296 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082052b-0ba8-4b06-8263-88dcc2391302 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:09.101354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa22988-eadb-4209-8029-8a36e5ee4012 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:09.111328 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:09.117037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:09.138547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc7e50-caa1-479b-9971-424b0564c461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:09.139367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc7e50-caa1-479b-9971-424b0564c461 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:09.139647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc7e50-caa1-479b-9971-424b0564c461 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:09.139919 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc7e50-caa1-479b-9971-424b0564c461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:09.152191 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc7e50-caa1-479b-9971-424b0564c461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:09.153668 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc7e50-caa1-479b-9971-424b0564c461 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:09.154320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d85e-21f0-47db-be59-64a75932c658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:09.155219 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d85e-21f0-47db-be59-64a75932c658 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:09.155712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d85e-21f0-47db-be59-64a75932c658 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:09.155999 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d85e-21f0-47db-be59-64a75932c658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:09.169606 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2d85e-21f0-47db-be59-64a75932c658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:09.171026 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2d85e-21f0-47db-be59-64a75932c658 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:09.172052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-45cc7e50-caa1-479b-9971-424b0564c461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:09.172052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:09.172052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:09.172052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:09.172052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:09.172052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:09.172052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:09.172052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:09.172052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:09.172052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:09.172052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:09.172052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:09.172052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:09.172052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:09.172052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:09.174412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:09.176730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:09.176730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:09.176730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:09.176730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:09.176730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 251/489] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:09.182263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc7e50-caa1-479b-9971-424b0564c461 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:09.203207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b7d2d85e-21f0-47db-be59-64a75932c658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:09.203207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:09.203207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:09.203207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:09.203207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:09.203207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:09.203207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:09.203207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:09.203207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:09.203207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:09.203207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:09.203207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:09.203207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:09.203207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:09.203207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:09.205533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:09.207646 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:09.207646 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:09.207646 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:09.207646 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:09.207646 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 239/490] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:09.211965 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d85e-21f0-47db-be59-64a75932c658 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:09.325164 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc7e50-caa1-479b-9971-424b0564c461 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:09.354985 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d85e-21f0-47db-be59-64a75932c658 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:09.362887 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127566a-6129-4adf-b697-210b93057c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:09.363577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127566a-6129-4adf-b697-210b93057c2b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:09.363868 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127566a-6129-4adf-b697-210b93057c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:09.364157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127566a-6129-4adf-b697-210b93057c2b None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:09.364889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127566a-6129-4adf-b697-210b93057c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:09.365204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127566a-6129-4adf-b697-210b93057c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:09.366612 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127566a-6129-4adf-b697-210b93057c2b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:09.379559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 252/491] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:09.381009 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616714df-e966-4297-b70c-e048d09a01b7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:09.381307 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616714df-e966-4297-b70c-e048d09a01b7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:09.381585 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616714df-e966-4297-b70c-e048d09a01b7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:09.382900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 253/492] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:09.384705 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616714df-e966-4297-b70c-e048d09a01b7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:09.402038 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d515bec-c136-4c71-a798-e94930fce98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:09.403168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d515bec-c136-4c71-a798-e94930fce98e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:09.403766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d515bec-c136-4c71-a798-e94930fce98e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:09.404375 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d515bec-c136-4c71-a798-e94930fce98e None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:09.405297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d515bec-c136-4c71-a798-e94930fce98e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:09.405795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d515bec-c136-4c71-a798-e94930fce98e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:09.407550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d515bec-c136-4c71-a798-e94930fce98e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:09.414017 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:09.424514 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 240/493] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:09.426165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ecd61-50a2-438a-bfbd-a07f867fbc67 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:09.426669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ecd61-50a2-438a-bfbd-a07f867fbc67 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:09.427161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ecd61-50a2-438a-bfbd-a07f867fbc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:09.446304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3c4ecd61-50a2-438a-bfbd-a07f867fbc67 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:09.447838 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3c4ecd61-50a2-438a-bfbd-a07f867fbc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:09.463313 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:09.491956 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616714df-e966-4297-b70c-e048d09a01b7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:09.526407 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 241/494] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:09.527455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b71eec-53a2-47e1-a42c-f4f2f374fced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:09.527981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ecd61-50a2-438a-bfbd-a07f867fbc67 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:09.528283 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b71eec-53a2-47e1-a42c-f4f2f374fced None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:09.528568 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b71eec-53a2-47e1-a42c-f4f2f374fced None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:09.528847 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b71eec-53a2-47e1-a42c-f4f2f374fced None admin] PATH_INFO: `/v3/users/glance` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:09.537271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b71eec-53a2-47e1-a42c-f4f2f374fced None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:09.538742 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b71eec-53a2-47e1-a42c-f4f2f374fced None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:09.555782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a3b71eec-53a2-47e1-a42c-f4f2f374fced None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 27 15:12:09.555782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:09.555782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:09.555782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:09.555782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:09.555782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:09.555782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:09.555782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:09.555782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:09.555782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:09.555782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:09.555782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:09.555782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:09.555782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:09.555782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:09.555782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:09.557116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:09.558036 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:09.558036 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:09.558036 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:09.558036 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:09.558036 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:09.558036 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:09.558036 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:09.558036 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:09.558036 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 27 15:12:09.558036 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:09.561993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 254/495] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:12:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:09.563002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b71eec-53a2-47e1-a42c-f4f2f374fced None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:09.652691 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ecd61-50a2-438a-bfbd-a07f867fbc67 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:09.666035 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:09.688146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b71eec-53a2-47e1-a42c-f4f2f374fced None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:09.703570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07ebce-1118-49e4-8a5b-ba3829ccdd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:09.704390 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07ebce-1118-49e4-8a5b-ba3829ccdd28 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:09.704763 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07ebce-1118-49e4-8a5b-ba3829ccdd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:09.705519 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07ebce-1118-49e4-8a5b-ba3829ccdd28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:09.715028 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07ebce-1118-49e4-8a5b-ba3829ccdd28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:09.716710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07ebce-1118-49e4-8a5b-ba3829ccdd28 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:09.724733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cddb6-8984-412b-9219-ccc63fbbc69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:09.725558 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cddb6-8984-412b-9219-ccc63fbbc69a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:09.725843 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cddb6-8984-412b-9219-ccc63fbbc69a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:09.726124 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cddb6-8984-412b-9219-ccc63fbbc69a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:09.737422 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cddb6-8984-412b-9219-ccc63fbbc69a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:09.737836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-0c07ebce-1118-49e4-8a5b-ba3829ccdd28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:12:09.737836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:09.737836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:09.737836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:09.737836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:09.737836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:09.737836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:09.737836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:09.737836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:09.737836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:09.737836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:09.737836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:09.737836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:09.737836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:09.737836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:09.737836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:09.738772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:09.739660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:09.739660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:09.739660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:09.739660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:09.739660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:09.739660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:09.739660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:09.739660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:09.739660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:12:09.739660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:09.744497 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 242/496] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 27 15:12:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:09.745461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07ebce-1118-49e4-8a5b-ba3829ccdd28 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:09.745998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-385cddb6-8984-412b-9219-ccc63fbbc69a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:09.745998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:09.745998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:09.745998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:09.745998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:09.745998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:09.745998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:09.745998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:09.745998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:09.745998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:09.745998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:09.745998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:09.745998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:09.745998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:09.745998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:09.745998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:09.748016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:09.748016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:09.748016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:09.748016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:09.748016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:09.748016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:09.748016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:09.748016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:09.748016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:09.748016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:09.748016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:09.748016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:09.748016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:09.748016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:09.748016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:09.748016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:09.749893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:09.749893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:09.749893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:09.749893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:09.749893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:09.749893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:09.749893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:09.749893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:09.749893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:09.749893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:09.749893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:09.749893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:09.749893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 255/497] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:09.749893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cddb6-8984-412b-9219-ccc63fbbc69a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:09.757520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:09.858023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cddb6-8984-412b-9219-ccc63fbbc69a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:09.869318 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07ebce-1118-49e4-8a5b-ba3829ccdd28 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:09.893689 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a7dae-d65f-44fc-9952-7f619cb870be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:09.894851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a7dae-d65f-44fc-9952-7f619cb870be None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:09.894851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a7dae-d65f-44fc-9952-7f619cb870be None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:09.895053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a7dae-d65f-44fc-9952-7f619cb870be None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:09.895972 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a7dae-d65f-44fc-9952-7f619cb870be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:09.896279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a7dae-d65f-44fc-9952-7f619cb870be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:09.897760 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a7dae-d65f-44fc-9952-7f619cb870be None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:09.911618 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fffc8-8b2d-4cd2-94d5-c4a0aeb01245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:09.912553 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fffc8-8b2d-4cd2-94d5-c4a0aeb01245 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:09.912972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fffc8-8b2d-4cd2-94d5-c4a0aeb01245 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:09.913380 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fffc8-8b2d-4cd2-94d5-c4a0aeb01245 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:09.914425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fffc8-8b2d-4cd2-94d5-c4a0aeb01245 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:09.914871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fffc8-8b2d-4cd2-94d5-c4a0aeb01245 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:09.916481 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fffc8-8b2d-4cd2-94d5-c4a0aeb01245 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:09.938925 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 256/498] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 27 15:12:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:09.940199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a7dae-d65f-44fc-9952-7f619cb870be None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:09.957823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:09.959497 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 243/499] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Jun 27 15:12:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:09.964155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c402fa-fa1d-41ad-b98c-6a17f53b8f8a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:09.964155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c402fa-fa1d-41ad-b98c-6a17f53b8f8a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:09.964155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c402fa-fa1d-41ad-b98c-6a17f53b8f8a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:09.964155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 244/500] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:09.964155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c402fa-fa1d-41ad-b98c-6a17f53b8f8a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:10.045594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:10.081215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a7dae-d65f-44fc-9952-7f619cb870be None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:10.092969 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c402fa-fa1d-41ad-b98c-6a17f53b8f8a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:10.122471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38973c-60b5-4d45-837f-6b137ef2a1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:10.123158 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38973c-60b5-4d45-837f-6b137ef2a1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:10.123435 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38973c-60b5-4d45-837f-6b137ef2a1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:10.123707 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38973c-60b5-4d45-837f-6b137ef2a1d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:10.124471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38973c-60b5-4d45-837f-6b137ef2a1d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:10.124779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38973c-60b5-4d45-837f-6b137ef2a1d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:10.126176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38973c-60b5-4d45-837f-6b137ef2a1d8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:10.136561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 257/501] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:10.137551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38973c-60b5-4d45-837f-6b137ef2a1d8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:10.149452 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e8db6-5a38-46b7-8b50-8f56de69edd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:10.150269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e8db6-5a38-46b7-8b50-8f56de69edd4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:10.150619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e8db6-5a38-46b7-8b50-8f56de69edd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:10.150929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e8db6-5a38-46b7-8b50-8f56de69edd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:10.225282 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:10.244233 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e8db6-5a38-46b7-8b50-8f56de69edd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:10.245757 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e8db6-5a38-46b7-8b50-8f56de69edd4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:10.265503 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38973c-60b5-4d45-837f-6b137ef2a1d8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:10.306715 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2de88-25ba-40aa-a8db-9e9482fc9e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:10.307637 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2de88-25ba-40aa-a8db-9e9482fc9e4d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:10.308063 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2de88-25ba-40aa-a8db-9e9482fc9e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:10.308504 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2de88-25ba-40aa-a8db-9e9482fc9e4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:10.335992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:10.387688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 245/502] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:12:10.389002 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9870427-87ab-4b8e-a3a0-f7bbf8061ae6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:10.389954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9870427-87ab-4b8e-a3a0-f7bbf8061ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:10.389954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9870427-87ab-4b8e-a3a0-f7bbf8061ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:10.401526 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2de88-25ba-40aa-a8db-9e9482fc9e4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:10.403076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2de88-25ba-40aa-a8db-9e9482fc9e4d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:10.410278 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b9870427-87ab-4b8e-a3a0-f7bbf8061ae6 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:10.411526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b9870427-87ab-4b8e-a3a0-f7bbf8061ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:10.480092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:10.492687 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 246/503] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:10.493554 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9870427-87ab-4b8e-a3a0-f7bbf8061ae6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:10.527311 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 258/504] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:12:10.528678 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58493-a1cc-43c6-bb7a-6ae3884be377 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:10.528983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58493-a1cc-43c6-bb7a-6ae3884be377 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:10.529247 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58493-a1cc-43c6-bb7a-6ae3884be377 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:10.530798 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 259/505] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:10.535681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e58493-a1cc-43c6-bb7a-6ae3884be377 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:10.597240 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:10.603774 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9870427-87ab-4b8e-a3a0-f7bbf8061ae6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:10.644852 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457dc78-2a18-40fa-a889-a343b28e11f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:10.645799 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457dc78-2a18-40fa-a889-a343b28e11f9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:10.646098 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457dc78-2a18-40fa-a889-a343b28e11f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:10.646412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457dc78-2a18-40fa-a889-a343b28e11f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:10.653930 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e58493-a1cc-43c6-bb7a-6ae3884be377 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:10.659361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457dc78-2a18-40fa-a889-a343b28e11f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:10.660845 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457dc78-2a18-40fa-a889-a343b28e11f9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:10.679524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-6457dc78-2a18-40fa-a889-a343b28e11f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:10.679524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:10.679524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:10.679524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:10.679524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:10.679524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:10.679524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:10.679524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:10.679524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:10.679524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:10.679524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:10.679524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:10.679524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:10.679524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:10.679524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:10.681917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:10.683096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:10.683096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:10.683096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:10.683096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:10.683096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 247/506] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:10.683096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457dc78-2a18-40fa-a889-a343b28e11f9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:10.698286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7374c-4d9f-4c3f-98e2-0abbf3305450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:10.699087 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7374c-4d9f-4c3f-98e2-0abbf3305450 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:10.699505 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7374c-4d9f-4c3f-98e2-0abbf3305450 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:10.699631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7374c-4d9f-4c3f-98e2-0abbf3305450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:10.713120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7374c-4d9f-4c3f-98e2-0abbf3305450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:10.715310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7374c-4d9f-4c3f-98e2-0abbf3305450 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:10.733349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9ca7374c-4d9f-4c3f-98e2-0abbf3305450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:10.733349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:10.733349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:10.733349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:10.733349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:10.733349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:10.733349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:10.733349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:10.733349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:10.733349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:10.733349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:10.733349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:10.733349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:10.733349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:10.733349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:10.734405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:10.735272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:10.735272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:10.735272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:10.735272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:10.735272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 260/507] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:10.735541 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7374c-4d9f-4c3f-98e2-0abbf3305450 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:10.760414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:10.800934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457dc78-2a18-40fa-a889-a343b28e11f9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:10.841337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c89b8-5415-4b87-bfa9-530727200c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:10.842324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c89b8-5415-4b87-bfa9-530727200c74 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:10.842645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c89b8-5415-4b87-bfa9-530727200c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:10.843092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c89b8-5415-4b87-bfa9-530727200c74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:10.844293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7374c-4d9f-4c3f-98e2-0abbf3305450 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:10.859476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c89b8-5415-4b87-bfa9-530727200c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:10.867433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c41c89b8-5415-4b87-bfa9-530727200c74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:10.867433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:10.867433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:10.867433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:10.867433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:10.867433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:10.867433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:10.867433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:10.867433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:10.867433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:10.867433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:10.867433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:10.867433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:10.867433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:10.867433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:10.867433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:10.868474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:10.868474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:10.868474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:10.868474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:10.868474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:10.868474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:10.868474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:10.868474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:10.868474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:10.868474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:10.868474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:10.868474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:10.868474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:10.868474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:10.868474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:10.868474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:10.869264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:10.869264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:10.869264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:10.869264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:10.869264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:10.869264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:10.869264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:10.869264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:10.869264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:10.869264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:10.869264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:10.869264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:10.869264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 248/508] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:10.869910 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728860e-e5ef-4e17-9936-e1fb9901026c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:10.870159 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728860e-e5ef-4e17-9936-e1fb9901026c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:10.870462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728860e-e5ef-4e17-9936-e1fb9901026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:10.887107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eddb1a-5c83-4237-a63b-150109339300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:10.887907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eddb1a-5c83-4237-a63b-150109339300 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:10.888192 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eddb1a-5c83-4237-a63b-150109339300 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:10.888472 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eddb1a-5c83-4237-a63b-150109339300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:10.888615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e728860e-e5ef-4e17-9936-e1fb9901026c None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:10.889841 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e728860e-e5ef-4e17-9936-e1fb9901026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:10.891982 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:10.902557 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eddb1a-5c83-4237-a63b-150109339300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:10.904114 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eddb1a-5c83-4237-a63b-150109339300 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:10.924817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a5eddb1a-5c83-4237-a63b-150109339300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:10.924817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:10.924817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:10.924817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:10.924817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:10.924817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:10.924817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:10.924817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:10.924817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:10.924817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:10.924817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:10.924817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:10.924817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:10.924817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:10.924817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:10.925759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:10.926945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:10.926945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:10.926945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:10.926945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:10.926945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 261/509] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:10.926945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eddb1a-5c83-4237-a63b-150109339300 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:10.973107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 249/510] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:10.973107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728860e-e5ef-4e17-9936-e1fb9901026c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:11.009197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:11.041885 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eddb1a-5c83-4237-a63b-150109339300 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:11.080454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad3155-2ce7-4ca8-8788-19a8b03b183b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:11.081290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad3155-2ce7-4ca8-8788-19a8b03b183b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:11.081636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad3155-2ce7-4ca8-8788-19a8b03b183b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:11.081920 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad3155-2ce7-4ca8-8788-19a8b03b183b None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:11.082691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad3155-2ce7-4ca8-8788-19a8b03b183b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:11.082987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad3155-2ce7-4ca8-8788-19a8b03b183b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:11.084374 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad3155-2ce7-4ca8-8788-19a8b03b183b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:11.087217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728860e-e5ef-4e17-9936-e1fb9901026c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:11.096724 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 262/511] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:11.097587 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad3155-2ce7-4ca8-8788-19a8b03b183b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:11.134253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754083d-607f-4cbe-8302-342dc5c3b9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:11.134937 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754083d-607f-4cbe-8302-342dc5c3b9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:11.135230 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754083d-607f-4cbe-8302-342dc5c3b9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:11.135547 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754083d-607f-4cbe-8302-342dc5c3b9a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:11.136254 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754083d-607f-4cbe-8302-342dc5c3b9a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:11.136566 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754083d-607f-4cbe-8302-342dc5c3b9a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:11.138631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754083d-607f-4cbe-8302-342dc5c3b9a2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:11.144857 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:11.151329 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 250/512] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:11.152186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754083d-607f-4cbe-8302-342dc5c3b9a2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:11.226303 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad3155-2ce7-4ca8-8788-19a8b03b183b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:11.260851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:11.268338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb43a4-9a8b-4378-93d7-46d54f00e789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:11.269152 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb43a4-9a8b-4378-93d7-46d54f00e789 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:11.269622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb43a4-9a8b-4378-93d7-46d54f00e789 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:11.270055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb43a4-9a8b-4378-93d7-46d54f00e789 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:11.271286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb43a4-9a8b-4378-93d7-46d54f00e789 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:11.271435 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754083d-607f-4cbe-8302-342dc5c3b9a2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:11.271798 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb43a4-9a8b-4378-93d7-46d54f00e789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:11.273866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb43a4-9a8b-4378-93d7-46d54f00e789 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:11.284949 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 263/513] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:11.285380 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb43a4-9a8b-4378-93d7-46d54f00e789 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:11.320208 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbccc6f6-6ab8-493a-afc2-3515814e9173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:11.321232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccc6f6-6ab8-493a-afc2-3515814e9173 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:11.321522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccc6f6-6ab8-493a-afc2-3515814e9173 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:11.321783 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccc6f6-6ab8-493a-afc2-3515814e9173 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:11.322590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbccc6f6-6ab8-493a-afc2-3515814e9173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:11.322898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbccc6f6-6ab8-493a-afc2-3515814e9173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:11.324305 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbccc6f6-6ab8-493a-afc2-3515814e9173 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:11.337362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 251/514] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:11.338242 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbccc6f6-6ab8-493a-afc2-3515814e9173 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:11.405205 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:11.429249 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb43a4-9a8b-4378-93d7-46d54f00e789 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:11.472520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbccc6f6-6ab8-493a-afc2-3515814e9173 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:11.487855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e93ead-93a4-4f65-a645-4a6bc1788a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:11.489186 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e93ead-93a4-4f65-a645-4a6bc1788a4f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:11.489649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e93ead-93a4-4f65-a645-4a6bc1788a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:11.490100 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e93ead-93a4-4f65-a645-4a6bc1788a4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:11.508857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e93ead-93a4-4f65-a645-4a6bc1788a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:11.511401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e93ead-93a4-4f65-a645-4a6bc1788a4f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:11.518966 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114074d5-82c5-4605-97a7-ba88dfefa367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:11.519793 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114074d5-82c5-4605-97a7-ba88dfefa367 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:11.520077 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114074d5-82c5-4605-97a7-ba88dfefa367 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:11.520351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114074d5-82c5-4605-97a7-ba88dfefa367 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:11.529040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114074d5-82c5-4605-97a7-ba88dfefa367 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:11.530580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114074d5-82c5-4605-97a7-ba88dfefa367 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:11.542367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-20e93ead-93a4-4f65-a645-4a6bc1788a4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:11.542367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:11.542367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:11.542367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:11.542367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:11.542367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:11.542367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:11.542367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:11.542367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:11.542367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:11.542367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:11.542367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:11.542367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:11.542367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:11.542367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:11.543362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:11.544197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:11.544197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:11.544197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:11.544197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:11.544884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 264/515] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:11.546061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-114074d5-82c5-4605-97a7-ba88dfefa367 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 15:12:11.546061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:11.546061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:11.546061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:11.546061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:11.546061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:11.546061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:11.546061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:11.546061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:11.546061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:11.546061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:11.546061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:11.546061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:11.546061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:11.546061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:11.546061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:11.548003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:11.550807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:11.550807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:11.550807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:11.550807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:11.550807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:11.550807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:11.550807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:11.550807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:11.550807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 15:12:11.550807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:11.551954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e93ead-93a4-4f65-a645-4a6bc1788a4f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:11.552113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 252/516] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:12:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:11.552113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114074d5-82c5-4605-97a7-ba88dfefa367 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:11.622607 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:11.661751 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114074d5-82c5-4605-97a7-ba88dfefa367 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:11.681307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:11.701226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e93ead-93a4-4f65-a645-4a6bc1788a4f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:11.704416 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f68a0-1bab-40ff-ad70-b762951b6337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:11.705692 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f68a0-1bab-40ff-ad70-b762951b6337 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:11.706164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f68a0-1bab-40ff-ad70-b762951b6337 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:11.706655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f68a0-1bab-40ff-ad70-b762951b6337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:11.723590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f68a0-1bab-40ff-ad70-b762951b6337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:11.725954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f68a0-1bab-40ff-ad70-b762951b6337 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:11.754714 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1011a77-84d5-4fce-8e59-43b63a98d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:11.755800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e27f68a0-1bab-40ff-ad70-b762951b6337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:11.755800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:11.755800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:11.755800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:11.755800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:11.755800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:11.755800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:11.755800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:11.755800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:11.755800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:11.755800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:11.755800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:11.755800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:11.755800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:11.755800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:11.757480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:11.759412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:11.759412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:11.759412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:11.759412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:11.759848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1011a77-84d5-4fce-8e59-43b63a98d152 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:11.759848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1011a77-84d5-4fce-8e59-43b63a98d152 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:11.759848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1011a77-84d5-4fce-8e59-43b63a98d152 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:11.760207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 253/517] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:11.760207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f68a0-1bab-40ff-ad70-b762951b6337 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:11.771186 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1011a77-84d5-4fce-8e59-43b63a98d152 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:11.772698 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1011a77-84d5-4fce-8e59-43b63a98d152 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:11.795807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a1011a77-84d5-4fce-8e59-43b63a98d152 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:11.795807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:11.795807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:11.795807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:11.795807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:11.795807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:11.795807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:11.795807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:11.795807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:11.795807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:11.795807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:11.795807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:11.795807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:11.795807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:11.795807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:11.797417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:11.799183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:11.799183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:11.799183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:11.799183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:11.799183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:11.799183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:11.799183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:11.799183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:11.799183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 265/518] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:11.799183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1011a77-84d5-4fce-8e59-43b63a98d152 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:11.914903 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f68a0-1bab-40ff-ad70-b762951b6337 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:11.948127 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1011a77-84d5-4fce-8e59-43b63a98d152 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:11.958249 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:11.965574 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71cb69-7766-4dd2-9fb2-edf2674b698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:11.966552 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71cb69-7766-4dd2-9fb2-edf2674b698e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:11.966990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71cb69-7766-4dd2-9fb2-edf2674b698e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:11.967334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71cb69-7766-4dd2-9fb2-edf2674b698e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:11.975927 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71cb69-7766-4dd2-9fb2-edf2674b698e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:11.977718 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71cb69-7766-4dd2-9fb2-edf2674b698e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:11.990967 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656be3c-7d3a-4d97-a1ec-d5f95c26e921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:11.991759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656be3c-7d3a-4d97-a1ec-d5f95c26e921 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:11.992124 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656be3c-7d3a-4d97-a1ec-d5f95c26e921 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:11.992486 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656be3c-7d3a-4d97-a1ec-d5f95c26e921 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:11.993329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656be3c-7d3a-4d97-a1ec-d5f95c26e921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:11.993725 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656be3c-7d3a-4d97-a1ec-d5f95c26e921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:11.994492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-7b71cb69-7766-4dd2-9fb2-edf2674b698e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:11.994492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:11.994492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:11.994492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:11.994492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:11.994492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:11.994492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:11.994492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:11.994492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:11.994492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:11.994492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:11.994492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:11.994492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:11.994492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:11.994492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:11.996239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:12.003610 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:12.003610 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:12.003610 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:12.003610 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:12.003610 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:12.003610 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:12.003610 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:12.003610 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:12.004709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656be3c-7d3a-4d97-a1ec-d5f95c26e921 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:12.004854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 254/519] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:12.004854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71cb69-7766-4dd2-9fb2-edf2674b698e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:12.018361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 266/520] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:12.019802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656be3c-7d3a-4d97-a1ec-d5f95c26e921 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:12.038199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:12.126957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71cb69-7766-4dd2-9fb2-edf2674b698e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:12.147302 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656be3c-7d3a-4d97-a1ec-d5f95c26e921 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:12.166569 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40aae60-b42f-47b1-add7-b01b10269d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:12.167268 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40aae60-b42f-47b1-add7-b01b10269d9b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:12.167554 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40aae60-b42f-47b1-add7-b01b10269d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:12.167836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40aae60-b42f-47b1-add7-b01b10269d9b None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:12.168715 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40aae60-b42f-47b1-add7-b01b10269d9b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:12.169029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40aae60-b42f-47b1-add7-b01b10269d9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:12.170604 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40aae60-b42f-47b1-add7-b01b10269d9b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:12.191578 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 255/521] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Jun 27 15:12:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:12.192447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40aae60-b42f-47b1-add7-b01b10269d9b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:12.193496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1784555-58ec-41f8-8c8c-cff7a0eb594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:12.194671 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1784555-58ec-41f8-8c8c-cff7a0eb594c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:12.195147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1784555-58ec-41f8-8c8c-cff7a0eb594c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:12.195615 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1784555-58ec-41f8-8c8c-cff7a0eb594c None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:12.197031 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1784555-58ec-41f8-8c8c-cff7a0eb594c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:12.197590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1784555-58ec-41f8-8c8c-cff7a0eb594c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:12.200201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1784555-58ec-41f8-8c8c-cff7a0eb594c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:12.221609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 267/522] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:12.223232 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1784555-58ec-41f8-8c8c-cff7a0eb594c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:12.259827 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:12.307339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:12.321439 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40aae60-b42f-47b1-add7-b01b10269d9b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:12.351937 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1784555-58ec-41f8-8c8c-cff7a0eb594c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:12.361390 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb6b4e-0a3e-4d25-862d-8a147bfea391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:12.362141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb6b4e-0a3e-4d25-862d-8a147bfea391 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:12.362598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb6b4e-0a3e-4d25-862d-8a147bfea391 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:12.363077 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb6b4e-0a3e-4d25-862d-8a147bfea391 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:12.363974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb6b4e-0a3e-4d25-862d-8a147bfea391 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:12.364457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb6b4e-0a3e-4d25-862d-8a147bfea391 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:12.366347 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb6b4e-0a3e-4d25-862d-8a147bfea391 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:12.389620 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 256/523] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:12.390359 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb6b4e-0a3e-4d25-862d-8a147bfea391 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:12.397965 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6febde-8ba1-4809-a385-df3efa4cf2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:12.399128 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6febde-8ba1-4809-a385-df3efa4cf2bb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:12.399611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6febde-8ba1-4809-a385-df3efa4cf2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:12.400097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6febde-8ba1-4809-a385-df3efa4cf2bb None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:12.401583 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6febde-8ba1-4809-a385-df3efa4cf2bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:12.402115 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6febde-8ba1-4809-a385-df3efa4cf2bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:12.404804 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6febde-8ba1-4809-a385-df3efa4cf2bb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:12.436712 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 268/524] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:12.438064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6febde-8ba1-4809-a385-df3efa4cf2bb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:12.503724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb6b4e-0a3e-4d25-862d-8a147bfea391 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:12.548157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:12.552700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6fbf1-8be3-4275-9783-52f4afd76abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:12.553381 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6fbf1-8be3-4275-9783-52f4afd76abd None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:12.553727 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6fbf1-8be3-4275-9783-52f4afd76abd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:12.554007 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6fbf1-8be3-4275-9783-52f4afd76abd None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:12.554730 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6fbf1-8be3-4275-9783-52f4afd76abd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:12.556539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6fbf1-8be3-4275-9783-52f4afd76abd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:12.569094 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6febde-8ba1-4809-a385-df3efa4cf2bb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:12.583769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 257/525] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:12:12 2022] POST /identity/v3/users => generated 247 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:12:12.584941 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6fbf1-8be3-4275-9783-52f4afd76abd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:12.601503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:12.621669 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189e55e-05d6-4214-8093-b3a9d7ca3506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:12.622690 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189e55e-05d6-4214-8093-b3a9d7ca3506 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:12.623116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189e55e-05d6-4214-8093-b3a9d7ca3506 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:12.623529 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189e55e-05d6-4214-8093-b3a9d7ca3506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:12.742872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189e55e-05d6-4214-8093-b3a9d7ca3506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:12.745754 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189e55e-05d6-4214-8093-b3a9d7ca3506 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:12.786611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6fbf1-8be3-4275-9783-52f4afd76abd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:12.850715 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8d977-0871-4d4f-91c4-2748936d362f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:12.852163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8d977-0871-4d4f-91c4-2748936d362f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:12.852790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8d977-0871-4d4f-91c4-2748936d362f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:12.853514 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8d977-0871-4d4f-91c4-2748936d362f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:12.869546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8d977-0871-4d4f-91c4-2748936d362f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:12.872772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8d977-0871-4d4f-91c4-2748936d362f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:12.876679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:12.897385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 269/526] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:12:12.897385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189e55e-05d6-4214-8093-b3a9d7ca3506 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:12.906281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-84d8d977-0871-4d4f-91c4-2748936d362f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 15:12:12.906281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:12.906281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:12.906281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:12.906281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:12.906281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:12.906281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:12.906281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:12.906281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:12.906281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:12.906281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:12.906281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:12.906281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:12.906281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:12.906281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:12.906281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:12.907413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:12.908638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:12.908638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:12.908638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:12.908638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:12.908638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:12.908638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:12.908638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:12.908638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:12.908638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 15:12:12.908638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:12.916046 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 258/527] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:12.917891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8d977-0871-4d4f-91c4-2748936d362f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:13.005726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:13.024602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189e55e-05d6-4214-8093-b3a9d7ca3506 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:13.069349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8d977-0871-4d4f-91c4-2748936d362f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:13.069567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95caf2e-c612-41ac-8372-9e4f5441a216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:13.070673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95caf2e-c612-41ac-8372-9e4f5441a216 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:13.071162 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95caf2e-c612-41ac-8372-9e4f5441a216 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:13.071630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95caf2e-c612-41ac-8372-9e4f5441a216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:13.073103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95caf2e-c612-41ac-8372-9e4f5441a216 None admin] RBAC: Adding query filter params (role.id=c5b95b7a83d94e99a828c836efe01929, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=37a36c30e9dc472d97d762d236dd865a) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:13.073618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95caf2e-c612-41ac-8372-9e4f5441a216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:13.076249 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95caf2e-c612-41ac-8372-9e4f5441a216 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:13.094439 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 270/528] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:12:12 2022] GET /identity/v3/role_assignments?user.id=37a36c30e9dc472d97d762d236dd865a&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=c5b95b7a83d94e99a828c836efe01929 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:13.096020 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95caf2e-c612-41ac-8372-9e4f5441a216 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:13.147100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49389836-d948-4614-9d8d-82c780776dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:13.148266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49389836-d948-4614-9d8d-82c780776dcb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:13.149503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49389836-d948-4614-9d8d-82c780776dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:13.150042 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49389836-d948-4614-9d8d-82c780776dcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:13.151744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49389836-d948-4614-9d8d-82c780776dcb None admin] RBAC: Adding query filter params (role.id=c5b95b7a83d94e99a828c836efe01929, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=f18acfb35dfe41a1aeb50c702bd1942b) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:13.152324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49389836-d948-4614-9d8d-82c780776dcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:13.154902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49389836-d948-4614-9d8d-82c780776dcb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:13.161660 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:13.169478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 259/529] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:12:12 2022] GET /identity/v3/role_assignments?user.id=f18acfb35dfe41a1aeb50c702bd1942b&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=c5b95b7a83d94e99a828c836efe01929 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:13.169927 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49389836-d948-4614-9d8d-82c780776dcb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:13.277926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95caf2e-c612-41ac-8372-9e4f5441a216 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:13.356058 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6733a48-a0d7-4e71-a43f-74dcb0396665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:13.356907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6733a48-a0d7-4e71-a43f-74dcb0396665 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:13.357193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6733a48-a0d7-4e71-a43f-74dcb0396665 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:13.357469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6733a48-a0d7-4e71-a43f-74dcb0396665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:13.372228 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6733a48-a0d7-4e71-a43f-74dcb0396665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:13.374157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6733a48-a0d7-4e71-a43f-74dcb0396665 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:13.397290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c6733a48-a0d7-4e71-a43f-74dcb0396665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:13.397290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:13.397290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:13.397290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:13.397290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:13.397290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:13.397290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:13.397290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:13.397290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:13.397290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:13.397290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:13.397290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:13.397290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:13.397290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:13.397290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:13.398184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:13.399153 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:13.399153 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:13.399153 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:13.399153 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:13.399405 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49389836-d948-4614-9d8d-82c780776dcb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:13.399480 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 271/530] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:13.405979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6733a48-a0d7-4e71-a43f-74dcb0396665 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:13.433578 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:13.444087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c440b9-b7e2-44ca-8cf6-2c1430f3c630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:13.445284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c440b9-b7e2-44ca-8cf6-2c1430f3c630 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:13.445960 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c440b9-b7e2-44ca-8cf6-2c1430f3c630 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:13.446529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c440b9-b7e2-44ca-8cf6-2c1430f3c630 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:13.447603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c440b9-b7e2-44ca-8cf6-2c1430f3c630 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:13.448120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c440b9-b7e2-44ca-8cf6-2c1430f3c630 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:13.449931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c440b9-b7e2-44ca-8cf6-2c1430f3c630 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:13.490075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 260/531] 10.222.0.33 () {56 vars in 1139 bytes} [Mon Jun 27 15:12:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:13.496283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c440b9-b7e2-44ca-8cf6-2c1430f3c630 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:13.583140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6733a48-a0d7-4e71-a43f-74dcb0396665 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:13.586702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:13.660115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c440b9-b7e2-44ca-8cf6-2c1430f3c630 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:13.699710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f5756-6397-481c-bc1c-6081871e3641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:13.700471 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f5756-6397-481c-bc1c-6081871e3641 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:13.700760 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f5756-6397-481c-bc1c-6081871e3641 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:13.701037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f5756-6397-481c-bc1c-6081871e3641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:13.712302 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f2d26-eedf-4a79-a9a3-90d58dd0e357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:13.713478 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f2d26-eedf-4a79-a9a3-90d58dd0e357 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:13.718700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f2d26-eedf-4a79-a9a3-90d58dd0e357 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:13.719325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f2d26-eedf-4a79-a9a3-90d58dd0e357 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:13.720489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f2d26-eedf-4a79-a9a3-90d58dd0e357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:13.721273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f2d26-eedf-4a79-a9a3-90d58dd0e357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:13.727584 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f2d26-eedf-4a79-a9a3-90d58dd0e357 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:13.762997 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 272/532] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:13.769678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:13.771869 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f2d26-eedf-4a79-a9a3-90d58dd0e357 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:13.786855 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f5756-6397-481c-bc1c-6081871e3641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:13.788360 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f5756-6397-481c-bc1c-6081871e3641 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:13.922334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 261/533] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 15:12:13.927830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f5756-6397-481c-bc1c-6081871e3641 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:13.941593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f2d26-eedf-4a79-a9a3-90d58dd0e357 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:14.031757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32317ca-db49-47b4-b391-b0b7a111ad29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:14.034999 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32317ca-db49-47b4-b391-b0b7a111ad29 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:14.034999 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32317ca-db49-47b4-b391-b0b7a111ad29 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:14.034999 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32317ca-db49-47b4-b391-b0b7a111ad29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:14.052961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32317ca-db49-47b4-b391-b0b7a111ad29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:14.055053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32317ca-db49-47b4-b391-b0b7a111ad29 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:14.088076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d32317ca-db49-47b4-b391-b0b7a111ad29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:14.088076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:14.088076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:14.088076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:14.088076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:14.088076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:14.088076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:14.088076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:14.088076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:14.088076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:14.088076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:14.088076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:14.088076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:14.088076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:14.088076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:14.089000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:14.089844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:14.089844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:14.089844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:14.089844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:14.089844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:14.089844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:14.089844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:14.089844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:14.099094 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 273/534] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:14.104254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32317ca-db49-47b4-b391-b0b7a111ad29 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:14.150623 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:14.178928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:14.226846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f5756-6397-481c-bc1c-6081871e3641 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:14.279932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32317ca-db49-47b4-b391-b0b7a111ad29 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:14.307926 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb352c-1f24-4f79-bdf5-ebd9c6ae86b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:14.309159 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb352c-1f24-4f79-bdf5-ebd9c6ae86b3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:14.309652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb352c-1f24-4f79-bdf5-ebd9c6ae86b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:14.310155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb352c-1f24-4f79-bdf5-ebd9c6ae86b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:14.332857 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb352c-1f24-4f79-bdf5-ebd9c6ae86b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:14.335134 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb352c-1f24-4f79-bdf5-ebd9c6ae86b3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:14.356663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbe44a-b5a9-414f-a429-7452773eea95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:14.357725 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbe44a-b5a9-414f-a429-7452773eea95 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:14.358211 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbe44a-b5a9-414f-a429-7452773eea95 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:14.359489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbe44a-b5a9-414f-a429-7452773eea95 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:14.360591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbe44a-b5a9-414f-a429-7452773eea95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:14.361389 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbe44a-b5a9-414f-a429-7452773eea95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:14.368749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbe44a-b5a9-414f-a429-7452773eea95 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:14.370211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-04eb352c-1f24-4f79-bdf5-ebd9c6ae86b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:14.370211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:14.370211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:14.370211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:14.370211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:14.370211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:14.370211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:14.370211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:14.370211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:14.370211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:14.370211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:14.370211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:14.370211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:14.370211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:14.370211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:14.371067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:14.371912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:14.371912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:14.371912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:14.371912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:14.374460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 262/535] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:12:14.383234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb352c-1f24-4f79-bdf5-ebd9c6ae86b3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:14.401181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 274/536] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:14.411012 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbe44a-b5a9-414f-a429-7452773eea95 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:14.594266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:14.615978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbe44a-b5a9-414f-a429-7452773eea95 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:14.626063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb352c-1f24-4f79-bdf5-ebd9c6ae86b3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:14.656458 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72be6e9-7ea0-4917-beb7-0f964a7aa93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:14.660844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72be6e9-7ea0-4917-beb7-0f964a7aa93a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:14.661572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72be6e9-7ea0-4917-beb7-0f964a7aa93a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:14.662197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72be6e9-7ea0-4917-beb7-0f964a7aa93a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:14.663732 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72be6e9-7ea0-4917-beb7-0f964a7aa93a None admin] RBAC: Adding query filter params (role.id=c5b95b7a83d94e99a828c836efe01929, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=0dccf96088954218a4fb8d7b466f970f) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:14.664771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72be6e9-7ea0-4917-beb7-0f964a7aa93a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:14.669401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72be6e9-7ea0-4917-beb7-0f964a7aa93a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:14.684359 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 275/537] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:12:14 2022] GET /identity/v3/role_assignments?user.id=0dccf96088954218a4fb8d7b466f970f&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=c5b95b7a83d94e99a828c836efe01929 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:14.712340 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120219b-7a14-4f1e-a3a8-e92ceeb6fbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:14.713754 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120219b-7a14-4f1e-a3a8-e92ceeb6fbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:14.714312 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120219b-7a14-4f1e-a3a8-e92ceeb6fbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:14.714808 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120219b-7a14-4f1e-a3a8-e92ceeb6fbb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:14.715816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120219b-7a14-4f1e-a3a8-e92ceeb6fbb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:14.716336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120219b-7a14-4f1e-a3a8-e92ceeb6fbb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:14.717996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120219b-7a14-4f1e-a3a8-e92ceeb6fbb4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:14.728050 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:14.735863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 263/538] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:14.743461 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72be6e9-7ea0-4917-beb7-0f964a7aa93a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:14.901972 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72be6e9-7ea0-4917-beb7-0f964a7aa93a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:14.944340 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de85ad-d626-4470-9642-2924549c86e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:14.945559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de85ad-d626-4470-9642-2924549c86e0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:14.946149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de85ad-d626-4470-9642-2924549c86e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:14.946651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de85ad-d626-4470-9642-2924549c86e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:14.954883 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de85ad-d626-4470-9642-2924549c86e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:14.957424 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de85ad-d626-4470-9642-2924549c86e0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:14.973884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-31de85ad-d626-4470-9642-2924549c86e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:14.973884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:14.973884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:14.973884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:14.973884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:14.973884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:14.973884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:14.973884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:14.973884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:14.973884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:14.973884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:14.973884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:14.973884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:14.973884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:14.973884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:14.974889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:14.975733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:14.975733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:14.975733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:14.975733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:14.975733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:14.975733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:14.975733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:14.975733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:14.978422 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 276/539] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:14.984456 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120219b-7a14-4f1e-a3a8-e92ceeb6fbb4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:15.158116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120219b-7a14-4f1e-a3a8-e92ceeb6fbb4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:15.212206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9ed76-dc79-4be4-9f5d-7aaabd31ae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:15.212894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9ed76-dc79-4be4-9f5d-7aaabd31ae3e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:15.213177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9ed76-dc79-4be4-9f5d-7aaabd31ae3e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:15.213460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9ed76-dc79-4be4-9f5d-7aaabd31ae3e None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:15.214287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9ed76-dc79-4be4-9f5d-7aaabd31ae3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:15.214601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9ed76-dc79-4be4-9f5d-7aaabd31ae3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:15.216051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9ed76-dc79-4be4-9f5d-7aaabd31ae3e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:15.237555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 264/540] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:15.243230 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de85ad-d626-4470-9642-2924549c86e0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:15.262781 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:15.411182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de85ad-d626-4470-9642-2924549c86e0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:15.419617 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c389da-8839-405e-b08a-0a4b374c48be None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:15.419913 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c389da-8839-405e-b08a-0a4b374c48be None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:15.420183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c389da-8839-405e-b08a-0a4b374c48be None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:15.421870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 265/541] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:15.428972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd572b-fab9-4605-b507-32300ecfe0d0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:15.429308 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd572b-fab9-4605-b507-32300ecfe0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:15.429535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd572b-fab9-4605-b507-32300ecfe0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:15.460729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d1cd572b-fab9-4605-b507-32300ecfe0d0 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:15.467101 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d1cd572b-fab9-4605-b507-32300ecfe0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:15.484837 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3105a3-009a-4889-9624-300244b66d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:15.485522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3105a3-009a-4889-9624-300244b66d89 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:15.485811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3105a3-009a-4889-9624-300244b66d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:15.486145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3105a3-009a-4889-9624-300244b66d89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:15.487031 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3105a3-009a-4889-9624-300244b66d89 None admin] RBAC: Adding query filter params (role.id=c5b95b7a83d94e99a828c836efe01929, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=67dbb53f47ca406c96377408e9f893f2) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:15.487347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3105a3-009a-4889-9624-300244b66d89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:15.488831 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3105a3-009a-4889-9624-300244b66d89 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:15.499984 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 277/542] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:12:15 2022] GET /identity/v3/role_assignments?user.id=67dbb53f47ca406c96377408e9f893f2&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=c5b95b7a83d94e99a828c836efe01929 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:15.598469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:15.638155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 266/543] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:12:15.703082 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3105a3-009a-4889-9624-300244b66d89 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:15.845539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:15.891975 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3105a3-009a-4889-9624-300244b66d89 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:15.951012 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2f709-ec16-41b3-971c-c24b6819cd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:15.952043 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2f709-ec16-41b3-971c-c24b6819cd44 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:15.952170 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2f709-ec16-41b3-971c-c24b6819cd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:15.952548 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2f709-ec16-41b3-971c-c24b6819cd44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:15.969734 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2f709-ec16-41b3-971c-c24b6819cd44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:15.977810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-72b2f709-ec16-41b3-971c-c24b6819cd44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:15.977810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:15.977810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:15.977810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:15.977810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:15.977810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:15.977810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:15.977810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:15.977810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:15.977810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:15.977810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:15.977810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:15.977810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:15.977810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:15.977810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:15.977810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:15.979450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:15.979450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:15.979450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:15.979450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:15.979450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:15.979450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:15.979450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:15.979450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:15.979450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:15.979450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:15.979450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:15.979450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:15.979450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:15.979450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:15.979450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:15.979450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:15.980987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:15.980987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:15.980987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:15.980987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:15.980987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:15.980987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:15.980987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:15.980987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:15.980987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:15.980987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:15.980987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:15.980987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:15.980987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 278/544] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:15.996116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd572b-fab9-4605-b507-32300ecfe0d0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:16.221380 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd572b-fab9-4605-b507-32300ecfe0d0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:16.317257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b98ae6-3def-4319-95e8-ac4cc46aee87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:16.319043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b98ae6-3def-4319-95e8-ac4cc46aee87 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:16.319853 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b98ae6-3def-4319-95e8-ac4cc46aee87 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:16.320599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b98ae6-3def-4319-95e8-ac4cc46aee87 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:16.322573 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b98ae6-3def-4319-95e8-ac4cc46aee87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:16.323539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b98ae6-3def-4319-95e8-ac4cc46aee87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:16.326495 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b98ae6-3def-4319-95e8-ac4cc46aee87 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:16.344232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 267/545] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:16.353764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2f709-ec16-41b3-971c-c24b6819cd44 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:16.414709 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe24984-f61a-4f24-ada7-537d93eaab98 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:16.416364 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe24984-f61a-4f24-ada7-537d93eaab98 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:16.417145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe24984-f61a-4f24-ada7-537d93eaab98 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:16.421292 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 268/546] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:16.439827 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ccb54-f899-482e-8de9-f27c28ee32ff None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:16.440747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ccb54-f899-482e-8de9-f27c28ee32ff None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:16.441528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ccb54-f899-482e-8de9-f27c28ee32ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:16.486176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2a0ccb54-f899-482e-8de9-f27c28ee32ff None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:16.489489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2a0ccb54-f899-482e-8de9-f27c28ee32ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:16.589435 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:16.589890 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2f709-ec16-41b3-971c-c24b6819cd44 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:16.635698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 269/547] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:16.638609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95ecbe-d91c-4bba-8bcf-309e174ed502 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:16.639043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95ecbe-d91c-4bba-8bcf-309e174ed502 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:16.639444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95ecbe-d91c-4bba-8bcf-309e174ed502 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:16.641181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 270/548] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:16.649001 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016e7ed-a0d5-452e-a5f8-15ff798fec70 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:16.649507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016e7ed-a0d5-452e-a5f8-15ff798fec70 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:16.650009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016e7ed-a0d5-452e-a5f8-15ff798fec70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:16.663629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:16.677412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6975b2-ce4c-4ac6-b6a6-cad68d9c06b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:16.679328 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6975b2-ce4c-4ac6-b6a6-cad68d9c06b4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:16.680171 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6975b2-ce4c-4ac6-b6a6-cad68d9c06b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:16.683139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6975b2-ce4c-4ac6-b6a6-cad68d9c06b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:16.708343 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6975b2-ce4c-4ac6-b6a6-cad68d9c06b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:16.711772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6975b2-ce4c-4ac6-b6a6-cad68d9c06b4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:16.712313 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c016e7ed-a0d5-452e-a5f8-15ff798fec70 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:16.715265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c016e7ed-a0d5-452e-a5f8-15ff798fec70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:16.765159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7f6975b2-ce4c-4ac6-b6a6-cad68d9c06b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:16.765159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:16.765159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:16.765159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:16.765159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:16.765159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:16.765159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:16.765159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:16.765159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:16.765159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:16.765159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:16.765159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:16.765159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:16.765159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:16.765159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:16.779101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:16.780935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:16.780935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:16.780935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:16.780935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:16.780935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 279/549] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:16.780935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6975b2-ce4c-4ac6-b6a6-cad68d9c06b4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:16.882792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 271/550] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:16.884784 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016e7ed-a0d5-452e-a5f8-15ff798fec70 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:17.073522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6975b2-ce4c-4ac6-b6a6-cad68d9c06b4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:17.146101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4d59a-8a32-4c24-98b9-63869e9732e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:17.149746 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4d59a-8a32-4c24-98b9-63869e9732e3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:17.150794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4d59a-8a32-4c24-98b9-63869e9732e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:17.151932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4d59a-8a32-4c24-98b9-63869e9732e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:17.155145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016e7ed-a0d5-452e-a5f8-15ff798fec70 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:17.180121 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4d59a-8a32-4c24-98b9-63869e9732e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:17.186800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:17.196074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-aca4d59a-8a32-4c24-98b9-63869e9732e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:17.196074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:17.196074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:17.196074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:17.196074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:17.196074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:17.196074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:17.196074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:17.196074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:17.196074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:17.196074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:17.196074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:17.196074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:17.196074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:17.196074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:17.196074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:17.198900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:17.198900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:17.198900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:17.198900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:17.198900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:17.198900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:17.198900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:17.198900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:17.198900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:17.198900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:17.198900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:17.198900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:17.198900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:17.198900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:17.198900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:17.198900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:17.201356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:17.201356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:17.201356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:17.201356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:17.201356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:17.201356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:17.201356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:17.201356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:17.201356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:17.201356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:17.201356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:17.201356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:17.210906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 280/551] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:17.212765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4d59a-8a32-4c24-98b9-63869e9732e3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:17.248188 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8a49d-53f4-4f95-a108-6e45c1ea8bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:17.250164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8a49d-53f4-4f95-a108-6e45c1ea8bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:17.250859 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8a49d-53f4-4f95-a108-6e45c1ea8bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:17.251562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8a49d-53f4-4f95-a108-6e45c1ea8bc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:17.253231 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8a49d-53f4-4f95-a108-6e45c1ea8bc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:17.254022 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8a49d-53f4-4f95-a108-6e45c1ea8bc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:17.257023 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8a49d-53f4-4f95-a108-6e45c1ea8bc9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:17.282062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 272/552] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:17.284404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8a49d-53f4-4f95-a108-6e45c1ea8bc9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:17.314197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:17.442403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4d59a-8a32-4c24-98b9-63869e9732e3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:17.489027 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8a49d-53f4-4f95-a108-6e45c1ea8bc9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:17.517243 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d5c7e-0e2f-4f9e-8083-de9749017452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:17.518637 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d5c7e-0e2f-4f9e-8083-de9749017452 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:17.519111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d5c7e-0e2f-4f9e-8083-de9749017452 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:17.519607 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d5c7e-0e2f-4f9e-8083-de9749017452 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:17.542390 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d5c7e-0e2f-4f9e-8083-de9749017452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:17.558378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0dae4-e87d-43f4-8f0a-b428a5a8e5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:17.559873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2c4d5c7e-0e2f-4f9e-8083-de9749017452 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:17.559873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:17.559873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:17.559873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:17.559873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:17.559873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:17.559873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:17.559873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:17.559873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:17.559873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:17.559873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:17.559873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:17.559873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:17.559873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:17.559873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:17.559873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:17.561823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:17.561823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:17.561823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:17.561823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:17.561823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:17.561823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:17.561823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:17.561823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:17.561823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:17.561823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:17.561823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:17.561823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:17.561823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:17.561823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:17.561823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:17.561823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:17.563488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:17.563488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:17.563488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:17.563488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:17.563488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:17.563488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:17.563488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:17.563488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:17.563488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:17.563488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:17.563488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:17.563488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:17.565852 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0dae4-e87d-43f4-8f0a-b428a5a8e5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:17.566772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 281/553] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:17.567181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0dae4-e87d-43f4-8f0a-b428a5a8e5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:17.567924 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0dae4-e87d-43f4-8f0a-b428a5a8e5d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:17.568366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d5c7e-0e2f-4f9e-8083-de9749017452 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:17.570156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0dae4-e87d-43f4-8f0a-b428a5a8e5d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:17.571103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0dae4-e87d-43f4-8f0a-b428a5a8e5d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:17.574067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0dae4-e87d-43f4-8f0a-b428a5a8e5d1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:17.592471 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 273/554] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:17.594498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0dae4-e87d-43f4-8f0a-b428a5a8e5d1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:17.656445 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:17.792704 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0dae4-e87d-43f4-8f0a-b428a5a8e5d1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:17.796822 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d5c7e-0e2f-4f9e-8083-de9749017452 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:17.800175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:17.859757 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f3c7e-ba93-44f3-be6b-b86570a55899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:17.861706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f3c7e-ba93-44f3-be6b-b86570a55899 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:17.862671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f3c7e-ba93-44f3-be6b-b86570a55899 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:17.863507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f3c7e-ba93-44f3-be6b-b86570a55899 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:17.865417 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f3c7e-ba93-44f3-be6b-b86570a55899 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:17.866255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f3c7e-ba93-44f3-be6b-b86570a55899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:17.868119 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa097129-8bf3-474f-bd60-c782b0c7e3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:17.869485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa097129-8bf3-474f-bd60-c782b0c7e3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:17.869767 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f3c7e-ba93-44f3-be6b-b86570a55899 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:17.870019 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa097129-8bf3-474f-bd60-c782b0c7e3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:17.870511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa097129-8bf3-474f-bd60-c782b0c7e3e8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:17.886108 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa097129-8bf3-474f-bd60-c782b0c7e3e8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:17.886717 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 274/555] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:17.888292 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f3c7e-ba93-44f3-be6b-b86570a55899 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:17.888750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa097129-8bf3-474f-bd60-c782b0c7e3e8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:17.914873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-fa097129-8bf3-474f-bd60-c782b0c7e3e8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 15:12:17.914873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:17.914873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:17.914873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:17.914873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:17.914873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:17.914873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:17.914873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:17.914873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:17.914873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:17.914873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:17.914873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:17.914873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:17.914873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:17.914873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:17.914873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:17.916790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:17.918723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:17.918723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:17.918723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:17.918723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:17.918723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:17.918723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:17.918723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:17.918723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:17.918723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 15:12:17.918723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:17.918723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 282/556] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:12:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:17.919840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47f98b-991d-4d10-a180-94e547c7fa14 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:17.919840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47f98b-991d-4d10-a180-94e547c7fa14 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:17.920070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47f98b-991d-4d10-a180-94e547c7fa14 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:17.922834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 283/557] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:17.927892 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47f98b-991d-4d10-a180-94e547c7fa14 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:18.044662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:18.053782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f3c7e-ba93-44f3-be6b-b86570a55899 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:18.056378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47f98b-991d-4d10-a180-94e547c7fa14 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:18.096260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a27b8-b3df-4833-b72a-26449550dd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:18.097562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a27b8-b3df-4833-b72a-26449550dd47 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:18.097996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a27b8-b3df-4833-b72a-26449550dd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:18.098094 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c12f9-c89b-48f7-bea8-fe4bbe93c891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:18.098589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a27b8-b3df-4833-b72a-26449550dd47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:18.099359 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c12f9-c89b-48f7-bea8-fe4bbe93c891 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:18.099806 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c12f9-c89b-48f7-bea8-fe4bbe93c891 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:18.100235 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c12f9-c89b-48f7-bea8-fe4bbe93c891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:18.118416 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a27b8-b3df-4833-b72a-26449550dd47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:18.118663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c12f9-c89b-48f7-bea8-fe4bbe93c891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:18.120851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c12f9-c89b-48f7-bea8-fe4bbe93c891 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:18.120994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a27b8-b3df-4833-b72a-26449550dd47 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:18.142447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-968c12f9-c89b-48f7-bea8-fe4bbe93c891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:18.142447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:18.142447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:18.142447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:18.142447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:18.142447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:18.142447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:18.142447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:18.142447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:18.142447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:18.142447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:18.142447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:18.142447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:18.142447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:18.142447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:18.144966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:18.147221 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:18.147221 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:18.147221 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:18.147221 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:18.147596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-1f7a27b8-b3df-4833-b72a-26449550dd47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:18.147596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:18.147596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:18.147596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:18.147596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:18.147596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:18.147596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:18.147596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:18.147596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:18.147596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:18.147596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:18.147596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:18.147596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:18.147596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:18.147596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:18.149004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:18.150569 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:18.150569 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:18.150569 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:18.150569 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:18.151008 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 284/558] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:18.151131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 275/559] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:18.151238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c12f9-c89b-48f7-bea8-fe4bbe93c891 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:18.151345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17931f09-5c8a-4778-a2bb-a9a4ccf0a44d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:18.151345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17931f09-5c8a-4778-a2bb-a9a4ccf0a44d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:18.151345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17931f09-5c8a-4778-a2bb-a9a4ccf0a44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:18.176220 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-17931f09-5c8a-4778-a2bb-a9a4ccf0a44d None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:18.178110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-17931f09-5c8a-4778-a2bb-a9a4ccf0a44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:18.178785 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:18.270624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 276/560] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:18.272101 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d692649-e064-4ae2-80db-eb00c092d533 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:18.272388 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d692649-e064-4ae2-80db-eb00c092d533 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:18.272671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d692649-e064-4ae2-80db-eb00c092d533 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:18.280709 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 277/561] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:18.280709 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d692649-e064-4ae2-80db-eb00c092d533 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:18.298676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c12f9-c89b-48f7-bea8-fe4bbe93c891 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:18.342770 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead2d56-7c8e-43a4-be74-3e5833c83056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:18.343506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead2d56-7c8e-43a4-be74-3e5833c83056 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:18.343792 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead2d56-7c8e-43a4-be74-3e5833c83056 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:18.344068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead2d56-7c8e-43a4-be74-3e5833c83056 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:18.344943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead2d56-7c8e-43a4-be74-3e5833c83056 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:18.345346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead2d56-7c8e-43a4-be74-3e5833c83056 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:18.347022 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead2d56-7c8e-43a4-be74-3e5833c83056 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:18.366569 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 285/562] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Jun 27 15:12:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:18.367539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead2d56-7c8e-43a4-be74-3e5833c83056 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:18.391139 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:18.421341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d692649-e064-4ae2-80db-eb00c092d533 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:18.452103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:18.462765 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c89832-4b60-4da7-ad49-c8f188f91e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:18.463450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c89832-4b60-4da7-ad49-c8f188f91e7b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:18.463744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c89832-4b60-4da7-ad49-c8f188f91e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:18.464018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c89832-4b60-4da7-ad49-c8f188f91e7b None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:18.464754 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c89832-4b60-4da7-ad49-c8f188f91e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:18.465066 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c89832-4b60-4da7-ad49-c8f188f91e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:18.466491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c89832-4b60-4da7-ad49-c8f188f91e7b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:18.478718 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 278/563] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:18.480056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cad415-e1f7-41c4-b78f-8d8a91ae1505 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:18.480337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cad415-e1f7-41c4-b78f-8d8a91ae1505 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:18.480618 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cad415-e1f7-41c4-b78f-8d8a91ae1505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:18.484971 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead2d56-7c8e-43a4-be74-3e5833c83056 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:18.500423 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-01cad415-e1f7-41c4-b78f-8d8a91ae1505 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:18.501774 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-01cad415-e1f7-41c4-b78f-8d8a91ae1505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:18.520970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9778a-e7c3-4b88-ac43-eb830103368f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:18.521662 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9778a-e7c3-4b88-ac43-eb830103368f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:18.521949 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9778a-e7c3-4b88-ac43-eb830103368f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:18.522256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9778a-e7c3-4b88-ac43-eb830103368f None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:18.523017 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9778a-e7c3-4b88-ac43-eb830103368f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:18.523333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9778a-e7c3-4b88-ac43-eb830103368f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:18.524771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9778a-e7c3-4b88-ac43-eb830103368f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:18.537849 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 286/564] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:18.538757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9778a-e7c3-4b88-ac43-eb830103368f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:18.590328 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 279/565] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:18.590328 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cad415-e1f7-41c4-b78f-8d8a91ae1505 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:18.652009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:18.668238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9778a-e7c3-4b88-ac43-eb830103368f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:18.690336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cad415-e1f7-41c4-b78f-8d8a91ae1505 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:18.706588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:18.713867 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4f781-9e9b-43e6-84bf-028978fbaba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:18.715181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4f781-9e9b-43e6-84bf-028978fbaba0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:18.715642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4f781-9e9b-43e6-84bf-028978fbaba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:18.716132 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4f781-9e9b-43e6-84bf-028978fbaba0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:18.731844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4f781-9e9b-43e6-84bf-028978fbaba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:18.741081 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf688615-3d04-4dfa-867d-d9fc7ec7df43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:18.742084 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf688615-3d04-4dfa-867d-d9fc7ec7df43 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:18.742573 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf688615-3d04-4dfa-867d-d9fc7ec7df43 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:18.743020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf688615-3d04-4dfa-867d-d9fc7ec7df43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:18.745834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-cde4f781-9e9b-43e6-84bf-028978fbaba0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:18.745834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:18.745834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:18.745834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:18.745834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:18.745834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:18.745834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:18.745834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:18.745834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:18.745834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:18.745834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:18.745834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:18.745834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:18.745834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:18.745834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:18.745834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:18.746836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:18.746836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:18.746836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:18.746836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:18.746836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:18.746836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:18.746836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:18.746836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:18.746836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:18.746836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:18.746836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:18.746836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:18.746836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:18.746836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:18.746836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:18.746836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:18.747664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:18.747664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:18.747664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:18.747664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:18.747664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:18.747664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:18.747664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:18.747664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:18.747664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:18.747664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:18.747664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:18.747664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:18.747664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 287/566] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:18.748913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4f781-9e9b-43e6-84bf-028978fbaba0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:18.820776 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf688615-3d04-4dfa-867d-d9fc7ec7df43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:18.822300 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf688615-3d04-4dfa-867d-d9fc7ec7df43 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:18.854029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4f781-9e9b-43e6-84bf-028978fbaba0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:18.887806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:18.892301 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e69ff5-7a0a-4544-8ea8-1c8bc9e9ac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:18.893395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e69ff5-7a0a-4544-8ea8-1c8bc9e9ac08 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:18.893804 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e69ff5-7a0a-4544-8ea8-1c8bc9e9ac08 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:18.894200 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e69ff5-7a0a-4544-8ea8-1c8bc9e9ac08 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:18.902518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e69ff5-7a0a-4544-8ea8-1c8bc9e9ac08 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:18.903984 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e69ff5-7a0a-4544-8ea8-1c8bc9e9ac08 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:18.918955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-22e69ff5-7a0a-4544-8ea8-1c8bc9e9ac08 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 27 15:12:18.918955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:18.918955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:18.918955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:18.918955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:18.918955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:18.918955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:18.918955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:18.918955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:18.918955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:18.918955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:18.918955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:18.918955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:18.918955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:18.918955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:18.918955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:18.920814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:18.922702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:18.922702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:18.922702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:18.922702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:18.922702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:18.922702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:18.922702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:18.922702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:18.922702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 27 15:12:18.922702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:18.922702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 288/567] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:12:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:18.922702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e69ff5-7a0a-4544-8ea8-1c8bc9e9ac08 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:18.931311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 280/568] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:12:18.932174 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf688615-3d04-4dfa-867d-d9fc7ec7df43 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:18.984015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:19.049733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e69ff5-7a0a-4544-8ea8-1c8bc9e9ac08 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:19.052994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf688615-3d04-4dfa-867d-d9fc7ec7df43 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:19.088012 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987f7c9-50cc-41b1-be8f-74bf9f44bd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:19.088881 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987f7c9-50cc-41b1-be8f-74bf9f44bd93 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:19.089113 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987f7c9-50cc-41b1-be8f-74bf9f44bd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:19.089387 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987f7c9-50cc-41b1-be8f-74bf9f44bd93 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:19.091291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a3afd-1f4e-449f-b2cf-8b19e0cc3ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:19.092117 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a3afd-1f4e-449f-b2cf-8b19e0cc3ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:19.092413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a3afd-1f4e-449f-b2cf-8b19e0cc3ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:19.092683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a3afd-1f4e-449f-b2cf-8b19e0cc3ef0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:19.098941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987f7c9-50cc-41b1-be8f-74bf9f44bd93 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:19.100463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987f7c9-50cc-41b1-be8f-74bf9f44bd93 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:19.104988 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a3afd-1f4e-449f-b2cf-8b19e0cc3ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:19.113269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-202a3afd-1f4e-449f-b2cf-8b19e0cc3ef0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:19.113269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:19.113269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:19.113269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:19.113269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:19.113269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:19.113269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:19.113269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:19.113269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:19.113269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:19.113269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:19.113269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:19.113269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:19.113269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:19.113269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:19.113269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:19.115128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:19.115128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:19.115128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:19.115128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:19.115128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:19.115128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:19.115128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:19.115128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:19.115128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:19.115128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:19.115128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:19.115128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:19.115128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:19.115128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:19.115128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:19.115128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:19.116806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:19.116806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:19.116806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:19.116806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:19.116806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:19.116806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:19.116806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:19.116806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:19.116806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:19.116806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:19.116806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:19.116806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:19.116806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 281/569] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:19.116806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a3afd-1f4e-449f-b2cf-8b19e0cc3ef0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:19.119665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e987f7c9-50cc-41b1-be8f-74bf9f44bd93 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:12:19.119665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:19.119665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:19.119665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:19.119665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:19.119665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:19.119665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:19.119665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:19.119665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:19.119665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:19.119665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:19.119665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:19.119665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:19.119665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:19.119665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:19.119665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:19.121982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:19.124293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:19.124293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:19.124293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:19.124293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:19.124293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:19.124293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:19.124293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:19.124293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:19.124293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:12:19.124293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:19.124293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 289/570] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 27 15:12:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:19.124293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987f7c9-50cc-41b1-be8f-74bf9f44bd93 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:19.151356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:19.228009 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987f7c9-50cc-41b1-be8f-74bf9f44bd93 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:19.233818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a3afd-1f4e-449f-b2cf-8b19e0cc3ef0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:19.241681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:19.266083 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d11a2-fb11-41cb-b194-2c565f44573f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:19.267114 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d11a2-fb11-41cb-b194-2c565f44573f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:19.267498 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d11a2-fb11-41cb-b194-2c565f44573f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:19.267925 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d11a2-fb11-41cb-b194-2c565f44573f None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:19.269019 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d11a2-fb11-41cb-b194-2c565f44573f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:19.269400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d11a2-fb11-41cb-b194-2c565f44573f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:19.270962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d11a2-fb11-41cb-b194-2c565f44573f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:19.272189 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e5b6a-14a9-4fca-bcd5-7187f2d2fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:19.272927 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e5b6a-14a9-4fca-bcd5-7187f2d2fb33 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:19.273215 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e5b6a-14a9-4fca-bcd5-7187f2d2fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:19.273491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e5b6a-14a9-4fca-bcd5-7187f2d2fb33 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:19.274279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e5b6a-14a9-4fca-bcd5-7187f2d2fb33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:19.274590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e5b6a-14a9-4fca-bcd5-7187f2d2fb33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:19.275970 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e5b6a-14a9-4fca-bcd5-7187f2d2fb33 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:19.285070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 282/571] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:19.285922 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e5b6a-14a9-4fca-bcd5-7187f2d2fb33 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:19.299119 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 290/572] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Jun 27 15:12:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:19.299119 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d11a2-fb11-41cb-b194-2c565f44573f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:19.379544 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:19.394858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e5b6a-14a9-4fca-bcd5-7187f2d2fb33 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:19.408565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d11a2-fb11-41cb-b194-2c565f44573f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:19.432056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ff300-501c-4a44-843c-21acbd350ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:19.432954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ff300-501c-4a44-843c-21acbd350ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:19.433358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ff300-501c-4a44-843c-21acbd350ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:19.433636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ff300-501c-4a44-843c-21acbd350ac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:19.447141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ff300-501c-4a44-843c-21acbd350ac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:19.448377 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28163ff-77ec-4690-9864-4533a53a2bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:19.448634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ff300-501c-4a44-843c-21acbd350ac2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:19.449062 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28163ff-77ec-4690-9864-4533a53a2bde None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:19.449360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28163ff-77ec-4690-9864-4533a53a2bde None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:19.449635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28163ff-77ec-4690-9864-4533a53a2bde None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:19.450511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28163ff-77ec-4690-9864-4533a53a2bde None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:19.450839 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28163ff-77ec-4690-9864-4533a53a2bde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:19.452276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28163ff-77ec-4690-9864-4533a53a2bde None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:19.467029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d21ff300-501c-4a44-843c-21acbd350ac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:19.467029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:19.467029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:19.467029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:19.467029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:19.467029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:19.467029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:19.467029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:19.467029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:19.467029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:19.467029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:19.467029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:19.467029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:19.467029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:19.467029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:19.475685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:19.477772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:19.477772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:19.477772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:19.477772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:19.477772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 283/573] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:19.477772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ff300-501c-4a44-843c-21acbd350ac2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:19.478454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 291/574] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 27 15:12:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:19.478454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28163ff-77ec-4690-9864-4533a53a2bde None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:19.515433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:19.627710 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28163ff-77ec-4690-9864-4533a53a2bde None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:19.628027 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ff300-501c-4a44-843c-21acbd350ac2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:19.664563 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf733ca-03e8-47ba-9429-4042f5e7c8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:19.665629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf733ca-03e8-47ba-9429-4042f5e7c8fe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:19.665629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf733ca-03e8-47ba-9429-4042f5e7c8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:19.665971 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf733ca-03e8-47ba-9429-4042f5e7c8fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:19.667099 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e2f5e-f41d-40d4-8291-f689c8e4fc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:19.667978 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e2f5e-f41d-40d4-8291-f689c8e4fc30 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:19.668355 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e2f5e-f41d-40d4-8291-f689c8e4fc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:19.668809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e2f5e-f41d-40d4-8291-f689c8e4fc30 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:19.669692 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e2f5e-f41d-40d4-8291-f689c8e4fc30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:19.670050 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e2f5e-f41d-40d4-8291-f689c8e4fc30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:19.671545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e2f5e-f41d-40d4-8291-f689c8e4fc30 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:19.677494 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf733ca-03e8-47ba-9429-4042f5e7c8fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:19.678991 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf733ca-03e8-47ba-9429-4042f5e7c8fe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:19.681728 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 284/575] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:19.683193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e2f5e-f41d-40d4-8291-f689c8e4fc30 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:19.687545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:19.707057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ecf733ca-03e8-47ba-9429-4042f5e7c8fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:19.707057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:19.707057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:19.707057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:19.707057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:19.707057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:19.707057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:19.707057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:19.707057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:19.707057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:19.707057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:19.707057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:19.707057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:19.707057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:19.707057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:19.708244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:19.709262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:19.709262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:19.709262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:19.709262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:19.709496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 292/576] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:19.710778 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf733ca-03e8-47ba-9429-4042f5e7c8fe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:19.796673 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e2f5e-f41d-40d4-8291-f689c8e4fc30 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:19.800009 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:19.822195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf733ca-03e8-47ba-9429-4042f5e7c8fe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:19.834430 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb898f-d41e-4bbd-b08a-ca07077ebf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:19.835248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb898f-d41e-4bbd-b08a-ca07077ebf28 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:19.835531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb898f-d41e-4bbd-b08a-ca07077ebf28 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:19.835831 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb898f-d41e-4bbd-b08a-ca07077ebf28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:19.848410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb898f-d41e-4bbd-b08a-ca07077ebf28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:19.850278 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb898f-d41e-4bbd-b08a-ca07077ebf28 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:19.859729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d65ce5-bb7e-4091-9e0b-6eb228934cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:19.860410 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d65ce5-bb7e-4091-9e0b-6eb228934cfd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:19.860768 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d65ce5-bb7e-4091-9e0b-6eb228934cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:19.861045 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d65ce5-bb7e-4091-9e0b-6eb228934cfd None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:19.861783 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d65ce5-bb7e-4091-9e0b-6eb228934cfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:19.862098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d65ce5-bb7e-4091-9e0b-6eb228934cfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:19.863531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d65ce5-bb7e-4091-9e0b-6eb228934cfd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:19.869861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-79cb898f-d41e-4bbd-b08a-ca07077ebf28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:19.869861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:19.869861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:19.869861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:19.869861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:19.869861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:19.869861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:19.869861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:19.869861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:19.869861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:19.869861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:19.869861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:19.869861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:19.869861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:19.869861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:19.870974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:19.872371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:19.872371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:19.872371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:19.872371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:19.872371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 285/577] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:19.872371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb898f-d41e-4bbd-b08a-ca07077ebf28 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:19.884064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 293/578] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:19.884064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d65ce5-bb7e-4091-9e0b-6eb228934cfd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:19.930544 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:19.985504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb898f-d41e-4bbd-b08a-ca07077ebf28 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:19.998029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d65ce5-bb7e-4091-9e0b-6eb228934cfd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:20.025706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f7d2-b8e1-43d9-9603-02c039e9e129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:20.026753 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f7d2-b8e1-43d9-9603-02c039e9e129 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:20.027147 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f7d2-b8e1-43d9-9603-02c039e9e129 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:20.027518 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f7d2-b8e1-43d9-9603-02c039e9e129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:20.038144 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e3cc-50f2-4a3c-b7fa-3c3ee48726c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:20.039127 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e3cc-50f2-4a3c-b7fa-3c3ee48726c1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:20.039565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e3cc-50f2-4a3c-b7fa-3c3ee48726c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:20.039904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e3cc-50f2-4a3c-b7fa-3c3ee48726c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:20.040743 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845f7d2-b8e1-43d9-9603-02c039e9e129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:20.042490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845f7d2-b8e1-43d9-9603-02c039e9e129 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:20.050399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:20.053800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0e3cc-50f2-4a3c-b7fa-3c3ee48726c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:20.056329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0e3cc-50f2-4a3c-b7fa-3c3ee48726c1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:20.063889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2845f7d2-b8e1-43d9-9603-02c039e9e129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:20.063889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:20.063889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:20.063889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:20.063889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:20.063889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:20.063889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:20.063889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:20.063889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:20.063889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:20.063889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:20.063889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:20.063889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:20.063889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:20.063889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:20.065824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:20.067832 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:20.067832 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:20.067832 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:20.067832 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:20.067832 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 286/579] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:20.068436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f7d2-b8e1-43d9-9603-02c039e9e129 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:20.082630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e2e0e3cc-50f2-4a3c-b7fa-3c3ee48726c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:20.082630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:20.082630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:20.082630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:20.082630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:20.082630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:20.082630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:20.082630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:20.082630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:20.082630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:20.082630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:20.082630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:20.082630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:20.082630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:20.082630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:20.084347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:20.086312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:20.086312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:20.086312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:20.086312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:20.086312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 294/580] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:20.086312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e3cc-50f2-4a3c-b7fa-3c3ee48726c1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:20.213519 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f7d2-b8e1-43d9-9603-02c039e9e129 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:20.221648 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e3cc-50f2-4a3c-b7fa-3c3ee48726c1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:20.223031 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:20.255544 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9c525-c223-42f8-9ed1-13008f12a84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:20.256392 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9c525-c223-42f8-9ed1-13008f12a84d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:20.256699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9c525-c223-42f8-9ed1-13008f12a84d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:20.257025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9c525-c223-42f8-9ed1-13008f12a84d None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:20.257898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9c525-c223-42f8-9ed1-13008f12a84d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:20.258371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9c525-c223-42f8-9ed1-13008f12a84d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:20.259922 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9c525-c223-42f8-9ed1-13008f12a84d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:20.266406 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4e7ea-ad74-4019-9580-0cf6098a2f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:20.269176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4e7ea-ad74-4019-9580-0cf6098a2f3a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:20.269176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4e7ea-ad74-4019-9580-0cf6098a2f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:20.269176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4e7ea-ad74-4019-9580-0cf6098a2f3a None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:20.269176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4e7ea-ad74-4019-9580-0cf6098a2f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:20.269176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4e7ea-ad74-4019-9580-0cf6098a2f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:20.270337 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4e7ea-ad74-4019-9580-0cf6098a2f3a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:20.285872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 287/581] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:20.285872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9c525-c223-42f8-9ed1-13008f12a84d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:20.286345 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 295/582] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:20.286345 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4e7ea-ad74-4019-9580-0cf6098a2f3a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:20.342398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:20.402285 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4e7ea-ad74-4019-9580-0cf6098a2f3a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:20.419341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9c525-c223-42f8-9ed1-13008f12a84d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:20.464057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8e1c1-1517-48b0-8e30-0b67ce25ad89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:20.465125 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8e1c1-1517-48b0-8e30-0b67ce25ad89 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:20.465628 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8e1c1-1517-48b0-8e30-0b67ce25ad89 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:20.466116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8e1c1-1517-48b0-8e30-0b67ce25ad89 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:20.467526 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8e1c1-1517-48b0-8e30-0b67ce25ad89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:20.468078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8e1c1-1517-48b0-8e30-0b67ce25ad89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:20.470787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8e1c1-1517-48b0-8e30-0b67ce25ad89 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:20.478009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25863fe2-8941-47c4-bacb-d4a29e1e310a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:20.478873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863fe2-8941-47c4-bacb-d4a29e1e310a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:20.479149 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863fe2-8941-47c4-bacb-d4a29e1e310a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:20.479424 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863fe2-8941-47c4-bacb-d4a29e1e310a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:20.487860 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25863fe2-8941-47c4-bacb-d4a29e1e310a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:20.489693 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25863fe2-8941-47c4-bacb-d4a29e1e310a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:20.500433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 296/583] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:20.500433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8e1c1-1517-48b0-8e30-0b67ce25ad89 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:20.510653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-25863fe2-8941-47c4-bacb-d4a29e1e310a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:20.510653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:20.510653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:20.510653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:20.510653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:20.510653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:20.510653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:20.510653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:20.510653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:20.510653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:20.510653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:20.510653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:20.510653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:20.510653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:20.510653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:20.512598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:20.514648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:20.514648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:20.514648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:20.514648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:20.514648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:20.514648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:20.514648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:20.514648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:20.514648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 288/584] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:20.515990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25863fe2-8941-47c4-bacb-d4a29e1e310a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:20.563249 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:20.612239 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8e1c1-1517-48b0-8e30-0b67ce25ad89 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:20.627579 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:20.651933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cbe51-5026-4b36-a1cf-fa580bcfaa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:20.652647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cbe51-5026-4b36-a1cf-fa580bcfaa47 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:20.652934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cbe51-5026-4b36-a1cf-fa580bcfaa47 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:20.653213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cbe51-5026-4b36-a1cf-fa580bcfaa47 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:20.653994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cbe51-5026-4b36-a1cf-fa580bcfaa47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:20.654344 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cbe51-5026-4b36-a1cf-fa580bcfaa47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:20.655834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cbe51-5026-4b36-a1cf-fa580bcfaa47 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:20.658069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25863fe2-8941-47c4-bacb-d4a29e1e310a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:20.675994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 297/585] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:20.675994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cbe51-5026-4b36-a1cf-fa580bcfaa47 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:20.710101 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bdc5a-f591-4b5f-bf52-7239118013a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:20.710992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bdc5a-f591-4b5f-bf52-7239118013a9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:20.711282 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bdc5a-f591-4b5f-bf52-7239118013a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:20.711561 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bdc5a-f591-4b5f-bf52-7239118013a9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:20.720289 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bdc5a-f591-4b5f-bf52-7239118013a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:20.721706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bdc5a-f591-4b5f-bf52-7239118013a9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:20.738624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ae3bdc5a-f591-4b5f-bf52-7239118013a9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 15:12:20.738624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:20.738624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:20.738624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:20.738624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:20.738624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:20.738624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:20.738624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:20.738624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:20.738624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:20.738624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:20.738624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:20.738624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:20.738624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:20.738624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:20.738624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:20.740705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:20.743666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:20.743666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:20.743666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:20.743666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:20.743666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:20.743666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:20.743666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:20.743666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:20.743666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 15:12:20.743666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:20.743666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 289/586] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:12:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:20.743666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bdc5a-f591-4b5f-bf52-7239118013a9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:20.803466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cbe51-5026-4b36-a1cf-fa580bcfaa47 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:20.838378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:20.847590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2feef7f-8580-4361-a5a5-012911cb75d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:20.848415 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2feef7f-8580-4361-a5a5-012911cb75d9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:20.848696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2feef7f-8580-4361-a5a5-012911cb75d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:20.848970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2feef7f-8580-4361-a5a5-012911cb75d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:20.855219 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bdc5a-f591-4b5f-bf52-7239118013a9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:20.856702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2feef7f-8580-4361-a5a5-012911cb75d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:20.858185 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2feef7f-8580-4361-a5a5-012911cb75d9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:20.884215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a2feef7f-8580-4361-a5a5-012911cb75d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:20.884215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:20.884215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:20.884215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:20.884215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:20.884215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:20.884215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:20.884215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:20.884215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:20.884215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:20.884215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:20.884215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:20.884215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:20.884215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:20.884215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:20.885400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:20.886485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:20.886485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:20.886485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:20.886485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:20.886485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:20.886485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:20.886485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:20.886485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:20.886485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 298/587] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:20.887917 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2feef7f-8580-4361-a5a5-012911cb75d9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:20.895833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01d6da-8856-451a-a4a1-a08b03e9ea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:20.896658 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01d6da-8856-451a-a4a1-a08b03e9ea22 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:20.896937 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01d6da-8856-451a-a4a1-a08b03e9ea22 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:20.897214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01d6da-8856-451a-a4a1-a08b03e9ea22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:20.904535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01d6da-8856-451a-a4a1-a08b03e9ea22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:20.905990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01d6da-8856-451a-a4a1-a08b03e9ea22 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:20.921442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-de01d6da-8856-451a-a4a1-a08b03e9ea22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:20.921442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:20.921442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:20.921442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:20.921442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:20.921442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:20.921442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:20.921442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:20.921442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:20.921442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:20.921442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:20.921442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:20.921442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:20.921442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:20.921442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:20.929867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:20.931206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:20.931206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:20.931206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:20.931206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:20.931206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:20.931206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:20.931206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:20.931206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:20.931206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 290/588] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:20.931206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01d6da-8856-451a-a4a1-a08b03e9ea22 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:20.938455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:21.014458 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2feef7f-8580-4361-a5a5-012911cb75d9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:21.053264 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d9b53-f763-47a7-ace8-80d9eca46cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:21.053955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d9b53-f763-47a7-ace8-80d9eca46cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:21.054261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d9b53-f763-47a7-ace8-80d9eca46cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:21.054534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d9b53-f763-47a7-ace8-80d9eca46cb0 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:21.055344 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d9b53-f763-47a7-ace8-80d9eca46cb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:21.056020 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d9b53-f763-47a7-ace8-80d9eca46cb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:21.056123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01d6da-8856-451a-a4a1-a08b03e9ea22 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:21.057488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d9b53-f763-47a7-ace8-80d9eca46cb0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:21.072070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 299/589] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:21.073041 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d9b53-f763-47a7-ace8-80d9eca46cb0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:21.100275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de55c0-0b9d-44b8-bdc7-81b665374a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:21.101165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de55c0-0b9d-44b8-bdc7-81b665374a26 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:21.101597 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de55c0-0b9d-44b8-bdc7-81b665374a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:21.101956 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de55c0-0b9d-44b8-bdc7-81b665374a26 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:21.114794 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de55c0-0b9d-44b8-bdc7-81b665374a26 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:21.117272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de55c0-0b9d-44b8-bdc7-81b665374a26 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:21.139346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-24de55c0-0b9d-44b8-bdc7-81b665374a26 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 15:12:21.139346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:21.139346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:21.139346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:21.139346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:21.139346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:21.139346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:21.139346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:21.139346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:21.139346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:21.139346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:21.139346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:21.139346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:21.139346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:21.139346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:21.139346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:21.141345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:21.143465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:21.143465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:21.143465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:21.143465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:21.143465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:21.143465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:21.143465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:21.143465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:21.143465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 15:12:21.143465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:21.143465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 291/590] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:21.143465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de55c0-0b9d-44b8-bdc7-81b665374a26 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:21.151277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:21.198569 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:21.210132 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d9b53-f763-47a7-ace8-80d9eca46cb0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:21.253064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63471abc-615b-41eb-a11a-79834020df4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:21.254133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63471abc-615b-41eb-a11a-79834020df4f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:21.254691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63471abc-615b-41eb-a11a-79834020df4f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:21.255184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63471abc-615b-41eb-a11a-79834020df4f None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:21.256366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63471abc-615b-41eb-a11a-79834020df4f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:21.256928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63471abc-615b-41eb-a11a-79834020df4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:21.258695 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de55c0-0b9d-44b8-bdc7-81b665374a26 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:21.259701 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63471abc-615b-41eb-a11a-79834020df4f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:21.291482 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 300/591] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Jun 27 15:12:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:21.292699 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63471abc-615b-41eb-a11a-79834020df4f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:21.302633 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10566495-9938-4430-a865-b254133da0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:21.303568 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10566495-9938-4430-a865-b254133da0fd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:21.303967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10566495-9938-4430-a865-b254133da0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:21.304418 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10566495-9938-4430-a865-b254133da0fd None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:21.305465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10566495-9938-4430-a865-b254133da0fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:21.306390 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10566495-9938-4430-a865-b254133da0fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:21.308379 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10566495-9938-4430-a865-b254133da0fd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:21.331830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 292/592] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:21.331830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10566495-9938-4430-a865-b254133da0fd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:21.420942 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63471abc-615b-41eb-a11a-79834020df4f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:21.427915 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:21.459947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b8070-c92b-44df-80cd-9ecfacee83ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:21.460623 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b8070-c92b-44df-80cd-9ecfacee83ce None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:21.460906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b8070-c92b-44df-80cd-9ecfacee83ce None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:21.461187 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b8070-c92b-44df-80cd-9ecfacee83ce None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:21.461979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b8070-c92b-44df-80cd-9ecfacee83ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:21.462317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b8070-c92b-44df-80cd-9ecfacee83ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:21.463769 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b8070-c92b-44df-80cd-9ecfacee83ce None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:21.477331 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 301/593] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:21.478021 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b8070-c92b-44df-80cd-9ecfacee83ce None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:21.488907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10566495-9938-4430-a865-b254133da0fd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:21.503812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:21.540786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ea07b-f491-4399-9cf9-309554e53521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:21.541664 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea07b-f491-4399-9cf9-309554e53521 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:21.541948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea07b-f491-4399-9cf9-309554e53521 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:21.542320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea07b-f491-4399-9cf9-309554e53521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:21.543446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ea07b-f491-4399-9cf9-309554e53521 None admin] RBAC: Adding query filter params (role.id=c5b95b7a83d94e99a828c836efe01929, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=0e419f9caf0a4ccb8108d375f527006e) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:21.543848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ea07b-f491-4399-9cf9-309554e53521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:21.545453 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ea07b-f491-4399-9cf9-309554e53521 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:21.551908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 293/594] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:12:21 2022] GET /identity/v3/role_assignments?user.id=0e419f9caf0a4ccb8108d375f527006e&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=c5b95b7a83d94e99a828c836efe01929 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:21.552762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ea07b-f491-4399-9cf9-309554e53521 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:21.617935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b8070-c92b-44df-80cd-9ecfacee83ce None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:21.668913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a41ea-454f-4fb5-8faf-1efbe746e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:21.669624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a41ea-454f-4fb5-8faf-1efbe746e199 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:21.669908 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a41ea-454f-4fb5-8faf-1efbe746e199 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:21.670199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a41ea-454f-4fb5-8faf-1efbe746e199 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:21.671111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a41ea-454f-4fb5-8faf-1efbe746e199 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:21.671435 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a41ea-454f-4fb5-8faf-1efbe746e199 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:21.673153 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a41ea-454f-4fb5-8faf-1efbe746e199 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:21.685876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ea07b-f491-4399-9cf9-309554e53521 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:21.696407 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 302/595] 10.222.0.33 () {56 vars in 1139 bytes} [Mon Jun 27 15:12:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:21.697600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a41ea-454f-4fb5-8faf-1efbe746e199 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:21.726832 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:21.733123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715db02-d3c4-4582-b85a-265596ee9bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:21.733960 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715db02-d3c4-4582-b85a-265596ee9bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:21.734242 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715db02-d3c4-4582-b85a-265596ee9bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:21.734525 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715db02-d3c4-4582-b85a-265596ee9bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:21.748830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715db02-d3c4-4582-b85a-265596ee9bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:21.750372 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715db02-d3c4-4582-b85a-265596ee9bc1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:21.772287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4715db02-d3c4-4582-b85a-265596ee9bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:21.772287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:21.772287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:21.772287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:21.772287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:21.772287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:21.772287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:21.772287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:21.772287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:21.772287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:21.772287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:21.772287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:21.772287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:21.772287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:21.772287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:21.773269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:21.774155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:21.774155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:21.774155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:21.774155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:21.774430 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 294/596] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:21.775112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715db02-d3c4-4582-b85a-265596ee9bc1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:21.784365 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:21.834436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a41ea-454f-4fb5-8faf-1efbe746e199 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:21.877960 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5f203-32f6-43fb-9ef2-762993ef4752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:21.878909 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5f203-32f6-43fb-9ef2-762993ef4752 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:21.879200 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5f203-32f6-43fb-9ef2-762993ef4752 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:21.879791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5f203-32f6-43fb-9ef2-762993ef4752 None admin] PATH_INFO: `/v3/projects/3f8ec287061141028659ab504e7707de/users/f18acfb35dfe41a1aeb50c702bd1942b/roles/c5b95b7a83d94e99a828c836efe01929` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:21.895762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5f203-32f6-43fb-9ef2-762993ef4752 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f8ec287061141028659ab504e7707de, user_id=f18acfb35dfe41a1aeb50c702bd1942b, role_id=c5b95b7a83d94e99a828c836efe01929)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:21.897235 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5f203-32f6-43fb-9ef2-762993ef4752 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:21.918269 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 303/597] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:12:21 2022] PUT /identity/v3/projects/3f8ec287061141028659ab504e7707de/users/f18acfb35dfe41a1aeb50c702bd1942b/roles/c5b95b7a83d94e99a828c836efe01929 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:12:21.919184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5f203-32f6-43fb-9ef2-762993ef4752 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:21.959910 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715db02-d3c4-4582-b85a-265596ee9bc1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:22.024689 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdaf316-3ba7-43fa-907e-ba3d142d8011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:22.025954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaf316-3ba7-43fa-907e-ba3d142d8011 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:22.026477 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaf316-3ba7-43fa-907e-ba3d142d8011 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:22.026811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaf316-3ba7-43fa-907e-ba3d142d8011 None admin] PATH_INFO: `/v3/projects/3f8ec287061141028659ab504e7707de/users/37a36c30e9dc472d97d762d236dd865a/roles/c5b95b7a83d94e99a828c836efe01929` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:22.052168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdaf316-3ba7-43fa-907e-ba3d142d8011 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f8ec287061141028659ab504e7707de, user_id=37a36c30e9dc472d97d762d236dd865a, role_id=c5b95b7a83d94e99a828c836efe01929)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:22.054155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdaf316-3ba7-43fa-907e-ba3d142d8011 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:22.064320 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5f203-32f6-43fb-9ef2-762993ef4752 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:22.077975 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 295/598] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:12:21 2022] PUT /identity/v3/projects/3f8ec287061141028659ab504e7707de/users/37a36c30e9dc472d97d762d236dd865a/roles/c5b95b7a83d94e99a828c836efe01929 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:12:22.080237 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdaf316-3ba7-43fa-907e-ba3d142d8011 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:22.099015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:22.150338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:22.152779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03448ef5-b7ce-4acc-9c8a-e675738b4494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:22.154014 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03448ef5-b7ce-4acc-9c8a-e675738b4494 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:22.154520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03448ef5-b7ce-4acc-9c8a-e675738b4494 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:22.154973 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03448ef5-b7ce-4acc-9c8a-e675738b4494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:22.179917 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03448ef5-b7ce-4acc-9c8a-e675738b4494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:22.182497 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03448ef5-b7ce-4acc-9c8a-e675738b4494 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:22.207450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-03448ef5-b7ce-4acc-9c8a-e675738b4494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:22.207450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:22.207450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:22.207450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:22.207450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:22.207450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:22.207450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:22.207450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:22.207450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:22.207450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:22.207450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:22.207450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:22.207450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:22.207450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:22.207450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:22.208436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:22.209322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:22.209322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:22.209322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:22.209322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:22.209322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 304/599] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:22.216935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03448ef5-b7ce-4acc-9c8a-e675738b4494 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:22.272880 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdaf316-3ba7-43fa-907e-ba3d142d8011 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:22.351416 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5ad77-65d5-4338-8b1f-c717b4efbb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:22.352011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ad77-65d5-4338-8b1f-c717b4efbb79 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:22.352295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ad77-65d5-4338-8b1f-c717b4efbb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:22.352625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ad77-65d5-4338-8b1f-c717b4efbb79 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:22.353433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5ad77-65d5-4338-8b1f-c717b4efbb79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:22.353738 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5ad77-65d5-4338-8b1f-c717b4efbb79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:22.355405 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5ad77-65d5-4338-8b1f-c717b4efbb79 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:22.370506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03448ef5-b7ce-4acc-9c8a-e675738b4494 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:22.375559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 296/600] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:22.378301 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5ad77-65d5-4338-8b1f-c717b4efbb79 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:22.443591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f8435-d5bc-473d-9645-ba0daa1d774c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:22.445192 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f8435-d5bc-473d-9645-ba0daa1d774c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:22.446002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f8435-d5bc-473d-9645-ba0daa1d774c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:22.446763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f8435-d5bc-473d-9645-ba0daa1d774c None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:22.448310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f8435-d5bc-473d-9645-ba0daa1d774c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:22.449089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f8435-d5bc-473d-9645-ba0daa1d774c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:22.452692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f8435-d5bc-473d-9645-ba0daa1d774c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:22.475132 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 305/601] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:22.486271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f8435-d5bc-473d-9645-ba0daa1d774c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:22.541342 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:22.566816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5ad77-65d5-4338-8b1f-c717b4efbb79 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:22.582640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:22.619983 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda75c9b-dcca-4fb6-adbb-f1afdb0500f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:22.620788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda75c9b-dcca-4fb6-adbb-f1afdb0500f9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:22.621139 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda75c9b-dcca-4fb6-adbb-f1afdb0500f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:22.621426 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda75c9b-dcca-4fb6-adbb-f1afdb0500f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:22.638174 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda75c9b-dcca-4fb6-adbb-f1afdb0500f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:22.639727 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda75c9b-dcca-4fb6-adbb-f1afdb0500f9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:22.662388 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f8435-d5bc-473d-9645-ba0daa1d774c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:22.682654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-eda75c9b-dcca-4fb6-adbb-f1afdb0500f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:22.682654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:22.682654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:22.682654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:22.682654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:22.682654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:22.682654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:22.682654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:22.682654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:22.682654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:22.682654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:22.682654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:22.682654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:22.682654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:22.682654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:22.683688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:22.684576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:22.684576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:22.684576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:22.684576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:22.684576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:22.684576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:22.684576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:22.684576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:22.685448 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 297/602] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:12:22.695484 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda75c9b-dcca-4fb6-adbb-f1afdb0500f9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:22.724167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb92f25-7661-4fca-b6ba-0ce38660b339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:22.725239 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb92f25-7661-4fca-b6ba-0ce38660b339 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:22.727390 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb92f25-7661-4fca-b6ba-0ce38660b339 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:22.727745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb92f25-7661-4fca-b6ba-0ce38660b339 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:22.746236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb92f25-7661-4fca-b6ba-0ce38660b339 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:22.747780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb92f25-7661-4fca-b6ba-0ce38660b339 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:22.782906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1eb92f25-7661-4fca-b6ba-0ce38660b339 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:22.782906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:22.782906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:22.782906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:22.782906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:22.782906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:22.782906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:22.782906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:22.782906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:22.782906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:22.782906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:22.782906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:22.782906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:22.782906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:22.782906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:22.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:22.784872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:22.784872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:22.784872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:22.784872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:22.784872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:22.784872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:22.784872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:22.784872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:22.785766 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 306/603] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:12:22.793544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb92f25-7661-4fca-b6ba-0ce38660b339 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:22.916666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda75c9b-dcca-4fb6-adbb-f1afdb0500f9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:23.012189 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf9b80-732c-4e20-96de-b7cee0f33c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:23.013868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf9b80-732c-4e20-96de-b7cee0f33c2d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:23.014735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf9b80-732c-4e20-96de-b7cee0f33c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:23.015587 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf9b80-732c-4e20-96de-b7cee0f33c2d None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:23.022333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf9b80-732c-4e20-96de-b7cee0f33c2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:23.023466 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf9b80-732c-4e20-96de-b7cee0f33c2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:23.026775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf9b80-732c-4e20-96de-b7cee0f33c2d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:23.060373 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 298/604] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:23.066141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf9b80-732c-4e20-96de-b7cee0f33c2d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:23.073803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:23.089004 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb92f25-7661-4fca-b6ba-0ce38660b339 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:23.101470 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:23.149094 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d1585-eca1-4bdd-9151-d14adec8b526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:23.153794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d1585-eca1-4bdd-9151-d14adec8b526 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:23.157447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d1585-eca1-4bdd-9151-d14adec8b526 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:23.158119 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d1585-eca1-4bdd-9151-d14adec8b526 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:23.160509 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d1585-eca1-4bdd-9151-d14adec8b526 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:23.161866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d1585-eca1-4bdd-9151-d14adec8b526 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:23.163624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d1585-eca1-4bdd-9151-d14adec8b526 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:23.187409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 307/605] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:23.197939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d1585-eca1-4bdd-9151-d14adec8b526 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:23.336640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d1585-eca1-4bdd-9151-d14adec8b526 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:23.397784 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf9b80-732c-4e20-96de-b7cee0f33c2d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:23.461845 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534aaf0-0412-4b09-8cf9-82019acbb891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:23.463521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534aaf0-0412-4b09-8cf9-82019acbb891 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:23.464015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534aaf0-0412-4b09-8cf9-82019acbb891 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:23.464504 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534aaf0-0412-4b09-8cf9-82019acbb891 None admin] PATH_INFO: `/v3/projects/3f8ec287061141028659ab504e7707de/users/67dbb53f47ca406c96377408e9f893f2/roles/c5b95b7a83d94e99a828c836efe01929` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:23.492974 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534aaf0-0412-4b09-8cf9-82019acbb891 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f8ec287061141028659ab504e7707de, user_id=67dbb53f47ca406c96377408e9f893f2, role_id=c5b95b7a83d94e99a828c836efe01929)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:23.495825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534aaf0-0412-4b09-8cf9-82019acbb891 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:23.515833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16467bce-abac-4e3c-ba1e-e7d78e430711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:23.516820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467bce-abac-4e3c-ba1e-e7d78e430711 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:23.517121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467bce-abac-4e3c-ba1e-e7d78e430711 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:23.517394 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467bce-abac-4e3c-ba1e-e7d78e430711 None admin] PATH_INFO: `/v3/projects/3f8ec287061141028659ab504e7707de/users/0dccf96088954218a4fb8d7b466f970f/roles/c5b95b7a83d94e99a828c836efe01929` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:23.517578 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:23.525445 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 308/606] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:12:23 2022] PUT /identity/v3/projects/3f8ec287061141028659ab504e7707de/users/67dbb53f47ca406c96377408e9f893f2/roles/c5b95b7a83d94e99a828c836efe01929 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:12:23.568770 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16467bce-abac-4e3c-ba1e-e7d78e430711 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f8ec287061141028659ab504e7707de, user_id=0dccf96088954218a4fb8d7b466f970f, role_id=c5b95b7a83d94e99a828c836efe01929)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:23.571940 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16467bce-abac-4e3c-ba1e-e7d78e430711 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:23.596694 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 299/607] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:12:23 2022] PUT /identity/v3/projects/3f8ec287061141028659ab504e7707de/users/0dccf96088954218a4fb8d7b466f970f/roles/c5b95b7a83d94e99a828c836efe01929 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:12:24.764106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd11bc7-fde3-4d5f-8911-5a1feecb450d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:24.764649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd11bc7-fde3-4d5f-8911-5a1feecb450d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:24.764649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd11bc7-fde3-4d5f-8911-5a1feecb450d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:24.766356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 309/608] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:24.773791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647ea69-1691-4987-b1c6-94a74c27a3a2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:24.774364 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647ea69-1691-4987-b1c6-94a74c27a3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:24.774832 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647ea69-1691-4987-b1c6-94a74c27a3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:24.812824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e647ea69-1691-4987-b1c6-94a74c27a3a2 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:24.814154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e647ea69-1691-4987-b1c6-94a74c27a3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:24.907545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:24.924366 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 300/609] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:24.959472 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd11bc7-fde3-4d5f-8911-5a1feecb450d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:24.978450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef12ae-fe43-46c7-9554-966888ff2f2d None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:24.978808 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef12ae-fe43-46c7-9554-966888ff2f2d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:24.979094 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef12ae-fe43-46c7-9554-966888ff2f2d None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:24.980677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 301/610] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:24.993866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f0140-0e08-4dcb-ac79-be1cf1624a1d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:24.994179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f0140-0e08-4dcb-ac79-be1cf1624a1d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:24.994437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f0140-0e08-4dcb-ac79-be1cf1624a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:25.025145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-480f0140-0e08-4dcb-ac79-be1cf1624a1d None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:25.026743 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-480f0140-0e08-4dcb-ac79-be1cf1624a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:25.087568 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd11bc7-fde3-4d5f-8911-5a1feecb450d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:25.139929 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebfd94-9097-4181-9c63-ed641de8ebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:25.141145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebfd94-9097-4181-9c63-ed641de8ebd1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:25.141576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebfd94-9097-4181-9c63-ed641de8ebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:25.142761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebfd94-9097-4181-9c63-ed641de8ebd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:25.156634 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebfd94-9097-4181-9c63-ed641de8ebd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:25.166490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1cebfd94-9097-4181-9c63-ed641de8ebd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:25.166490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:25.166490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:25.166490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:25.166490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:25.166490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:25.166490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:25.166490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:25.166490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:25.166490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:25.166490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:25.166490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:25.166490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:25.166490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:25.166490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:25.166490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:25.167516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:25.167516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:25.167516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:25.167516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:25.167516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:25.167516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:25.167516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:25.167516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:25.167516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:25.167516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:25.167516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:25.167516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:25.167516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:25.167516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:25.167516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:25.167516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:25.168346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:25.168346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:25.168346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:25.168346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:25.168346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:25.168346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:25.168346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:25.168346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:25.168346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:25.168346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:25.168346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:25.168346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:25.171358 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 310/611] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:12:25.178782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebfd94-9097-4181-9c63-ed641de8ebd1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:25.240348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 302/612] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:25.280530 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f09760-23c4-4f41-a0f1-f214deb59cc4 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:25.281158 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f09760-23c4-4f41-a0f1-f214deb59cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:25.281849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f09760-23c4-4f41-a0f1-f214deb59cc4 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:25.283974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 303/613] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:25.289131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f09760-23c4-4f41-a0f1-f214deb59cc4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:25.301790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:25.358711 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebfd94-9097-4181-9c63-ed641de8ebd1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:25.400213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87cf3-78a6-4789-a171-ef16070e0927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:25.401299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87cf3-78a6-4789-a171-ef16070e0927 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:25.401822 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87cf3-78a6-4789-a171-ef16070e0927 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:25.402332 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87cf3-78a6-4789-a171-ef16070e0927 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:25.403326 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca87cf3-78a6-4789-a171-ef16070e0927 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:25.403872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca87cf3-78a6-4789-a171-ef16070e0927 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:25.405483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca87cf3-78a6-4789-a171-ef16070e0927 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:25.420005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 311/614] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:25.421255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f09760-23c4-4f41-a0f1-f214deb59cc4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:25.422066 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c7095-14ce-45e8-9ae6-6175d2755800 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:25.422639 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c7095-14ce-45e8-9ae6-6175d2755800 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:25.423169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c7095-14ce-45e8-9ae6-6175d2755800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:25.442240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-250c7095-14ce-45e8-9ae6-6175d2755800 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:25.443848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-250c7095-14ce-45e8-9ae6-6175d2755800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:25.455192 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:25.472327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641d17f-6268-4870-b3e9-ce9efca3a607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:25.473326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641d17f-6268-4870-b3e9-ce9efca3a607 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:25.473733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641d17f-6268-4870-b3e9-ce9efca3a607 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:25.474038 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641d17f-6268-4870-b3e9-ce9efca3a607 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:25.489967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641d17f-6268-4870-b3e9-ce9efca3a607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:25.498315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-7641d17f-6268-4870-b3e9-ce9efca3a607 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:25.498315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:25.498315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:25.498315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:25.498315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:25.498315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:25.498315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:25.498315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:25.498315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:25.498315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:25.498315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:25.498315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:25.498315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:25.498315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:25.498315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:25.498315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:25.499343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:25.499343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:25.499343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:25.499343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:25.499343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:25.499343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:25.499343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:25.499343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:25.499343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:25.499343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:25.499343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:25.499343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:25.499343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:25.499343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:25.499343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:25.499343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:25.500176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:25.500176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:25.500176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:25.500176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:25.500176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:25.500176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:25.500176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:25.500176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:25.500176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:25.500176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:25.500176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:25.500176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:25.503137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 304/615] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:25.504234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641d17f-6268-4870-b3e9-ce9efca3a607 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:25.544977 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 312/616] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:25.544977 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c7095-14ce-45e8-9ae6-6175d2755800 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:25.611469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:25.657219 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641d17f-6268-4870-b3e9-ce9efca3a607 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:25.671498 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c7095-14ce-45e8-9ae6-6175d2755800 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:25.713605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e922b-467c-4fe7-bc35-7f4271ca0812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:25.714475 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e922b-467c-4fe7-bc35-7f4271ca0812 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:25.714763 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e922b-467c-4fe7-bc35-7f4271ca0812 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:25.715040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e922b-467c-4fe7-bc35-7f4271ca0812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:25.730093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d3c71-8849-43a8-8faa-4fb90ef64c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:25.730830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d3c71-8849-43a8-8faa-4fb90ef64c52 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:25.731151 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d3c71-8849-43a8-8faa-4fb90ef64c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:25.731422 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d3c71-8849-43a8-8faa-4fb90ef64c52 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:25.732013 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e922b-467c-4fe7-bc35-7f4271ca0812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:25.732218 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d3c71-8849-43a8-8faa-4fb90ef64c52 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:25.732493 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d3c71-8849-43a8-8faa-4fb90ef64c52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:25.733861 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d3c71-8849-43a8-8faa-4fb90ef64c52 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:25.736211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e922b-467c-4fe7-bc35-7f4271ca0812 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:25.748519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 313/617] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:25.749519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d3c71-8849-43a8-8faa-4fb90ef64c52 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:25.773291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-560e922b-467c-4fe7-bc35-7f4271ca0812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:25.773291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:25.773291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:25.773291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:25.773291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:25.773291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:25.773291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:25.773291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:25.773291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:25.773291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:25.773291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:25.773291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:25.773291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:25.773291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:25.773291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:25.775703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:25.777451 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:25.777451 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:25.777451 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:25.777451 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:25.789594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 305/618] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:25.791732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e922b-467c-4fe7-bc35-7f4271ca0812 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:25.861514 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:25.882195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d3c71-8849-43a8-8faa-4fb90ef64c52 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:25.900656 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:25.929558 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc68147-ae68-4d57-b775-2b1936dfffa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:25.931525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc68147-ae68-4d57-b775-2b1936dfffa0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:25.931825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc68147-ae68-4d57-b775-2b1936dfffa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:25.932104 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc68147-ae68-4d57-b775-2b1936dfffa0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:25.947647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc68147-ae68-4d57-b775-2b1936dfffa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:25.957105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9dc68147-ae68-4d57-b775-2b1936dfffa0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:25.957105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:25.957105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:25.957105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:25.957105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:25.957105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:25.957105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:25.957105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:25.957105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:25.957105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:25.957105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:25.957105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:25.957105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:25.957105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:25.957105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:25.957105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:25.958775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:25.958775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:25.958775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:25.958775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:25.958775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:25.958775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:25.958775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:25.958775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:25.958775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:25.958775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:25.958775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:25.958775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:25.958775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:25.958775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:25.958775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:25.958775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:25.960411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:25.960411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:25.960411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:25.960411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:25.960411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:25.960411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:25.960411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:25.960411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:25.960411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:25.960411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:25.960411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:25.960411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:25.960411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 314/619] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:25.960411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc68147-ae68-4d57-b775-2b1936dfffa0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:26.016458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e922b-467c-4fe7-bc35-7f4271ca0812 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:26.084388 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d10684-7f38-4255-a0e0-569f9ccc678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:26.086482 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d10684-7f38-4255-a0e0-569f9ccc678e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:26.087503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d10684-7f38-4255-a0e0-569f9ccc678e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:26.088255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d10684-7f38-4255-a0e0-569f9ccc678e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:26.095307 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc68147-ae68-4d57-b775-2b1936dfffa0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:26.118466 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d10684-7f38-4255-a0e0-569f9ccc678e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:26.121645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d10684-7f38-4255-a0e0-569f9ccc678e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:26.146395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df557f-1f00-4e3c-b3bc-6821c26df2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:26.147093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df557f-1f00-4e3c-b3bc-6821c26df2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:26.147388 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df557f-1f00-4e3c-b3bc-6821c26df2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:26.147652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df557f-1f00-4e3c-b3bc-6821c26df2e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:26.148595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df557f-1f00-4e3c-b3bc-6821c26df2e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:26.148920 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df557f-1f00-4e3c-b3bc-6821c26df2e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:26.150491 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df557f-1f00-4e3c-b3bc-6821c26df2e3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:26.170273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 315/620] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:26.170273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df557f-1f00-4e3c-b3bc-6821c26df2e3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:26.171945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-87d10684-7f38-4255-a0e0-569f9ccc678e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:26.171945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:26.171945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:26.171945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:26.171945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:26.171945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:26.171945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:26.171945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:26.171945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:26.171945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:26.171945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:26.171945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:26.171945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:26.171945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:26.171945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:26.173653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:26.176022 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:26.176022 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:26.176022 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:26.176022 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:26.182429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 306/621] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:26.184352 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d10684-7f38-4255-a0e0-569f9ccc678e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:26.207331 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:26.297077 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df557f-1f00-4e3c-b3bc-6821c26df2e3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:26.343430 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:26.368829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f588-cc39-4ed6-9c3e-879a394caabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:26.369385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d10684-7f38-4255-a0e0-569f9ccc678e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:26.369555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f588-cc39-4ed6-9c3e-879a394caabe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:26.369726 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f588-cc39-4ed6-9c3e-879a394caabe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:26.370008 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f588-cc39-4ed6-9c3e-879a394caabe None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:26.370755 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86f588-cc39-4ed6-9c3e-879a394caabe None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:26.371068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86f588-cc39-4ed6-9c3e-879a394caabe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:26.372472 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86f588-cc39-4ed6-9c3e-879a394caabe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:26.388724 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 316/622] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:26.388724 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f588-cc39-4ed6-9c3e-879a394caabe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:26.444021 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f47a3-26cb-4036-9a56-31b180f5fd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:26.446287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f47a3-26cb-4036-9a56-31b180f5fd7e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:26.447608 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f47a3-26cb-4036-9a56-31b180f5fd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:26.448938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f47a3-26cb-4036-9a56-31b180f5fd7e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:26.465908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f47a3-26cb-4036-9a56-31b180f5fd7e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:26.468725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f47a3-26cb-4036-9a56-31b180f5fd7e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:26.496303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-001f47a3-26cb-4036-9a56-31b180f5fd7e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 15:12:26.496303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:26.496303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:26.496303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:26.496303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:26.496303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:26.496303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:26.496303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:26.496303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:26.496303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:26.496303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:26.496303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:26.496303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:26.496303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:26.496303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:26.496303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:26.497363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:26.498345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:26.498345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:26.498345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:26.498345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:26.498345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:26.498345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:26.498345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:26.498345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:26.498345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 15:12:26.498345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:26.498884 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 307/623] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:12:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:26.499984 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f47a3-26cb-4036-9a56-31b180f5fd7e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:26.511887 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:26.524444 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f588-cc39-4ed6-9c3e-879a394caabe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:26.583957 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916b331-1034-4ee8-9093-65fd02a11c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:26.585096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916b331-1034-4ee8-9093-65fd02a11c84 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:26.585586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916b331-1034-4ee8-9093-65fd02a11c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:26.586066 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916b331-1034-4ee8-9093-65fd02a11c84 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:26.587402 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916b331-1034-4ee8-9093-65fd02a11c84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:26.587919 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916b331-1034-4ee8-9093-65fd02a11c84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:26.590541 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916b331-1034-4ee8-9093-65fd02a11c84 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:26.610750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 317/624] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:26.612147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907ae37-b85d-409e-8c80-196af76d461e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:26.612531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907ae37-b85d-409e-8c80-196af76d461e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:26.612811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907ae37-b85d-409e-8c80-196af76d461e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:26.614411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 318/625] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:26.615007 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907ae37-b85d-409e-8c80-196af76d461e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:26.621380 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f47a3-26cb-4036-9a56-31b180f5fd7e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:26.670333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6a313-9963-434b-8010-aecd445457db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:26.671546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6a313-9963-434b-8010-aecd445457db None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:26.671939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6a313-9963-434b-8010-aecd445457db None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:26.672411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6a313-9963-434b-8010-aecd445457db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:26.689897 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6a313-9963-434b-8010-aecd445457db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:26.691443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6a313-9963-434b-8010-aecd445457db None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:26.701800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:26.723833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-5cf6a313-9963-434b-8010-aecd445457db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:26.723833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:26.723833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:26.723833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:26.723833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:26.723833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:26.723833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:26.723833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:26.723833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:26.723833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:26.723833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:26.723833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:26.723833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:26.723833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:26.723833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:26.724868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:26.725814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:26.725814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:26.725814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:26.725814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:26.726585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 308/626] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:26.728645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156991d0-50fd-4962-89b7-b20905a9824f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:26.729165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156991d0-50fd-4962-89b7-b20905a9824f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:26.729682 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156991d0-50fd-4962-89b7-b20905a9824f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:26.732751 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 309/627] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:26.733942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156991d0-50fd-4962-89b7-b20905a9824f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:26.768220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907ae37-b85d-409e-8c80-196af76d461e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:26.825033 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b0c2b-4d03-4341-9de0-e0b6d886833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:26.826040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b0c2b-4d03-4341-9de0-e0b6d886833b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:26.826515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b0c2b-4d03-4341-9de0-e0b6d886833b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:26.826953 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b0c2b-4d03-4341-9de0-e0b6d886833b None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:26.828364 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b0c2b-4d03-4341-9de0-e0b6d886833b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:26.828858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b0c2b-4d03-4341-9de0-e0b6d886833b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:26.830785 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b0c2b-4d03-4341-9de0-e0b6d886833b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:26.853403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 319/628] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Jun 27 15:12:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:26.855821 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2af904-a3b3-4467-8f88-0ce83792a6b9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:26.856275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2af904-a3b3-4467-8f88-0ce83792a6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:26.856614 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2af904-a3b3-4467-8f88-0ce83792a6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:26.876074 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156991d0-50fd-4962-89b7-b20905a9824f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:26.881973 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1d2af904-a3b3-4467-8f88-0ce83792a6b9 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:26.883829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1d2af904-a3b3-4467-8f88-0ce83792a6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:26.897203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:26.921532 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffd92f-c007-49db-af24-2e5ef4c83a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:26.922396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffd92f-c007-49db-af24-2e5ef4c83a80 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:26.922834 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffd92f-c007-49db-af24-2e5ef4c83a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:26.923119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffd92f-c007-49db-af24-2e5ef4c83a80 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:26.932978 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffd92f-c007-49db-af24-2e5ef4c83a80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:26.934747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffd92f-c007-49db-af24-2e5ef4c83a80 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:26.950881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-dfffd92f-c007-49db-af24-2e5ef4c83a80 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 27 15:12:26.950881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:26.950881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:26.950881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:26.950881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:26.950881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:26.950881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:26.950881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:26.950881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:26.950881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:26.950881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:26.950881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:26.950881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:26.950881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:26.950881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:26.950881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:26.952708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:26.955714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:26.955714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:26.955714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:26.955714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:26.955714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:26.955714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:26.955714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:26.955714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:26.955714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 27 15:12:26.955714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:26.955714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 310/629] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:12:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:26.955714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffd92f-c007-49db-af24-2e5ef4c83a80 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:26.997646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 320/630] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:27.000015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebfb1f-6e51-4b70-b7e2-4d4eaaf84b4a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:27.000544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebfb1f-6e51-4b70-b7e2-4d4eaaf84b4a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:27.001137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebfb1f-6e51-4b70-b7e2-4d4eaaf84b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:27.029875 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-feebfb1f-6e51-4b70-b7e2-4d4eaaf84b4a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:27.031318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-feebfb1f-6e51-4b70-b7e2-4d4eaaf84b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:27.042131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:27.110817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffd92f-c007-49db-af24-2e5ef4c83a80 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:27.112398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 321/631] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:27.113417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebfb1f-6e51-4b70-b7e2-4d4eaaf84b4a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:27.171861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd0943-c3a0-4d70-a79f-01452af9d427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:27.173023 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd0943-c3a0-4d70-a79f-01452af9d427 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:27.174319 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd0943-c3a0-4d70-a79f-01452af9d427 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:27.174768 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd0943-c3a0-4d70-a79f-01452af9d427 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:27.176005 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd0943-c3a0-4d70-a79f-01452af9d427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:27.176483 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd0943-c3a0-4d70-a79f-01452af9d427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:27.178861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd0943-c3a0-4d70-a79f-01452af9d427 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:27.198744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 311/632] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:27.200292 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd0943-c3a0-4d70-a79f-01452af9d427 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:27.227180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:27.258930 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebfb1f-6e51-4b70-b7e2-4d4eaaf84b4a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:27.301193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4836da9-bd47-4d5d-ae4c-2b532caa4823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:27.302201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4836da9-bd47-4d5d-ae4c-2b532caa4823 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:27.302646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4836da9-bd47-4d5d-ae4c-2b532caa4823 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:27.302960 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4836da9-bd47-4d5d-ae4c-2b532caa4823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:27.318877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4836da9-bd47-4d5d-ae4c-2b532caa4823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:27.321427 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4836da9-bd47-4d5d-ae4c-2b532caa4823 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:27.335673 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd0943-c3a0-4d70-a79f-01452af9d427 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:27.351601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f4836da9-bd47-4d5d-ae4c-2b532caa4823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:27.351601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:27.351601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:27.351601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:27.351601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:27.351601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:27.351601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:27.351601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:27.351601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:27.351601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:27.351601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:27.351601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:27.351601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:27.351601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:27.351601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:27.353157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:27.354663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:27.354663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:27.354663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:27.354663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:27.354663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 322/633] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:27.355455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4836da9-bd47-4d5d-ae4c-2b532caa4823 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:27.367148 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:27.387786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf243f-5478-4c99-88db-39ea14092af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:27.388534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf243f-5478-4c99-88db-39ea14092af1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:27.388897 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf243f-5478-4c99-88db-39ea14092af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:27.389293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf243f-5478-4c99-88db-39ea14092af1 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:27.390374 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf243f-5478-4c99-88db-39ea14092af1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:27.390813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf243f-5478-4c99-88db-39ea14092af1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:27.392534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf243f-5478-4c99-88db-39ea14092af1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:27.415356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 312/634] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Jun 27 15:12:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:27.416498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf243f-5478-4c99-88db-39ea14092af1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:27.491199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4836da9-bd47-4d5d-ae4c-2b532caa4823 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:27.534909 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:27.548477 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3c5fb-9fae-4909-b802-33c8b3de1318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:27.549495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3c5fb-9fae-4909-b802-33c8b3de1318 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:27.549881 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3c5fb-9fae-4909-b802-33c8b3de1318 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:27.550255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3c5fb-9fae-4909-b802-33c8b3de1318 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:27.560806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf243f-5478-4c99-88db-39ea14092af1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:27.565970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3c5fb-9fae-4909-b802-33c8b3de1318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:27.574928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1fc3c5fb-9fae-4909-b802-33c8b3de1318 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:27.574928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:27.574928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:27.574928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:27.574928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:27.574928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:27.574928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:27.574928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:27.574928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:27.574928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:27.574928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:27.574928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:27.574928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:27.574928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:27.574928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:27.574928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:27.576855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:27.576855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:27.576855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:27.576855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:27.576855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:27.576855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:27.576855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:27.576855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:27.576855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:27.576855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:27.576855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:27.576855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:27.576855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:27.576855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:27.576855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:27.576855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:27.583963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:27.583963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:27.583963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:27.583963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:27.583963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:27.583963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:27.583963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:27.583963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:27.583963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:27.583963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:27.583963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:27.583963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:27.583963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 323/635] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:27.583963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3c5fb-9fae-4909-b802-33c8b3de1318 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:27.605231 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc76c9-113b-448b-bf4f-84da7c8e01f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:27.606063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc76c9-113b-448b-bf4f-84da7c8e01f8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:27.606391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc76c9-113b-448b-bf4f-84da7c8e01f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:27.606675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc76c9-113b-448b-bf4f-84da7c8e01f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:27.620067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc76c9-113b-448b-bf4f-84da7c8e01f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:27.635458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-afbc76c9-113b-448b-bf4f-84da7c8e01f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:27.635458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:27.635458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:27.635458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:27.635458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:27.635458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:27.635458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:27.635458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:27.635458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:27.635458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:27.635458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:27.635458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:27.635458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:27.635458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:27.635458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:27.635458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:27.638310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:27.638310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:27.638310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:27.638310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:27.638310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:27.638310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:27.638310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:27.638310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:27.638310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:27.638310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:27.638310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:27.638310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:27.638310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:27.638310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:27.638310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:27.638310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:27.639954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:27.639954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:27.639954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:27.639954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:27.639954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:27.639954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:27.639954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:27.639954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:27.639954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:27.639954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:27.639954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:27.639954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:27.639954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 313/636] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:27.639954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc76c9-113b-448b-bf4f-84da7c8e01f8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:27.691940 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:27.705680 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3c5fb-9fae-4909-b802-33c8b3de1318 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:27.748128 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28eb02-dbc2-41a9-ad07-1ac2812aa7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:27.748937 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28eb02-dbc2-41a9-ad07-1ac2812aa7cb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:27.749230 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28eb02-dbc2-41a9-ad07-1ac2812aa7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:27.749507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28eb02-dbc2-41a9-ad07-1ac2812aa7cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:27.759564 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28eb02-dbc2-41a9-ad07-1ac2812aa7cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:27.761076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28eb02-dbc2-41a9-ad07-1ac2812aa7cb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:27.771354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc76c9-113b-448b-bf4f-84da7c8e01f8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:27.776467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2f28eb02-dbc2-41a9-ad07-1ac2812aa7cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:12:27.776467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:27.776467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:27.776467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:27.776467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:27.776467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:27.776467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:27.776467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:27.776467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:27.776467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:27.776467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:27.776467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:27.776467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:27.776467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:27.776467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:27.776467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:27.778177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:27.780034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:27.780034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:27.780034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:27.780034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:27.780034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:27.780034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:27.780034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:27.780034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:27.780034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:12:27.780034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:27.780034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 324/637] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 27 15:12:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:27.780034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28eb02-dbc2-41a9-ad07-1ac2812aa7cb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:27.821605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312701d-813d-4ae4-b49c-fa6b8c89e105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:27.822805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312701d-813d-4ae4-b49c-fa6b8c89e105 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:27.823297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312701d-813d-4ae4-b49c-fa6b8c89e105 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:27.823655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312701d-813d-4ae4-b49c-fa6b8c89e105 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:27.824766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312701d-813d-4ae4-b49c-fa6b8c89e105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:27.825315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312701d-813d-4ae4-b49c-fa6b8c89e105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:27.827818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312701d-813d-4ae4-b49c-fa6b8c89e105 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:27.838603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:27.850202 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 314/638] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:27.851732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312701d-813d-4ae4-b49c-fa6b8c89e105 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:27.921966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28eb02-dbc2-41a9-ad07-1ac2812aa7cb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:27.966191 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc597e61-eddc-4b56-89e9-1862ed28ce7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:27.966885 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc597e61-eddc-4b56-89e9-1862ed28ce7f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:27.967168 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc597e61-eddc-4b56-89e9-1862ed28ce7f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:27.967451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc597e61-eddc-4b56-89e9-1862ed28ce7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:27.990958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:27.999323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312701d-813d-4ae4-b49c-fa6b8c89e105 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:28.046402 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948613e4-ebba-4c5b-a822-b7ee0213a523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:28.047415 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948613e4-ebba-4c5b-a822-b7ee0213a523 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:28.047872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948613e4-ebba-4c5b-a822-b7ee0213a523 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:28.048235 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948613e4-ebba-4c5b-a822-b7ee0213a523 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:28.049285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948613e4-ebba-4c5b-a822-b7ee0213a523 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:28.049687 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948613e4-ebba-4c5b-a822-b7ee0213a523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:28.051236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948613e4-ebba-4c5b-a822-b7ee0213a523 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:28.056831 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc597e61-eddc-4b56-89e9-1862ed28ce7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:28.058653 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc597e61-eddc-4b56-89e9-1862ed28ce7f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:28.062080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 315/639] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:28.063541 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948613e4-ebba-4c5b-a822-b7ee0213a523 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:28.132116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:28.206910 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 325/640] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:12:28.208160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc597e61-eddc-4b56-89e9-1862ed28ce7f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:28.213244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948613e4-ebba-4c5b-a822-b7ee0213a523 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:28.264985 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32497ac0-d2d6-42e0-8f1b-1651385514b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:28.266117 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32497ac0-d2d6-42e0-8f1b-1651385514b8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:28.266636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32497ac0-d2d6-42e0-8f1b-1651385514b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:28.267980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32497ac0-d2d6-42e0-8f1b-1651385514b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:28.269456 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32497ac0-d2d6-42e0-8f1b-1651385514b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:28.270013 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32497ac0-d2d6-42e0-8f1b-1651385514b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:28.272711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32497ac0-d2d6-42e0-8f1b-1651385514b8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:28.284204 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 316/641] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:28.285396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32497ac0-d2d6-42e0-8f1b-1651385514b8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:28.317368 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:28.339607 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc597e61-eddc-4b56-89e9-1862ed28ce7f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:28.382613 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af589d6-6b14-43de-9ec8-2329d565165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:28.383310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af589d6-6b14-43de-9ec8-2329d565165f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:28.383592 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af589d6-6b14-43de-9ec8-2329d565165f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:28.383865 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af589d6-6b14-43de-9ec8-2329d565165f None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:28.384746 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af589d6-6b14-43de-9ec8-2329d565165f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:28.385053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af589d6-6b14-43de-9ec8-2329d565165f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:28.386589 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af589d6-6b14-43de-9ec8-2329d565165f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:28.415971 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 326/642] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 27 15:12:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:28.417051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af589d6-6b14-43de-9ec8-2329d565165f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:28.422773 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:28.439749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32497ac0-d2d6-42e0-8f1b-1651385514b8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:28.494817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e0645-f2ab-4e39-86a8-440dce9c0124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:28.495956 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e0645-f2ab-4e39-86a8-440dce9c0124 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:28.496410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e0645-f2ab-4e39-86a8-440dce9c0124 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:28.496791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e0645-f2ab-4e39-86a8-440dce9c0124 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:28.508691 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e0645-f2ab-4e39-86a8-440dce9c0124 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:28.510799 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e0645-f2ab-4e39-86a8-440dce9c0124 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:28.529170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-3d8e0645-f2ab-4e39-86a8-440dce9c0124 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:28.529170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:28.529170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:28.529170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:28.529170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:28.529170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:28.529170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:28.529170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:28.529170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:28.529170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:28.529170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:28.529170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:28.529170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:28.529170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:28.529170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:28.531087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:28.532942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:28.532942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:28.532942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:28.532942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:28.532942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:28.532942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:28.532942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:28.532942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:28.532942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 317/643] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:28.534140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e0645-f2ab-4e39-86a8-440dce9c0124 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:28.571441 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af589d6-6b14-43de-9ec8-2329d565165f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:28.610956 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbb518-1181-4fbd-8e2c-a52d8b3b0c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:28.611771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbb518-1181-4fbd-8e2c-a52d8b3b0c5c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:28.612050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbb518-1181-4fbd-8e2c-a52d8b3b0c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:28.612324 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbb518-1181-4fbd-8e2c-a52d8b3b0c5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:28.623577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbb518-1181-4fbd-8e2c-a52d8b3b0c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:28.625066 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbb518-1181-4fbd-8e2c-a52d8b3b0c5c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:28.643790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-68bbb518-1181-4fbd-8e2c-a52d8b3b0c5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:28.643790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:28.643790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:28.643790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:28.643790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:28.643790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:28.643790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:28.643790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:28.643790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:28.643790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:28.643790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:28.643790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:28.643790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:28.643790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:28.643790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:28.644808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:28.645873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:28.645873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:28.645873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:28.645873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:28.645873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 327/644] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:28.645873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbb518-1181-4fbd-8e2c-a52d8b3b0c5c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:28.662942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:28.694240 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e0645-f2ab-4e39-86a8-440dce9c0124 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:28.723145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:28.743434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ee9ef-f0d2-4cfe-8a07-3a93cbacc59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:28.744754 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ee9ef-f0d2-4cfe-8a07-3a93cbacc59d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:28.745251 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ee9ef-f0d2-4cfe-8a07-3a93cbacc59d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:28.745634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ee9ef-f0d2-4cfe-8a07-3a93cbacc59d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:28.762802 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ee9ef-f0d2-4cfe-8a07-3a93cbacc59d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:28.765321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ee9ef-f0d2-4cfe-8a07-3a93cbacc59d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:28.787420 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbb518-1181-4fbd-8e2c-a52d8b3b0c5c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:28.788639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-879ee9ef-f0d2-4cfe-8a07-3a93cbacc59d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:28.788639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:28.788639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:28.788639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:28.788639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:28.788639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:28.788639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:28.788639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:28.788639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:28.788639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:28.788639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:28.788639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:28.788639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:28.788639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:28.788639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:28.790336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:28.792603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:28.792603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:28.792603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:28.792603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:28.792603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 318/645] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:28.792603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ee9ef-f0d2-4cfe-8a07-3a93cbacc59d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:28.835942 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2183848-2f80-4e90-900e-666768c707ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:28.837223 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2183848-2f80-4e90-900e-666768c707ba None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:28.837669 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2183848-2f80-4e90-900e-666768c707ba None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:28.838120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2183848-2f80-4e90-900e-666768c707ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:28.855272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2183848-2f80-4e90-900e-666768c707ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:28.857820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2183848-2f80-4e90-900e-666768c707ba None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:28.888700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f2183848-2f80-4e90-900e-666768c707ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:28.888700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:28.888700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:28.888700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:28.888700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:28.888700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:28.888700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:28.888700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:28.888700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:28.888700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:28.888700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:28.888700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:28.888700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:28.888700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:28.888700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:28.889805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:28.890796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:28.890796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:28.890796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:28.890796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:28.894456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 328/646] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:28.895889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2183848-2f80-4e90-900e-666768c707ba None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:28.933343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ee9ef-f0d2-4cfe-8a07-3a93cbacc59d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:28.980948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:28.988172 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375c6d8-d0ec-4c51-be92-83438e4cbca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:28.989192 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375c6d8-d0ec-4c51-be92-83438e4cbca7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:28.989560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375c6d8-d0ec-4c51-be92-83438e4cbca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:28.989891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375c6d8-d0ec-4c51-be92-83438e4cbca7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:29.030085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2183848-2f80-4e90-900e-666768c707ba None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:29.042706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:29.075297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375c6d8-d0ec-4c51-be92-83438e4cbca7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:29.076117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f35a93-d18a-4aa7-aa42-c263ebc09a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:29.076642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f35a93-d18a-4aa7-aa42-c263ebc09a20 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:29.076990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375c6d8-d0ec-4c51-be92-83438e4cbca7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:29.077155 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f35a93-d18a-4aa7-aa42-c263ebc09a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:29.077507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f35a93-d18a-4aa7-aa42-c263ebc09a20 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:29.078535 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f35a93-d18a-4aa7-aa42-c263ebc09a20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:29.078943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f35a93-d18a-4aa7-aa42-c263ebc09a20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:29.081029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f35a93-d18a-4aa7-aa42-c263ebc09a20 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:29.095487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 329/647] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:29.096794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f35a93-d18a-4aa7-aa42-c263ebc09a20 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:29.211115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 319/648] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:12:29.212294 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375c6d8-d0ec-4c51-be92-83438e4cbca7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:29.239368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f35a93-d18a-4aa7-aa42-c263ebc09a20 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:29.248183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:29.284180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94223f8b-4a23-4451-871d-60e35e5ab403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:29.284938 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94223f8b-4a23-4451-871d-60e35e5ab403 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:29.285312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94223f8b-4a23-4451-871d-60e35e5ab403 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:29.285678 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94223f8b-4a23-4451-871d-60e35e5ab403 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:29.286707 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94223f8b-4a23-4451-871d-60e35e5ab403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:29.287139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94223f8b-4a23-4451-871d-60e35e5ab403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:29.288680 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94223f8b-4a23-4451-871d-60e35e5ab403 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:29.302896 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 330/649] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:29.303784 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94223f8b-4a23-4451-871d-60e35e5ab403 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:29.337537 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:29.342212 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375c6d8-d0ec-4c51-be92-83438e4cbca7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:29.386758 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82be904-4367-46da-adeb-08f8bceea434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:29.387810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82be904-4367-46da-adeb-08f8bceea434 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:29.388242 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82be904-4367-46da-adeb-08f8bceea434 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:29.388682 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82be904-4367-46da-adeb-08f8bceea434 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:29.389920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82be904-4367-46da-adeb-08f8bceea434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:29.390467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82be904-4367-46da-adeb-08f8bceea434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:29.392555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82be904-4367-46da-adeb-08f8bceea434 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:29.410176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 320/650] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:29.411552 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82be904-4367-46da-adeb-08f8bceea434 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:29.442739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94223f8b-4a23-4451-871d-60e35e5ab403 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:29.483516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7191f7b-74b6-4040-9524-1285f40110bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:29.484351 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7191f7b-74b6-4040-9524-1285f40110bd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:29.484725 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7191f7b-74b6-4040-9524-1285f40110bd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:29.485084 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7191f7b-74b6-4040-9524-1285f40110bd None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:29.486144 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7191f7b-74b6-4040-9524-1285f40110bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:29.486624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7191f7b-74b6-4040-9524-1285f40110bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:29.488117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7191f7b-74b6-4040-9524-1285f40110bd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:29.505594 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 331/651] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:29.506987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7191f7b-74b6-4040-9524-1285f40110bd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:29.539326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:29.551115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82be904-4367-46da-adeb-08f8bceea434 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:29.597801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e34699-397f-46f8-9e24-edd65b07c04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:29.598902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e34699-397f-46f8-9e24-edd65b07c04b None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:29.599269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e34699-397f-46f8-9e24-edd65b07c04b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:29.599634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e34699-397f-46f8-9e24-edd65b07c04b None admin] PATH_INFO: `/v3/projects/3f8ec287061141028659ab504e7707de/users/0e419f9caf0a4ccb8108d375f527006e/roles/c5b95b7a83d94e99a828c836efe01929` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:29.621796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:29.622384 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e34699-397f-46f8-9e24-edd65b07c04b None admin] RBAC: Authorizing `identity:create_grant(project_id=3f8ec287061141028659ab504e7707de, user_id=0e419f9caf0a4ccb8108d375f527006e, role_id=c5b95b7a83d94e99a828c836efe01929)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:29.624619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e34699-397f-46f8-9e24-edd65b07c04b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:29.642775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7191f7b-74b6-4040-9524-1285f40110bd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:29.654651 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 321/652] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:12:29 2022] PUT /identity/v3/projects/3f8ec287061141028659ab504e7707de/users/0e419f9caf0a4ccb8108d375f527006e/roles/c5b95b7a83d94e99a828c836efe01929 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:12:29.654651 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e34699-397f-46f8-9e24-edd65b07c04b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:29.691043 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439179a-f4af-4af0-b2e8-02ad9ea442a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:29.692123 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439179a-f4af-4af0-b2e8-02ad9ea442a1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:29.692594 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439179a-f4af-4af0-b2e8-02ad9ea442a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:29.693044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439179a-f4af-4af0-b2e8-02ad9ea442a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:29.709319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439179a-f4af-4af0-b2e8-02ad9ea442a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:29.711522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439179a-f4af-4af0-b2e8-02ad9ea442a1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:29.734068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d439179a-f4af-4af0-b2e8-02ad9ea442a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:29.734068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:29.734068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:29.734068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:29.734068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:29.734068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:29.734068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:29.734068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:29.734068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:29.734068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:29.734068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:29.734068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:29.734068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:29.734068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:29.734068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:29.736133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:29.737825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:29.737825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:29.737825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:29.737825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:29.737825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 332/653] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:29.739220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439179a-f4af-4af0-b2e8-02ad9ea442a1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:29.816650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e34699-397f-46f8-9e24-edd65b07c04b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:29.881576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e05212-5eb7-4f48-a7d9-4cf0158e08f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:29.882981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e05212-5eb7-4f48-a7d9-4cf0158e08f8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:29.883460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e05212-5eb7-4f48-a7d9-4cf0158e08f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:29.883962 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e05212-5eb7-4f48-a7d9-4cf0158e08f8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:29.898209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e05212-5eb7-4f48-a7d9-4cf0158e08f8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:29.901026 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e05212-5eb7-4f48-a7d9-4cf0158e08f8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:29.906064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439179a-f4af-4af0-b2e8-02ad9ea442a1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:29.932361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d7e05212-5eb7-4f48-a7d9-4cf0158e08f8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 15:12:29.932361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:29.932361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:29.932361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:29.932361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:29.932361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:29.932361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:29.932361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:29.932361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:29.932361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:29.932361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:29.932361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:29.932361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:29.932361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:29.932361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:29.932361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:29.933401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:29.934883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:29.934883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:29.934883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:29.934883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:29.934883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:29.934883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:29.934883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:29.934883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:29.934883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 15:12:29.934883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:29.934883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 322/654] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:29.936081 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e05212-5eb7-4f48-a7d9-4cf0158e08f8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:29.940879 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:29.973155 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988438a-ef58-491a-ba49-f27e79332270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:29.974533 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988438a-ef58-491a-ba49-f27e79332270 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:29.975025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988438a-ef58-491a-ba49-f27e79332270 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:29.975505 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988438a-ef58-491a-ba49-f27e79332270 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:29.989377 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988438a-ef58-491a-ba49-f27e79332270 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:29.992223 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988438a-ef58-491a-ba49-f27e79332270 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:29.996824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:30.023521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4988438a-ef58-491a-ba49-f27e79332270 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:30.023521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:30.023521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:30.023521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:30.023521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:30.023521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:30.023521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:30.023521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:30.023521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:30.023521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:30.023521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:30.023521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:30.023521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:30.023521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:30.023521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:30.024522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:30.025432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:30.025432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:30.025432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:30.025432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:30.025432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:30.025432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:30.025432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:30.025432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:30.026700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 333/655] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:30.028030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988438a-ef58-491a-ba49-f27e79332270 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:30.143151 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e05212-5eb7-4f48-a7d9-4cf0158e08f8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:30.184246 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988438a-ef58-491a-ba49-f27e79332270 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:30.195773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c1814-06fa-4aa7-b74e-8c808acda5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:30.196793 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c1814-06fa-4aa7-b74e-8c808acda5aa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:30.197211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c1814-06fa-4aa7-b74e-8c808acda5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:30.198349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c1814-06fa-4aa7-b74e-8c808acda5aa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:30.208352 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c1814-06fa-4aa7-b74e-8c808acda5aa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:30.210191 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c1814-06fa-4aa7-b74e-8c808acda5aa None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:30.229655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4a8c1814-06fa-4aa7-b74e-8c808acda5aa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 15:12:30.229655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:30.229655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:30.229655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:30.229655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:30.229655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:30.229655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:30.229655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:30.229655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:30.229655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:30.229655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:30.229655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:30.229655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:30.229655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:30.229655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:30.229655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:30.231564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:30.234186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:30.234186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:30.234186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:30.234186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:30.234186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:30.234186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:30.234186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:30.234186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:30.234186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 15:12:30.234186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:30.234186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 323/656] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:12:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:30.234186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c1814-06fa-4aa7-b74e-8c808acda5aa None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:30.238260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04955937-e6ca-4926-8cb9-ccf6ed49ac0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:30.239586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04955937-e6ca-4926-8cb9-ccf6ed49ac0b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:30.239586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04955937-e6ca-4926-8cb9-ccf6ed49ac0b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:30.239586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04955937-e6ca-4926-8cb9-ccf6ed49ac0b None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:30.240295 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04955937-e6ca-4926-8cb9-ccf6ed49ac0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:30.240566 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04955937-e6ca-4926-8cb9-ccf6ed49ac0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:30.241966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04955937-e6ca-4926-8cb9-ccf6ed49ac0b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:30.256181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 334/657] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:30.256761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04955937-e6ca-4926-8cb9-ccf6ed49ac0b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:30.325047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:30.334022 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:30.396420 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c1814-06fa-4aa7-b74e-8c808acda5aa None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:30.417615 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04955937-e6ca-4926-8cb9-ccf6ed49ac0b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:30.461583 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579400ef-a6d3-48ca-83ae-e62df93dcef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:30.462678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579400ef-a6d3-48ca-83ae-e62df93dcef8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:30.463098 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579400ef-a6d3-48ca-83ae-e62df93dcef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:30.463504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579400ef-a6d3-48ca-83ae-e62df93dcef8 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:30.465017 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579400ef-a6d3-48ca-83ae-e62df93dcef8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:30.465402 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579400ef-a6d3-48ca-83ae-e62df93dcef8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:30.466635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8811e-c05a-4007-af71-34a02b90964e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:30.467345 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8811e-c05a-4007-af71-34a02b90964e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:30.467621 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8811e-c05a-4007-af71-34a02b90964e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:30.467788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579400ef-a6d3-48ca-83ae-e62df93dcef8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:30.467916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8811e-c05a-4007-af71-34a02b90964e None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:30.468717 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8811e-c05a-4007-af71-34a02b90964e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:30.469025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8811e-c05a-4007-af71-34a02b90964e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:30.470983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8811e-c05a-4007-af71-34a02b90964e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:30.494700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 335/658] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:30.494700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8811e-c05a-4007-af71-34a02b90964e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:30.504719 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 324/659] 10.222.0.33 () {56 vars in 1139 bytes} [Mon Jun 27 15:12:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:30.506699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579400ef-a6d3-48ca-83ae-e62df93dcef8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:30.677978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8811e-c05a-4007-af71-34a02b90964e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:30.692843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579400ef-a6d3-48ca-83ae-e62df93dcef8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:30.709656 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:30.730055 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:30.738199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf66ec-118a-4983-bf27-0e0cc3fedc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:30.738952 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf66ec-118a-4983-bf27-0e0cc3fedc7c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:30.739274 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf66ec-118a-4983-bf27-0e0cc3fedc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:30.739674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf66ec-118a-4983-bf27-0e0cc3fedc7c None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:30.741136 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf66ec-118a-4983-bf27-0e0cc3fedc7c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:30.741636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf66ec-118a-4983-bf27-0e0cc3fedc7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:30.744213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf66ec-118a-4983-bf27-0e0cc3fedc7c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:30.760220 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a871958-f024-42d9-89d2-3978bf94896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:30.761200 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a871958-f024-42d9-89d2-3978bf94896e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:30.761615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a871958-f024-42d9-89d2-3978bf94896e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:30.762074 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a871958-f024-42d9-89d2-3978bf94896e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:30.775205 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a871958-f024-42d9-89d2-3978bf94896e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:30.778334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a871958-f024-42d9-89d2-3978bf94896e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:30.785421 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 336/660] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Jun 27 15:12:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:30.786169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf66ec-118a-4983-bf27-0e0cc3fedc7c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:30.807766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4a871958-f024-42d9-89d2-3978bf94896e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:30.807766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:30.807766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:30.807766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:30.807766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:30.807766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:30.807766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:30.807766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:30.807766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:30.807766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:30.807766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:30.807766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:30.807766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:30.807766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:30.807766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:30.809550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:30.811334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:30.811334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:30.811334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:30.811334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:30.811334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:30.811334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:30.811334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:30.811334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:30.811334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 325/661] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:30.811334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a871958-f024-42d9-89d2-3978bf94896e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:30.979303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a871958-f024-42d9-89d2-3978bf94896e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:30.984511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf66ec-118a-4983-bf27-0e0cc3fedc7c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:31.024772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e64b-c53a-47d9-9875-bc284d9bc709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:31.025607 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e64b-c53a-47d9-9875-bc284d9bc709 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:31.026010 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e64b-c53a-47d9-9875-bc284d9bc709 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:31.026720 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e64b-c53a-47d9-9875-bc284d9bc709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:31.048472 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0c8a2-90ab-487c-b60c-c412bc534cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:31.049520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0c8a2-90ab-487c-b60c-c412bc534cff None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:31.049962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0c8a2-90ab-487c-b60c-c412bc534cff None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:31.050460 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0c8a2-90ab-487c-b60c-c412bc534cff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:31.051768 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0c8a2-90ab-487c-b60c-c412bc534cff None admin] RBAC: Adding query filter params (role.id=c5b95b7a83d94e99a828c836efe01929, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=f18acfb35dfe41a1aeb50c702bd1942b) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:31.052275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0c8a2-90ab-487c-b60c-c412bc534cff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:31.054401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0c8a2-90ab-487c-b60c-c412bc534cff None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:31.066039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 337/662] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:12:30 2022] GET /identity/v3/role_assignments?user.id=f18acfb35dfe41a1aeb50c702bd1942b&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=c5b95b7a83d94e99a828c836efe01929 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:31.067561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0c8a2-90ab-487c-b60c-c412bc534cff None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:31.143789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:31.166193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:31.174823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9e64b-c53a-47d9-9875-bc284d9bc709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:31.177325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9e64b-c53a-47d9-9875-bc284d9bc709 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:31.276944 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0c8a2-90ab-487c-b60c-c412bc534cff None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:31.342879 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70451876-4d13-46d7-91f4-a8ef802e6608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:31.344554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70451876-4d13-46d7-91f4-a8ef802e6608 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:31.345393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70451876-4d13-46d7-91f4-a8ef802e6608 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:31.346202 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70451876-4d13-46d7-91f4-a8ef802e6608 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:31.352320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 326/663] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:12:31.353194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e64b-c53a-47d9-9875-bc284d9bc709 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:31.455769 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70451876-4d13-46d7-91f4-a8ef802e6608 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:31.457299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70451876-4d13-46d7-91f4-a8ef802e6608 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:31.489827 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:31.522796 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e64b-c53a-47d9-9875-bc284d9bc709 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:31.528777 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:31.581894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610050bc-1c8e-485c-94c5-0ad6749aed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:31.583368 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610050bc-1c8e-485c-94c5-0ad6749aed74 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:31.583914 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610050bc-1c8e-485c-94c5-0ad6749aed74 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:31.584557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610050bc-1c8e-485c-94c5-0ad6749aed74 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:31.585866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610050bc-1c8e-485c-94c5-0ad6749aed74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:31.586738 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610050bc-1c8e-485c-94c5-0ad6749aed74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:31.588738 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610050bc-1c8e-485c-94c5-0ad6749aed74 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:31.604616 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 327/664] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:31.606238 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610050bc-1c8e-485c-94c5-0ad6749aed74 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:31.634319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 338/665] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:12:31.635777 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70451876-4d13-46d7-91f4-a8ef802e6608 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:31.744600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610050bc-1c8e-485c-94c5-0ad6749aed74 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:31.789486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc912d0c-8b13-4249-b4c6-dd86875a2159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:31.790285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc912d0c-8b13-4249-b4c6-dd86875a2159 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:31.790577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc912d0c-8b13-4249-b4c6-dd86875a2159 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:31.790862 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc912d0c-8b13-4249-b4c6-dd86875a2159 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:31.795588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70451876-4d13-46d7-91f4-a8ef802e6608 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:31.802588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:31.805020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc912d0c-8b13-4249-b4c6-dd86875a2159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:31.807045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc912d0c-8b13-4249-b4c6-dd86875a2159 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:31.829327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-dc912d0c-8b13-4249-b4c6-dd86875a2159 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:31.829327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:31.829327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:31.829327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:31.829327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:31.829327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:31.829327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:31.829327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:31.829327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:31.829327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:31.829327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:31.829327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:31.829327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:31.829327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:31.829327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:31.831018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:31.832539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:31.832539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:31.832539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:31.832539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:31.832539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 328/666] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:31.832539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc912d0c-8b13-4249-b4c6-dd86875a2159 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:31.867002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8003703-facc-4b5a-84d6-d28b67bbc832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:31.868614 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003703-facc-4b5a-84d6-d28b67bbc832 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:31.869494 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003703-facc-4b5a-84d6-d28b67bbc832 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:31.870385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003703-facc-4b5a-84d6-d28b67bbc832 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:31.872469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8003703-facc-4b5a-84d6-d28b67bbc832 None admin] RBAC: Adding query filter params (role.id=c5b95b7a83d94e99a828c836efe01929, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=37a36c30e9dc472d97d762d236dd865a) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:31.873398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8003703-facc-4b5a-84d6-d28b67bbc832 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:31.876807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8003703-facc-4b5a-84d6-d28b67bbc832 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:31.889791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 339/667] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:12:31 2022] GET /identity/v3/role_assignments?user.id=37a36c30e9dc472d97d762d236dd865a&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=c5b95b7a83d94e99a828c836efe01929 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:31.891967 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8003703-facc-4b5a-84d6-d28b67bbc832 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:31.914567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:32.037597 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc912d0c-8b13-4249-b4c6-dd86875a2159 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:32.098851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8003703-facc-4b5a-84d6-d28b67bbc832 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:32.103034 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af41f7-cef1-4bc2-bd94-d2e0de928beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:32.104677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af41f7-cef1-4bc2-bd94-d2e0de928beb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:32.105301 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af41f7-cef1-4bc2-bd94-d2e0de928beb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:32.105700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af41f7-cef1-4bc2-bd94-d2e0de928beb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:32.132169 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af41f7-cef1-4bc2-bd94-d2e0de928beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:32.135329 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af41f7-cef1-4bc2-bd94-d2e0de928beb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:32.159069 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693414b-a82b-46f4-986a-43bc6f2698f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:32.160025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693414b-a82b-46f4-986a-43bc6f2698f6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:32.160507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693414b-a82b-46f4-986a-43bc6f2698f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:32.160926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693414b-a82b-46f4-986a-43bc6f2698f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:32.161816 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693414b-a82b-46f4-986a-43bc6f2698f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:32.162333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693414b-a82b-46f4-986a-43bc6f2698f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:32.163718 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693414b-a82b-46f4-986a-43bc6f2698f6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:32.167045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-33af41f7-cef1-4bc2-bd94-d2e0de928beb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:32.167045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:32.167045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:32.167045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:32.167045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:32.167045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:32.167045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:32.167045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:32.167045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:32.167045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:32.167045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:32.167045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:32.167045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:32.167045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:32.167045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:32.168343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:32.169611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:32.169611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:32.169611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:32.169611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:32.171964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 329/668] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:32.173718 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8f6d8-028a-4c0a-a229-cc783bbfe583 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:32.174302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8f6d8-028a-4c0a-a229-cc783bbfe583 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:32.174786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8f6d8-028a-4c0a-a229-cc783bbfe583 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:32.176716 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 330/669] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:32.178998 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8f6d8-028a-4c0a-a229-cc783bbfe583 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:32.190363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 340/670] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:32.191872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fb3ca-93a6-4faf-a47f-382deed172e7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:32.192160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fb3ca-93a6-4faf-a47f-382deed172e7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:32.192434 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fb3ca-93a6-4faf-a47f-382deed172e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:32.215799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-113fb3ca-93a6-4faf-a47f-382deed172e7 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:32.216978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-113fb3ca-93a6-4faf-a47f-382deed172e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:32.255111 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:32.333038 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:32.347903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 341/671] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:32.349680 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fb3ca-93a6-4faf-a47f-382deed172e7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:32.390854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8f6d8-028a-4c0a-a229-cc783bbfe583 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:32.444289 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91eca8e-90d6-4487-84f0-365d751de3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:32.445312 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91eca8e-90d6-4487-84f0-365d751de3fc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:32.445602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91eca8e-90d6-4487-84f0-365d751de3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:32.446597 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91eca8e-90d6-4487-84f0-365d751de3fc None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:32.447415 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91eca8e-90d6-4487-84f0-365d751de3fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:32.447735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91eca8e-90d6-4487-84f0-365d751de3fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:32.449190 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91eca8e-90d6-4487-84f0-365d751de3fc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:32.472318 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 331/672] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:32.473664 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91eca8e-90d6-4487-84f0-365d751de3fc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:32.500767 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fb3ca-93a6-4faf-a47f-382deed172e7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:32.540713 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993aa9b1-9a02-4bc5-8d05-5965dd823e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:32.541960 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993aa9b1-9a02-4bc5-8d05-5965dd823e5d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:32.542495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993aa9b1-9a02-4bc5-8d05-5965dd823e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:32.542987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993aa9b1-9a02-4bc5-8d05-5965dd823e5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:32.552694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993aa9b1-9a02-4bc5-8d05-5965dd823e5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:32.555431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993aa9b1-9a02-4bc5-8d05-5965dd823e5d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:32.572664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-993aa9b1-9a02-4bc5-8d05-5965dd823e5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:32.572664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:32.572664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:32.572664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:32.572664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:32.572664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:32.572664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:32.572664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:32.572664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:32.572664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:32.572664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:32.572664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:32.572664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:32.572664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:32.572664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:32.573622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:32.574681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:32.574681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:32.574681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:32.574681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:32.574681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:32.574681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:32.574681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:32.574681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:32.581356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 342/673] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:32.581356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993aa9b1-9a02-4bc5-8d05-5965dd823e5d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:32.644113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91eca8e-90d6-4487-84f0-365d751de3fc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:32.647350 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:32.690090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47472c-dc3c-4f65-8b97-817c4e8ee5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:32.690815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:32.691792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47472c-dc3c-4f65-8b97-817c4e8ee5fe None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:32.692080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47472c-dc3c-4f65-8b97-817c4e8ee5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:32.692361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47472c-dc3c-4f65-8b97-817c4e8ee5fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:32.705875 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47472c-dc3c-4f65-8b97-817c4e8ee5fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:32.715059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4a47472c-dc3c-4f65-8b97-817c4e8ee5fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:32.715059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:32.715059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:32.715059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:32.715059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:32.715059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:32.715059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:32.715059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:32.715059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:32.715059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:32.715059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:32.715059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:32.715059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:32.715059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:32.715059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:32.715059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:32.716928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:32.716928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:32.716928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:32.716928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:32.716928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:32.716928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:32.716928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:32.716928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:32.716928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:32.716928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:32.716928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:32.716928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:32.716928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:32.716928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:32.716928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:32.716928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:32.719236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:32.719236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:32.719236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:32.719236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:32.719236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:32.719236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:32.719236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:32.719236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:32.719236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:32.719236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:32.719236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:32.719236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:32.719236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 332/674] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:32.719236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47472c-dc3c-4f65-8b97-817c4e8ee5fe None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:32.747911 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993aa9b1-9a02-4bc5-8d05-5965dd823e5d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:32.811160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbaba7-7b0f-4419-8218-b989ab9624a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:32.813284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbaba7-7b0f-4419-8218-b989ab9624a1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:32.819512 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbaba7-7b0f-4419-8218-b989ab9624a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:32.819512 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbaba7-7b0f-4419-8218-b989ab9624a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:32.827273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbaba7-7b0f-4419-8218-b989ab9624a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:32.827273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbaba7-7b0f-4419-8218-b989ab9624a1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:32.848231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b3dbaba7-7b0f-4419-8218-b989ab9624a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:32.848231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:32.848231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:32.848231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:32.848231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:32.848231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:32.848231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:32.848231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:32.848231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:32.848231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:32.848231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:32.848231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:32.848231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:32.848231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:32.848231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:32.850071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:32.851900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:32.851900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:32.851900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:32.851900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:32.851900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:32.851900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:32.851900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:32.851900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:32.853120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 343/675] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:32.853532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbaba7-7b0f-4419-8218-b989ab9624a1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:32.891062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47472c-dc3c-4f65-8b97-817c4e8ee5fe None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:32.942141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417340e-1e60-46b9-9563-e0584e8e6560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:32.942865 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417340e-1e60-46b9-9563-e0584e8e6560 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:32.943150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417340e-1e60-46b9-9563-e0584e8e6560 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:32.943428 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417340e-1e60-46b9-9563-e0584e8e6560 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:32.944239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417340e-1e60-46b9-9563-e0584e8e6560 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:32.944548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417340e-1e60-46b9-9563-e0584e8e6560 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:32.946638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417340e-1e60-46b9-9563-e0584e8e6560 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:32.965276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 333/676] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:32.966377 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417340e-1e60-46b9-9563-e0584e8e6560 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:32.999205 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:33.047804 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbaba7-7b0f-4419-8218-b989ab9624a1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:33.081633 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:33.099891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417340e-1e60-46b9-9563-e0584e8e6560 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:33.125240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f961ff8-58c5-4a91-ab00-0e0befabd28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:33.125240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f961ff8-58c5-4a91-ab00-0e0befabd28e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:33.125240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f961ff8-58c5-4a91-ab00-0e0befabd28e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:33.125240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f961ff8-58c5-4a91-ab00-0e0befabd28e None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:33.125961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f961ff8-58c5-4a91-ab00-0e0befabd28e None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:33.125961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f961ff8-58c5-4a91-ab00-0e0befabd28e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:33.126892 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f961ff8-58c5-4a91-ab00-0e0befabd28e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:33.152193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 344/677] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:33.154165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f961ff8-58c5-4a91-ab00-0e0befabd28e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:33.155577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32623f6b-8e10-4839-b36a-f66dfe97e6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:33.156511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32623f6b-8e10-4839-b36a-f66dfe97e6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:33.157070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32623f6b-8e10-4839-b36a-f66dfe97e6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:33.157527 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32623f6b-8e10-4839-b36a-f66dfe97e6f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:33.158560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32623f6b-8e10-4839-b36a-f66dfe97e6f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:33.159132 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32623f6b-8e10-4839-b36a-f66dfe97e6f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:33.161249 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32623f6b-8e10-4839-b36a-f66dfe97e6f3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:33.190704 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 334/678] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:33.192655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32623f6b-8e10-4839-b36a-f66dfe97e6f3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:33.295627 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f961ff8-58c5-4a91-ab00-0e0befabd28e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:33.338796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcaa0e-f420-42ef-b869-73f64a6512d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:33.340335 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcaa0e-f420-42ef-b869-73f64a6512d8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:33.340848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcaa0e-f420-42ef-b869-73f64a6512d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:33.341326 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcaa0e-f420-42ef-b869-73f64a6512d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:33.342497 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcaa0e-f420-42ef-b869-73f64a6512d8 None admin] RBAC: Adding query filter params (role.id=c5b95b7a83d94e99a828c836efe01929, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=67dbb53f47ca406c96377408e9f893f2) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:33.343069 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcaa0e-f420-42ef-b869-73f64a6512d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:33.344827 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcaa0e-f420-42ef-b869-73f64a6512d8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:33.352718 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 345/679] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:12:33 2022] GET /identity/v3/role_assignments?user.id=67dbb53f47ca406c96377408e9f893f2&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=c5b95b7a83d94e99a828c836efe01929 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:33.354042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcaa0e-f420-42ef-b869-73f64a6512d8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:33.373775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:33.404275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32623f6b-8e10-4839-b36a-f66dfe97e6f3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:33.414751 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:33.481649 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed903a01-395a-4015-8c3e-27735546b43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:33.483196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed903a01-395a-4015-8c3e-27735546b43c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:33.483196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed903a01-395a-4015-8c3e-27735546b43c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:33.483625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed903a01-395a-4015-8c3e-27735546b43c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:33.508823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed903a01-395a-4015-8c3e-27735546b43c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:33.511441 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed903a01-395a-4015-8c3e-27735546b43c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:33.536315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcaa0e-f420-42ef-b869-73f64a6512d8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:33.573614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ed903a01-395a-4015-8c3e-27735546b43c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:33.573614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:33.573614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:33.573614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:33.573614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:33.573614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:33.573614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:33.573614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:33.573614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:33.573614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:33.573614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:33.573614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:33.573614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:33.573614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:33.573614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:33.575324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:33.577032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:33.577032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:33.577032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:33.577032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:33.577032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 335/680] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:33.582465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed903a01-395a-4015-8c3e-27735546b43c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:33.610660 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b9c08-6414-4993-a464-942533cbc438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:33.612466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b9c08-6414-4993-a464-942533cbc438 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:33.613260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b9c08-6414-4993-a464-942533cbc438 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:33.613980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b9c08-6414-4993-a464-942533cbc438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:33.615928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b9c08-6414-4993-a464-942533cbc438 None admin] RBAC: Adding query filter params (role.id=c5b95b7a83d94e99a828c836efe01929, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=0dccf96088954218a4fb8d7b466f970f) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:33.616981 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b9c08-6414-4993-a464-942533cbc438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:33.620362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b9c08-6414-4993-a464-942533cbc438 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:33.633877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 346/681] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:12:33 2022] GET /identity/v3/role_assignments?user.id=0dccf96088954218a4fb8d7b466f970f&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=c5b95b7a83d94e99a828c836efe01929 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:33.810150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef3f4-8c70-4133-aa9e-bc489da434f4 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:33.811212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef3f4-8c70-4133-aa9e-bc489da434f4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:33.812011 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef3f4-8c70-4133-aa9e-bc489da434f4 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:33.815779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 347/682] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:33.826406 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28832e-f5eb-4bdf-b31e-9085b3e54006 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:33.827492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28832e-f5eb-4bdf-b31e-9085b3e54006 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:33.829418 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28832e-f5eb-4bdf-b31e-9085b3e54006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:33.861025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6d28832e-f5eb-4bdf-b31e-9085b3e54006 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:33.863931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6d28832e-f5eb-4bdf-b31e-9085b3e54006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:33.875569 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed903a01-395a-4015-8c3e-27735546b43c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:33.952418 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd29d6d-e7ce-44e2-9e06-7d4f91ba40aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:33.953539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd29d6d-e7ce-44e2-9e06-7d4f91ba40aa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:33.954481 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd29d6d-e7ce-44e2-9e06-7d4f91ba40aa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:33.956828 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd29d6d-e7ce-44e2-9e06-7d4f91ba40aa None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:33.957958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd29d6d-e7ce-44e2-9e06-7d4f91ba40aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:33.958295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd29d6d-e7ce-44e2-9e06-7d4f91ba40aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:33.960677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd29d6d-e7ce-44e2-9e06-7d4f91ba40aa None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:33.966638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:33.989764 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 336/683] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:33.997408 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd29d6d-e7ce-44e2-9e06-7d4f91ba40aa None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:34.028169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 348/684] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:12:34.080975 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28832e-f5eb-4bdf-b31e-9085b3e54006 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:34.160871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:34.253821 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd29d6d-e7ce-44e2-9e06-7d4f91ba40aa None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:34.327929 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28832e-f5eb-4bdf-b31e-9085b3e54006 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:34.356780 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9921043-5070-4a73-be63-452887686a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:34.358762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9921043-5070-4a73-be63-452887686a09 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:34.359578 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9921043-5070-4a73-be63-452887686a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:34.360542 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9921043-5070-4a73-be63-452887686a09 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:34.390686 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9921043-5070-4a73-be63-452887686a09 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:34.394791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9921043-5070-4a73-be63-452887686a09 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:34.434000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b9921043-5070-4a73-be63-452887686a09 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 15:12:34.434000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:34.434000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:34.434000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:34.434000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:34.434000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:34.434000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:34.434000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:34.434000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:34.434000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:34.434000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:34.434000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:34.434000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:34.434000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:34.434000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:34.434000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:34.435843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:34.437680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:34.437680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:34.437680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:34.437680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:34.437680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:34.437680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:34.437680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:34.437680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:34.437680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 15:12:34.437680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:34.441793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd9978-53af-49a9-8b04-eb2749ab65af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:34.444094 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 337/685] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:12:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 450 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:34.444532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd9978-53af-49a9-8b04-eb2749ab65af None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:34.445404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd9978-53af-49a9-8b04-eb2749ab65af None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:34.446162 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd9978-53af-49a9-8b04-eb2749ab65af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:34.453309 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9921043-5070-4a73-be63-452887686a09 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:34.469683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd9978-53af-49a9-8b04-eb2749ab65af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:34.474494 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd9978-53af-49a9-8b04-eb2749ab65af None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:34.512205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-afcd9978-53af-49a9-8b04-eb2749ab65af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:34.512205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:34.512205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:34.512205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:34.512205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:34.512205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:34.512205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:34.512205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:34.512205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:34.512205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:34.512205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:34.512205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:34.512205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:34.512205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:34.512205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:34.513914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:34.515611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:34.515611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:34.515611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:34.515611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:34.520635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 349/686] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:34.527939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd9978-53af-49a9-8b04-eb2749ab65af None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:34.584376 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:34.734803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9921043-5070-4a73-be63-452887686a09 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:34.770852 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:34.790449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd9978-53af-49a9-8b04-eb2749ab65af None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:34.862789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cb7a8-b2b1-44bb-b251-c50000ee310d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:34.863891 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cb7a8-b2b1-44bb-b251-c50000ee310d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:34.864375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cb7a8-b2b1-44bb-b251-c50000ee310d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:34.864858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cb7a8-b2b1-44bb-b251-c50000ee310d None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:34.866167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cb7a8-b2b1-44bb-b251-c50000ee310d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:34.866748 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cb7a8-b2b1-44bb-b251-c50000ee310d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:34.869424 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cb7a8-b2b1-44bb-b251-c50000ee310d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:34.871078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667ef47-eefc-4244-a8e7-dbfc34bfc1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:34.871807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667ef47-eefc-4244-a8e7-dbfc34bfc1fb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:34.872096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667ef47-eefc-4244-a8e7-dbfc34bfc1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:34.872381 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667ef47-eefc-4244-a8e7-dbfc34bfc1fb None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:34.873293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667ef47-eefc-4244-a8e7-dbfc34bfc1fb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:34.873612 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667ef47-eefc-4244-a8e7-dbfc34bfc1fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:34.875218 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667ef47-eefc-4244-a8e7-dbfc34bfc1fb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:34.893517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 350/687] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:34.900232 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cb7a8-b2b1-44bb-b251-c50000ee310d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:34.918861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 338/688] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Jun 27 15:12:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:34.935131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667ef47-eefc-4244-a8e7-dbfc34bfc1fb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:35.125455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cb7a8-b2b1-44bb-b251-c50000ee310d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:35.209148 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5dbbb-9376-4a96-8f6d-5c3c1140d78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:35.211209 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5dbbb-9376-4a96-8f6d-5c3c1140d78c None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:35.211957 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5dbbb-9376-4a96-8f6d-5c3c1140d78c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:35.212724 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5dbbb-9376-4a96-8f6d-5c3c1140d78c None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:35.214271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5dbbb-9376-4a96-8f6d-5c3c1140d78c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:35.217955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5dbbb-9376-4a96-8f6d-5c3c1140d78c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:35.236791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667ef47-eefc-4244-a8e7-dbfc34bfc1fb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:35.260703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:35.267262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 351/689] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:12:34 2022] POST /identity/v3/users => generated 254 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:12:35.270397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85910f-56bb-44db-9f27-62afeccd9ff0 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:35.271309 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85910f-56bb-44db-9f27-62afeccd9ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:35.272374 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85910f-56bb-44db-9f27-62afeccd9ff0 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:35.278689 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 352/690] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:35.286918 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51545994-d3e9-4f6f-909d-d7df2102fb46 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:35.287382 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51545994-d3e9-4f6f-909d-d7df2102fb46 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:35.290251 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51545994-d3e9-4f6f-909d-d7df2102fb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:35.297321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:35.319883 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-51545994-d3e9-4f6f-909d-d7df2102fb46 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:35.322035 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-51545994-d3e9-4f6f-909d-d7df2102fb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:35.328621 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7eec78-ae54-46a8-8e51-ceb5265b0ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:35.329809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eec78-ae54-46a8-8e51-ceb5265b0ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:35.330297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eec78-ae54-46a8-8e51-ceb5265b0ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:35.330737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eec78-ae54-46a8-8e51-ceb5265b0ff7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:35.537035 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 353/691] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 15:12:35.555519 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7eec78-ae54-46a8-8e51-ceb5265b0ff7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:35.558584 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7eec78-ae54-46a8-8e51-ceb5265b0ff7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:35.636474 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51545994-d3e9-4f6f-909d-d7df2102fb46 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:35.760691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51545994-d3e9-4f6f-909d-d7df2102fb46 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:35.786632 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 339/692] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 852 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 15:12:35.796408 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7eec78-ae54-46a8-8e51-ceb5265b0ff7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:35.807151 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb5b5b-0811-411c-abaa-ce4e2c6f7115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:35.808355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb5b5b-0811-411c-abaa-ce4e2c6f7115 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:35.808833 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb5b5b-0811-411c-abaa-ce4e2c6f7115 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:35.809323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb5b5b-0811-411c-abaa-ce4e2c6f7115 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:35.816314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:35.825899 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb5b5b-0811-411c-abaa-ce4e2c6f7115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:35.831957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:35.837651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b8cb5b5b-0811-411c-abaa-ce4e2c6f7115 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:12:35.837651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:35.837651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:35.837651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:35.837651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:35.837651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:35.837651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:35.837651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:35.837651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:35.837651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:35.837651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:35.837651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:35.837651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:35.837651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:35.837651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:35.837651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:35.839780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:35.839780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:35.839780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:35.839780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:35.839780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:35.839780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:35.839780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:35.839780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:35.839780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:35.839780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:35.839780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:35.839780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:35.839780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:35.839780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:35.839780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:35.839780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:35.841357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:35.841357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:35.841357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:35.841357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:35.841357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:35.841357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:35.841357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:35.841357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:35.841357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:35.841357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:35.841357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:12:35.841357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:35.841357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 354/693] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:12:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:12:35.850122 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb5b5b-0811-411c-abaa-ce4e2c6f7115 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:35.969561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb5b5b-0811-411c-abaa-ce4e2c6f7115 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:36.009140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89ba75-3727-4cbc-bdb0-327113776d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:36.009987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89ba75-3727-4cbc-bdb0-327113776d4c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:36.010413 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89ba75-3727-4cbc-bdb0-327113776d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:36.010651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89ba75-3727-4cbc-bdb0-327113776d4c None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:36.011384 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89ba75-3727-4cbc-bdb0-327113776d4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:36.011688 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89ba75-3727-4cbc-bdb0-327113776d4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:36.013094 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89ba75-3727-4cbc-bdb0-327113776d4c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:36.024185 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 355/694] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:12:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:36.039188 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89ba75-3727-4cbc-bdb0-327113776d4c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:36.178915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:36.191333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7eec78-ae54-46a8-8e51-ceb5265b0ff7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:36.277532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89ba75-3727-4cbc-bdb0-327113776d4c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:36.331650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bce319-7b14-4ac8-bcf1-474edc47e598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:36.332973 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bce319-7b14-4ac8-bcf1-474edc47e598 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:36.333457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bce319-7b14-4ac8-bcf1-474edc47e598 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:36.333939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bce319-7b14-4ac8-bcf1-474edc47e598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:36.378979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bce319-7b14-4ac8-bcf1-474edc47e598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:36.381742 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bce319-7b14-4ac8-bcf1-474edc47e598 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:36.385098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d02de-6a7c-4674-be8b-a235e90b7ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:36.386702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d02de-6a7c-4674-be8b-a235e90b7ddb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:36.387201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d02de-6a7c-4674-be8b-a235e90b7ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:36.387702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d02de-6a7c-4674-be8b-a235e90b7ddb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:36.420800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d02de-6a7c-4674-be8b-a235e90b7ddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:36.423347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d02de-6a7c-4674-be8b-a235e90b7ddb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:36.444977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-98bce319-7b14-4ac8-bcf1-474edc47e598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:36.444977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:36.444977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:36.444977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:36.444977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:36.444977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:36.444977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:36.444977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:36.444977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:36.444977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:36.444977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:36.444977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:36.444977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:36.444977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:36.444977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:36.446724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:36.448470 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:36.448470 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:36.448470 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:36.448470 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:36.458388 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 340/695] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 657 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:12:36.462292 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bce319-7b14-4ac8-bcf1-474edc47e598 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:36.464809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9e0d02de-6a7c-4674-be8b-a235e90b7ddb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:36.464809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:36.464809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:36.464809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:36.464809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:36.464809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:36.464809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:36.464809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:36.464809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:36.464809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:36.464809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:36.464809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:36.464809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:36.464809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:36.464809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:36.466510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:36.468230 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:36.468230 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:36.468230 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:36.468230 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:36.478414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 356/696] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:36.498134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d02de-6a7c-4674-be8b-a235e90b7ddb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:36.628420 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:36.697573 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bce319-7b14-4ac8-bcf1-474edc47e598 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:36.764955 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a335b12-b744-4e86-8677-64dc0440d449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:36.766171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a335b12-b744-4e86-8677-64dc0440d449 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:36.766720 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a335b12-b744-4e86-8677-64dc0440d449 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:36.767221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a335b12-b744-4e86-8677-64dc0440d449 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:36.768785 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a335b12-b744-4e86-8677-64dc0440d449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:36.774260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a335b12-b744-4e86-8677-64dc0440d449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:36.774260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a335b12-b744-4e86-8677-64dc0440d449 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:36.798419 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 341/697] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:36.818314 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a335b12-b744-4e86-8677-64dc0440d449 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:36.878508 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d02de-6a7c-4674-be8b-a235e90b7ddb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:36.918620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:37.040107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a335b12-b744-4e86-8677-64dc0440d449 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:37.059967 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc42a0-e01d-4cae-a94d-0e69dbc7f381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:37.060628 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc42a0-e01d-4cae-a94d-0e69dbc7f381 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:37.061136 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc42a0-e01d-4cae-a94d-0e69dbc7f381 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:37.061613 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc42a0-e01d-4cae-a94d-0e69dbc7f381 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:37.063096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc42a0-e01d-4cae-a94d-0e69dbc7f381 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:37.063656 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc42a0-e01d-4cae-a94d-0e69dbc7f381 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:37.066181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc42a0-e01d-4cae-a94d-0e69dbc7f381 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:37.098663 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:37.112156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2160f5-c732-4b58-82cf-8589c0764664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:37.114473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2160f5-c732-4b58-82cf-8589c0764664 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:37.116297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2160f5-c732-4b58-82cf-8589c0764664 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:37.117118 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2160f5-c732-4b58-82cf-8589c0764664 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:37.134276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 357/698] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 637 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:37.144308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc42a0-e01d-4cae-a94d-0e69dbc7f381 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:37.155158 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2160f5-c732-4b58-82cf-8589c0764664 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:37.158632 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2160f5-c732-4b58-82cf-8589c0764664 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:37.189406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-7c2160f5-c732-4b58-82cf-8589c0764664 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:37.189406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:37.189406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:37.189406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:37.189406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:37.189406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:37.189406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:37.189406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:37.189406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:37.189406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:37.189406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:37.189406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:37.189406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:37.189406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:37.189406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:37.191243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:37.192887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:37.192887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:37.192887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:37.192887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:37.192887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:37.192887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:37.192887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:37.192887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:37.192887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 342/699] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:12:37.194644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72dd7b-0a23-4f1e-8a5c-a9f67b750ad2 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:37.195862 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72dd7b-0a23-4f1e-8a5c-a9f67b750ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:37.195862 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72dd7b-0a23-4f1e-8a5c-a9f67b750ad2 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:37.205025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 343/700] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:37 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:37.206614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72dd7b-0a23-4f1e-8a5c-a9f67b750ad2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:37.300660 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc42a0-e01d-4cae-a94d-0e69dbc7f381 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:37.353648 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802430a-7c02-4bb6-8dd4-c84d162d0704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:37.355203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802430a-7c02-4bb6-8dd4-c84d162d0704 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:37.355719 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802430a-7c02-4bb6-8dd4-c84d162d0704 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:37.356215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802430a-7c02-4bb6-8dd4-c84d162d0704 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:37.374120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802430a-7c02-4bb6-8dd4-c84d162d0704 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:37.377604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802430a-7c02-4bb6-8dd4-c84d162d0704 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:37.378347 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72dd7b-0a23-4f1e-8a5c-a9f67b750ad2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:37.411396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c802430a-7c02-4bb6-8dd4-c84d162d0704 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:12:37.411396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:37.411396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:37.411396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:37.411396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:37.411396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:37.411396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:37.411396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:37.411396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:37.411396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:37.411396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:37.411396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:37.411396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:37.411396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:37.411396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:37.411396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:37.412500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:37.413506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:37.413506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:37.413506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:37.413506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:37.413506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:37.413506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:37.413506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:37.413506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:37.413506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:12:37.413506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:37.414595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 358/701] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 27 15:12:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:37.416533 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49bcf7-fdb9-4e37-9eed-e658e98a6b83 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:37.417033 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49bcf7-fdb9-4e37-9eed-e658e98a6b83 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:37.417525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49bcf7-fdb9-4e37-9eed-e658e98a6b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:37.425129 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f42d8-a3ae-4c28-b6a7-7cd137145b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:37.426214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f42d8-a3ae-4c28-b6a7-7cd137145b9f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:37.426735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f42d8-a3ae-4c28-b6a7-7cd137145b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:37.427241 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f42d8-a3ae-4c28-b6a7-7cd137145b9f None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:37.428731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f42d8-a3ae-4c28-b6a7-7cd137145b9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:37.429310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f42d8-a3ae-4c28-b6a7-7cd137145b9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:37.433176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f42d8-a3ae-4c28-b6a7-7cd137145b9f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:37.445651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ce49bcf7-fdb9-4e37-9eed-e658e98a6b83 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:37.448098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ce49bcf7-fdb9-4e37-9eed-e658e98a6b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:37.457213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 344/702] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:37.458985 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f42d8-a3ae-4c28-b6a7-7cd137145b9f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:37.478393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:37.538440 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 359/703] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:37.539972 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49bcf7-fdb9-4e37-9eed-e658e98a6b83 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:37.545101 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:37.641066 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f42d8-a3ae-4c28-b6a7-7cd137145b9f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:37.690452 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174714d0-82eb-47dd-bfd6-97f948b030c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:37.691468 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174714d0-82eb-47dd-bfd6-97f948b030c2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:37.691945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174714d0-82eb-47dd-bfd6-97f948b030c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:37.692265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174714d0-82eb-47dd-bfd6-97f948b030c2 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:37.693070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174714d0-82eb-47dd-bfd6-97f948b030c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:37.693378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174714d0-82eb-47dd-bfd6-97f948b030c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:37.694925 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174714d0-82eb-47dd-bfd6-97f948b030c2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:37.695364 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49bcf7-fdb9-4e37-9eed-e658e98a6b83 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:37.715346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 345/704] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 27 15:12:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:37.716758 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94566b-2df5-49b2-9a79-1e588f03a9db None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:37.717045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94566b-2df5-49b2-9a79-1e588f03a9db None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:37.717317 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94566b-2df5-49b2-9a79-1e588f03a9db None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:37.724349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 346/705] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:37.724349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94566b-2df5-49b2-9a79-1e588f03a9db None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:37.745283 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62ec4e-231b-47ea-b33a-2bd3f0514107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:37.745959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62ec4e-231b-47ea-b33a-2bd3f0514107 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:37.746261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62ec4e-231b-47ea-b33a-2bd3f0514107 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:37.746541 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62ec4e-231b-47ea-b33a-2bd3f0514107 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:37.747390 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62ec4e-231b-47ea-b33a-2bd3f0514107 None admin] RBAC: Adding query filter params (role.id=c5b95b7a83d94e99a828c836efe01929, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=0e419f9caf0a4ccb8108d375f527006e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:37.747700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62ec4e-231b-47ea-b33a-2bd3f0514107 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:37.749165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62ec4e-231b-47ea-b33a-2bd3f0514107 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:37.756626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 360/706] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:12:37 2022] GET /identity/v3/role_assignments?user.id=0e419f9caf0a4ccb8108d375f527006e&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=c5b95b7a83d94e99a828c836efe01929 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:37.757499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62ec4e-231b-47ea-b33a-2bd3f0514107 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:37.810954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:37.911326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94566b-2df5-49b2-9a79-1e588f03a9db None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:37.916868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:37.980206 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62ec4e-231b-47ea-b33a-2bd3f0514107 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:37.988661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d7238-5492-491e-94fe-a0addc14dd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:37.989691 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d7238-5492-491e-94fe-a0addc14dd07 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:37.990103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d7238-5492-491e-94fe-a0addc14dd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:37.990557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d7238-5492-491e-94fe-a0addc14dd07 None admin] PATH_INFO: `/v3/services/network` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:37.991348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d7238-5492-491e-94fe-a0addc14dd07 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:37.993265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d7238-5492-491e-94fe-a0addc14dd07 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4d9d7238-5492-491e-94fe-a0addc14dd07 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:38.019504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:38.021467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:38.021467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:38.021467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:38.021467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:38.021467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:38.021467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:38.021467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:12:38.021467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:12:38.021467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:12:38.021467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:12:38.021467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:38.021467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:38.021467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:38.021467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:38.021467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:38.021467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:38.023662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:38.023662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:38.023662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:38.023662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:38.023662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:38.023662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:38.023662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:38.023662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:38.023662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:38.023662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:38.023662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:12:38.023662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:12:38.023662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 15:12:38.023662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:38.023662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 347/707] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:37 2022] GET /identity/v3/services/network => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:38.025510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5bc80-be46-4541-ab40-ffa6f257a375 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:38.027104 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5bc80-be46-4541-ab40-ffa6f257a375 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:38.027104 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5bc80-be46-4541-ab40-ffa6f257a375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:38.034542 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4015393-d78f-43ad-b42a-40f8394dbd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:38.035915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4015393-d78f-43ad-b42a-40f8394dbd4e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:38.035915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4015393-d78f-43ad-b42a-40f8394dbd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:38.035915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4015393-d78f-43ad-b42a-40f8394dbd4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:38.059500 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c1e5bc80-be46-4541-ab40-ffa6f257a375 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:38.061888 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c1e5bc80-be46-4541-ab40-ffa6f257a375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:38.149441 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4015393-d78f-43ad-b42a-40f8394dbd4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:38.152216 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4015393-d78f-43ad-b42a-40f8394dbd4e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:38.176359 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 348/708] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:38.178159 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5bc80-be46-4541-ab40-ffa6f257a375 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:38.201884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:38.361495 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:38.369582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 361/709] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:12:38.369582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409044a-41dd-4bd4-8ea7-2d5d90425b12 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:38.369582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409044a-41dd-4bd4-8ea7-2d5d90425b12 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:38.369582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409044a-41dd-4bd4-8ea7-2d5d90425b12 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:38.369582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 362/710] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:38.369582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409044a-41dd-4bd4-8ea7-2d5d90425b12 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:38.379360 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5bc80-be46-4541-ab40-ffa6f257a375 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:38.442075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ba14c-8135-4769-b65a-6ccb15320978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:38.443270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ba14c-8135-4769-b65a-6ccb15320978 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:38.443744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ba14c-8135-4769-b65a-6ccb15320978 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:38.444237 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ba14c-8135-4769-b65a-6ccb15320978 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:38.445570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ba14c-8135-4769-b65a-6ccb15320978 None admin] RBAC: Adding query filter params (name=network) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:38.446102 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ba14c-8135-4769-b65a-6ccb15320978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:38.448837 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ba14c-8135-4769-b65a-6ccb15320978 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:38.462198 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 349/711] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 27 15:12:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:38.462198 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ba14c-8135-4769-b65a-6ccb15320978 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:38.512591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409044a-41dd-4bd4-8ea7-2d5d90425b12 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:38.539394 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:38.553402 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be0a74-8461-4f18-b4bd-9b4fca015c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:38.554396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be0a74-8461-4f18-b4bd-9b4fca015c07 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:38.554745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be0a74-8461-4f18-b4bd-9b4fca015c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:38.555412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be0a74-8461-4f18-b4bd-9b4fca015c07 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:38.556193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be0a74-8461-4f18-b4bd-9b4fca015c07 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:38.557632 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be0a74-8461-4f18-b4bd-9b4fca015c07 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:38.573796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-64be0a74-8461-4f18-b4bd-9b4fca015c07 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 15:12:38.573796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:38.573796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:12:38.573796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:12:38.573796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:12:38.573796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:12:38.573796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:12:38.573796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:12:38.573796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 15:12:38.573796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:38.573796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:12:38.573796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:38.573796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:38.573796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:38.573796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:38.573796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:38.574878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:38.574878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:38.574878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:38.574878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:38.574878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:38.574878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:38.574878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:38.574878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:12:38.574878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:12:38.574878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:12:38.574878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:12:38.574878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:38.574878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:38.574878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:38.574878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:38.574878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:38.575763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:38.575763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:38.575763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:38.575763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:38.575763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:38.575763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:38.575763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:38.575763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:38.575763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:38.575763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:38.575763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:38.575763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:12:38.575763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:12:38.575763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 15:12:38.575763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:38.575763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 363/712] 10.222.0.33 () {56 vars in 1129 bytes} [Mon Jun 27 15:12:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:38.576614 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5511d08-d7ba-41cb-8a8e-83143f270b2b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:38.577343 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5511d08-d7ba-41cb-8a8e-83143f270b2b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:38.577343 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5511d08-d7ba-41cb-8a8e-83143f270b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:38.599488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d5511d08-d7ba-41cb-8a8e-83143f270b2b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:38.601478 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d5511d08-d7ba-41cb-8a8e-83143f270b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:38.613180 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ba14c-8135-4769-b65a-6ccb15320978 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:38.669823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d203a4f-f542-4911-be12-6e800e2a2200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:38.671317 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d203a4f-f542-4911-be12-6e800e2a2200 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:38.671791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d203a4f-f542-4911-be12-6e800e2a2200 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:38.672267 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d203a4f-f542-4911-be12-6e800e2a2200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:38.693152 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d203a4f-f542-4911-be12-6e800e2a2200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:38.695867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d203a4f-f542-4911-be12-6e800e2a2200 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:38.714258 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 364/713] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:38.714258 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5511d08-d7ba-41cb-8a8e-83143f270b2b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:38.737092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-5d203a4f-f542-4911-be12-6e800e2a2200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:38.737092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:38.737092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:38.737092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:38.737092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:38.737092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:38.737092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:38.737092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:38.737092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:38.737092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:38.737092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:38.737092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:38.737092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:38.737092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:38.737092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:38.738092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:38.739255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:38.739255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:38.739255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:38.739255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:38.739485 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 350/714] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:38.741031 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d203a4f-f542-4911-be12-6e800e2a2200 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:38.765964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:38.888656 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5511d08-d7ba-41cb-8a8e-83143f270b2b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:38.914122 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d203a4f-f542-4911-be12-6e800e2a2200 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:38.918415 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:38.949694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d51d9-67b7-479e-afd2-291f20d32e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:38.950423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d51d9-67b7-479e-afd2-291f20d32e01 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:38.950766 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d51d9-67b7-479e-afd2-291f20d32e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:38.951096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d51d9-67b7-479e-afd2-291f20d32e01 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:38.952114 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d51d9-67b7-479e-afd2-291f20d32e01 None admin] RBAC: Adding query filter params (type=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:38.952597 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d51d9-67b7-479e-afd2-291f20d32e01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:38.955034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d51d9-67b7-479e-afd2-291f20d32e01 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:38.974263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 365/715] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 27 15:12:38 2022] GET /identity/v3/services?type=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:38.974263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d51d9-67b7-479e-afd2-291f20d32e01 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:38.984469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73164c2-e174-4ee8-b636-03c7cbafa346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:38.985686 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73164c2-e174-4ee8-b636-03c7cbafa346 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:38.986488 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73164c2-e174-4ee8-b636-03c7cbafa346 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:38.987015 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73164c2-e174-4ee8-b636-03c7cbafa346 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:38.988307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73164c2-e174-4ee8-b636-03c7cbafa346 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:38.988879 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73164c2-e174-4ee8-b636-03c7cbafa346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:38.991188 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73164c2-e174-4ee8-b636-03c7cbafa346 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:38.999102 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 351/716] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Jun 27 15:12:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:39.000676 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73164c2-e174-4ee8-b636-03c7cbafa346 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:39.158832 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:39.196551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d51d9-67b7-479e-afd2-291f20d32e01 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:39.203446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73164c2-e174-4ee8-b636-03c7cbafa346 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:39.271041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2a540-ba1a-4a2d-b524-5bc011a07862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:39.271860 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2a540-ba1a-4a2d-b524-5bc011a07862 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:39.272204 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2a540-ba1a-4a2d-b524-5bc011a07862 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:39.272534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2a540-ba1a-4a2d-b524-5bc011a07862 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:39.273452 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2a540-ba1a-4a2d-b524-5bc011a07862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:39.273818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2a540-ba1a-4a2d-b524-5bc011a07862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:39.276307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2a540-ba1a-4a2d-b524-5bc011a07862 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:39.278260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba50d1b-4a81-4a61-b739-0d821e6b62f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:39.279408 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba50d1b-4a81-4a61-b739-0d821e6b62f6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:39.280096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba50d1b-4a81-4a61-b739-0d821e6b62f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:39.280747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba50d1b-4a81-4a61-b739-0d821e6b62f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:39.297805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 352/717] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:39.299175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2a540-ba1a-4a2d-b524-5bc011a07862 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:39.306278 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba50d1b-4a81-4a61-b739-0d821e6b62f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:39.322391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9ba50d1b-4a81-4a61-b739-0d821e6b62f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:39.322391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:39.322391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:39.322391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:39.322391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:39.322391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:39.322391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:39.322391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:39.322391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:39.322391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:39.322391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:39.322391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:39.322391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:39.322391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:39.322391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:39.322391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:39.324242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:39.324242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:39.324242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:39.324242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:39.324242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:39.324242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:39.324242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:39.324242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:39.324242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:39.324242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:39.324242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:39.324242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:39.324242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:39.324242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:39.324242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:39.324242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:39.325894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:39.325894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:39.325894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:39.325894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:39.325894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:39.325894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:39.325894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:39.325894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:39.325894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:39.325894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:39.325894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:39.325894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:39.328189 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 366/718] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:39.329768 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba50d1b-4a81-4a61-b739-0d821e6b62f6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:39.416822 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:39.524766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2a540-ba1a-4a2d-b524-5bc011a07862 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:39.546072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba50d1b-4a81-4a61-b739-0d821e6b62f6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:39.594354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61094ac-e44b-4e35-b19e-6c22412246ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:39.595985 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61094ac-e44b-4e35-b19e-6c22412246ba None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:39.596596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61094ac-e44b-4e35-b19e-6c22412246ba None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:39.597182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61094ac-e44b-4e35-b19e-6c22412246ba None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:39.598700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61094ac-e44b-4e35-b19e-6c22412246ba None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:39.599595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61094ac-e44b-4e35-b19e-6c22412246ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:39.602250 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61094ac-e44b-4e35-b19e-6c22412246ba None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:39.618379 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 353/719] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Jun 27 15:12:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:39.619917 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0852e7-653e-47db-9417-4dbf92010b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:39.621569 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61094ac-e44b-4e35-b19e-6c22412246ba None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:39.623333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0852e7-653e-47db-9417-4dbf92010b3f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:39.624755 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0852e7-653e-47db-9417-4dbf92010b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:39.626129 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0852e7-653e-47db-9417-4dbf92010b3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:39.631225 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:39.658582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0852e7-653e-47db-9417-4dbf92010b3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:39.665632 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0852e7-653e-47db-9417-4dbf92010b3f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:39.716889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-0b0852e7-653e-47db-9417-4dbf92010b3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:39.716889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:39.716889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:39.716889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:39.716889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:39.716889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:39.716889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:39.716889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:39.716889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:39.716889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:39.716889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:39.716889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:39.716889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:39.716889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:39.716889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:39.718912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:39.721068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:39.721068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:39.721068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:39.721068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:39.721068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:39.721068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:39.721068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:39.721068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:39.725317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 367/720] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:39.736094 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0852e7-653e-47db-9417-4dbf92010b3f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:39.949185 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61094ac-e44b-4e35-b19e-6c22412246ba None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:39.986772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0852e7-653e-47db-9417-4dbf92010b3f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:40.005087 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:40.038172 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff4b06-05d1-4bb5-b525-6840ae824c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:40.039488 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff4b06-05d1-4bb5-b525-6840ae824c5e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:40.040064 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff4b06-05d1-4bb5-b525-6840ae824c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:40.040536 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff4b06-05d1-4bb5-b525-6840ae824c5e None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:40.041961 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff4b06-05d1-4bb5-b525-6840ae824c5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:40.042548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff4b06-05d1-4bb5-b525-6840ae824c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:40.045247 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff4b06-05d1-4bb5-b525-6840ae824c5e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:40.064739 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 354/721] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:40.077224 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff4b06-05d1-4bb5-b525-6840ae824c5e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:40.080925 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee7824-b503-4030-967b-e45f57c6d504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:40.082122 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee7824-b503-4030-967b-e45f57c6d504 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:40.082668 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee7824-b503-4030-967b-e45f57c6d504 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:40.083161 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee7824-b503-4030-967b-e45f57c6d504 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:40.086085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee7824-b503-4030-967b-e45f57c6d504 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:40.086085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee7824-b503-4030-967b-e45f57c6d504 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:40.090327 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee7824-b503-4030-967b-e45f57c6d504 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:40.138028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 368/722] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:40.144886 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee7824-b503-4030-967b-e45f57c6d504 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:40.224426 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:40.290437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff4b06-05d1-4bb5-b525-6840ae824c5e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:40.359219 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae92dd1-4bc2-462c-be16-983898bee152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:40.361022 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae92dd1-4bc2-462c-be16-983898bee152 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:40.361766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae92dd1-4bc2-462c-be16-983898bee152 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:40.362634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae92dd1-4bc2-462c-be16-983898bee152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:40.375109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee7824-b503-4030-967b-e45f57c6d504 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:40.386245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae92dd1-4bc2-462c-be16-983898bee152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:40.389371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae92dd1-4bc2-462c-be16-983898bee152 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:40.425173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-aae92dd1-4bc2-462c-be16-983898bee152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:40.425173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:40.425173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:40.425173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:40.425173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:40.425173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:40.425173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:40.425173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:40.425173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:40.425173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:40.425173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:40.425173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:40.425173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:40.425173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:40.425173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:40.427004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:40.428798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:40.428798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:40.428798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:40.428798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:40.433228 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 355/723] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:40.436167 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea259eec-ce37-483f-bf04-1b6bad4f63ac None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:40.436992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea259eec-ce37-483f-bf04-1b6bad4f63ac None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:40.437750 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea259eec-ce37-483f-bf04-1b6bad4f63ac None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:40.441109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 356/724] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:40.445664 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea259eec-ce37-483f-bf04-1b6bad4f63ac None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:40.448838 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb737524-cdb5-4d4a-8274-0cf6c80f47dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:40.450770 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb737524-cdb5-4d4a-8274-0cf6c80f47dc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:40.451619 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb737524-cdb5-4d4a-8274-0cf6c80f47dc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:40.454325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb737524-cdb5-4d4a-8274-0cf6c80f47dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:40.456471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb737524-cdb5-4d4a-8274-0cf6c80f47dc None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=37a36c30e9dc472d97d762d236dd865a) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:40.457350 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb737524-cdb5-4d4a-8274-0cf6c80f47dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:40.460480 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb737524-cdb5-4d4a-8274-0cf6c80f47dc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:40.475441 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 369/725] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:12:40 2022] GET /identity/v3/role_assignments?user.id=37a36c30e9dc472d97d762d236dd865a&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 259 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:40.479320 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80194efe-77f1-4760-93ed-231bc5e3e824 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:40.479757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80194efe-77f1-4760-93ed-231bc5e3e824 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:40.480183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80194efe-77f1-4760-93ed-231bc5e3e824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:40.510414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-80194efe-77f1-4760-93ed-231bc5e3e824 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:40.512551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-80194efe-77f1-4760-93ed-231bc5e3e824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:40.554210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:40.644780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 370/726] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:40.686996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea259eec-ce37-483f-bf04-1b6bad4f63ac None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:40.687813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80194efe-77f1-4760-93ed-231bc5e3e824 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:40.722454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:40.763788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce6fab-e72a-4f6e-81e4-0d9c98c5f679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:40.765391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce6fab-e72a-4f6e-81e4-0d9c98c5f679 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:40.766379 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce6fab-e72a-4f6e-81e4-0d9c98c5f679 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:40.766978 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce6fab-e72a-4f6e-81e4-0d9c98c5f679 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:40.768518 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce6fab-e72a-4f6e-81e4-0d9c98c5f679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:40.769156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce6fab-e72a-4f6e-81e4-0d9c98c5f679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:40.772007 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce6fab-e72a-4f6e-81e4-0d9c98c5f679 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:40.796320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 357/727] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:40.808013 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce6fab-e72a-4f6e-81e4-0d9c98c5f679 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:40.918953 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80194efe-77f1-4760-93ed-231bc5e3e824 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:41.033219 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2a21c-41f7-4a45-8bf9-5ac26bf606aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:41.034821 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2a21c-41f7-4a45-8bf9-5ac26bf606aa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:41.035436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2a21c-41f7-4a45-8bf9-5ac26bf606aa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:41.036051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2a21c-41f7-4a45-8bf9-5ac26bf606aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:41.056750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2a21c-41f7-4a45-8bf9-5ac26bf606aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:41.066377 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce6fab-e72a-4f6e-81e4-0d9c98c5f679 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:41.070857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b8b2a21c-41f7-4a45-8bf9-5ac26bf606aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:12:41.070857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:41.070857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:41.070857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:41.070857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:41.070857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:41.070857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:41.070857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:41.070857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:41.070857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:41.070857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:41.070857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:41.070857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:41.070857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:41.070857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:41.070857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:41.072577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:41.072577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:41.072577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:41.072577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:41.072577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:41.072577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:41.072577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:41.072577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:41.072577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:41.072577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:41.072577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:41.072577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:41.072577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:41.072577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:41.072577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:41.072577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:41.074257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:41.074257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:41.074257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:41.074257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:41.074257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:41.074257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:41.074257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:41.074257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:41.074257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:41.074257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:41.074257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:12:41.074257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:41.079000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 371/728] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:12:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:41.089025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2a21c-41f7-4a45-8bf9-5ac26bf606aa None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:41.142662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d5efe-5712-4b01-bcf7-75aba8d864b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:41.144014 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d5efe-5712-4b01-bcf7-75aba8d864b1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:41.144469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d5efe-5712-4b01-bcf7-75aba8d864b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:41.144931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d5efe-5712-4b01-bcf7-75aba8d864b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:41.154654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:41.173844 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d5efe-5712-4b01-bcf7-75aba8d864b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:41.176448 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d5efe-5712-4b01-bcf7-75aba8d864b1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:41.219049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-895d5efe-5712-4b01-bcf7-75aba8d864b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 15:12:41.219049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:41.219049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:41.219049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:41.219049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:41.219049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:41.219049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:41.219049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:41.219049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:41.219049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:41.219049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:41.219049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:41.219049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:41.219049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:41.219049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:41.219049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:41.221012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:41.223459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:41.223459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:41.223459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:41.223459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:41.223459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:41.223459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:41.223459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:41.223459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:41.223459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 15:12:41.223459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:41.228508 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 358/729] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 27 15:12:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:41.230338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d5efe-5712-4b01-bcf7-75aba8d864b1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:41.287644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2a21c-41f7-4a45-8bf9-5ac26bf606aa None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:41.327302 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862ee65-a9ba-4d35-a897-16338d1e56fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:41.328004 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862ee65-a9ba-4d35-a897-16338d1e56fa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:41.328288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862ee65-a9ba-4d35-a897-16338d1e56fa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:41.328976 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862ee65-a9ba-4d35-a897-16338d1e56fa None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:41.329378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862ee65-a9ba-4d35-a897-16338d1e56fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:41.329775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862ee65-a9ba-4d35-a897-16338d1e56fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:41.331227 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862ee65-a9ba-4d35-a897-16338d1e56fa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:41.338874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:41.347459 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 372/730] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:12:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:41.356435 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862ee65-a9ba-4d35-a897-16338d1e56fa None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:41.419748 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d5efe-5712-4b01-bcf7-75aba8d864b1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:41.480829 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1383386-40e8-403c-ac94-2b27aab93d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:41.487701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1383386-40e8-403c-ac94-2b27aab93d36 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:41.487975 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1383386-40e8-403c-ac94-2b27aab93d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:41.488323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1383386-40e8-403c-ac94-2b27aab93d36 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:41.489137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1383386-40e8-403c-ac94-2b27aab93d36 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:41.489451 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1383386-40e8-403c-ac94-2b27aab93d36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:41.491031 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1383386-40e8-403c-ac94-2b27aab93d36 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:41.524947 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 359/731] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Jun 27 15:12:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:41.533148 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1383386-40e8-403c-ac94-2b27aab93d36 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:41.576668 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:41.603638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862ee65-a9ba-4d35-a897-16338d1e56fa None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:41.651104 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f241a6-d966-4c7f-8d77-510b60004c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:41.652206 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f241a6-d966-4c7f-8d77-510b60004c8a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:41.652667 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f241a6-d966-4c7f-8d77-510b60004c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:41.653086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f241a6-d966-4c7f-8d77-510b60004c8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:41.677621 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f241a6-d966-4c7f-8d77-510b60004c8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:41.679370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f241a6-d966-4c7f-8d77-510b60004c8a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:41.732393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b3f241a6-d966-4c7f-8d77-510b60004c8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:41.732393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:41.732393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:41.732393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:41.732393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:41.732393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:41.732393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:41.732393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:41.732393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:41.732393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:41.732393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:41.732393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:41.732393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:41.732393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:41.732393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:41.733371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:41.734287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:41.734287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:41.734287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:41.734287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:41.740918 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:41.742838 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 373/732] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:41.753522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1383386-40e8-403c-ac94-2b27aab93d36 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:41.755858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f241a6-d966-4c7f-8d77-510b60004c8a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:41.819009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d6ece-4a54-4ca7-a000-981fe8dc33a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:41.820472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d6ece-4a54-4ca7-a000-981fe8dc33a8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:41.820686 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d6ece-4a54-4ca7-a000-981fe8dc33a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:41.821157 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d6ece-4a54-4ca7-a000-981fe8dc33a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:41.958150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d6ece-4a54-4ca7-a000-981fe8dc33a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:41.961015 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d6ece-4a54-4ca7-a000-981fe8dc33a8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:42.131898 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f241a6-d966-4c7f-8d77-510b60004c8a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:42.176458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:42.183802 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 360/733] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:12:42.187139 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d6ece-4a54-4ca7-a000-981fe8dc33a8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:42.289150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:42.339372 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8b7c8-6472-4080-9759-418ce17120b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:42.340488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8b7c8-6472-4080-9759-418ce17120b9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:42.340947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8b7c8-6472-4080-9759-418ce17120b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:42.341392 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8b7c8-6472-4080-9759-418ce17120b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:42.342688 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8b7c8-6472-4080-9759-418ce17120b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:42.343176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8b7c8-6472-4080-9759-418ce17120b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:42.346857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8b7c8-6472-4080-9759-418ce17120b9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:42.389219 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d6ece-4a54-4ca7-a000-981fe8dc33a8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:42.406154 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 374/734] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 655 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:42.415866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8b7c8-6472-4080-9759-418ce17120b9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:42.460563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35534324-06eb-408f-b997-b4c3813c6dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:42.461984 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534324-06eb-408f-b997-b4c3813c6dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:42.462469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534324-06eb-408f-b997-b4c3813c6dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:42.462931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534324-06eb-408f-b997-b4c3813c6dc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:42.485485 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35534324-06eb-408f-b997-b4c3813c6dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:42.488194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35534324-06eb-408f-b997-b4c3813c6dc5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:42.525078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-35534324-06eb-408f-b997-b4c3813c6dc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:42.525078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:42.525078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:42.525078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:42.525078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:42.525078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:42.525078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:42.525078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:42.525078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:42.525078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:42.525078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:42.525078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:42.525078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:42.525078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:42.525078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:42.526284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:42.527392 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:42.527392 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:42.527392 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:42.527392 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:42.534414 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 361/735] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:42.539721 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35534324-06eb-408f-b997-b4c3813c6dc5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:42.648885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:42.719272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8b7c8-6472-4080-9759-418ce17120b9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:42.734119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35534324-06eb-408f-b997-b4c3813c6dc5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:42.775741 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd030a3-814c-4d14-8d47-4f908f920d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:42.777282 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd030a3-814c-4d14-8d47-4f908f920d7d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:42.777712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd030a3-814c-4d14-8d47-4f908f920d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:42.778131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd030a3-814c-4d14-8d47-4f908f920d7d None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:42.779394 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd030a3-814c-4d14-8d47-4f908f920d7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:42.780028 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd030a3-814c-4d14-8d47-4f908f920d7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:42.781794 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd030a3-814c-4d14-8d47-4f908f920d7d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:42.787028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3d466-ce7a-4c80-a3cc-84c19e7f445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:42.788851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3d466-ce7a-4c80-a3cc-84c19e7f445a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:42.789650 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3d466-ce7a-4c80-a3cc-84c19e7f445a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:42.790550 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3d466-ce7a-4c80-a3cc-84c19e7f445a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:42.799858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 362/736] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:42.799858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6f360-3536-4a21-80b2-133374b5fd15 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:42.799858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6f360-3536-4a21-80b2-133374b5fd15 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:42.799858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6f360-3536-4a21-80b2-133374b5fd15 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:42.799858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 363/737] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:42.808429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4add1-bb4b-450a-bcf3-b58adcd9cb2c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:42.808839 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4add1-bb4b-450a-bcf3-b58adcd9cb2c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:42.808992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4add1-bb4b-450a-bcf3-b58adcd9cb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:42.815839 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3d466-ce7a-4c80-a3cc-84c19e7f445a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:42.819213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3d466-ce7a-4c80-a3cc-84c19e7f445a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:42.828875 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8ec4add1-bb4b-450a-bcf3-b58adcd9cb2c None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:42.830150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8ec4add1-bb4b-450a-bcf3-b58adcd9cb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:42.843657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8de3d466-ce7a-4c80-a3cc-84c19e7f445a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 15:12:42.843657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:42.843657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:42.843657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:42.843657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:42.843657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:42.843657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:42.843657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:42.843657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:42.843657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:42.843657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:42.843657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:42.843657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:42.843657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:42.843657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:42.843657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:42.846015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:42.848137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:42.848137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:42.848137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:42.848137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:42.848137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:42.848137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:42.848137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:42.848137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:42.848137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 15:12:42.848137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:42.848137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 375/738] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:12:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:12:42.848137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3d466-ce7a-4c80-a3cc-84c19e7f445a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:42.907559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:42.974039 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 364/739] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:42.976332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4add1-bb4b-450a-bcf3-b58adcd9cb2c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:42.978508 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3d466-ce7a-4c80-a3cc-84c19e7f445a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:43.047389 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:43.060895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27d334-eb2d-4052-9f97-1772bc0a7bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:43.063952 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27d334-eb2d-4052-9f97-1772bc0a7bbd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:43.064966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27d334-eb2d-4052-9f97-1772bc0a7bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:43.065782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27d334-eb2d-4052-9f97-1772bc0a7bbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:43.082376 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27d334-eb2d-4052-9f97-1772bc0a7bbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:43.085867 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27d334-eb2d-4052-9f97-1772bc0a7bbd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:43.119310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3a27d334-eb2d-4052-9f97-1772bc0a7bbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:43.119310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:43.119310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:43.119310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:43.119310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:43.119310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:43.119310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:43.119310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:43.119310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:43.119310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:43.119310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:43.119310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:43.119310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:43.119310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:43.119310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:43.120275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:43.121236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:43.121236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:43.121236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:43.121236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:43.121236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:43.121236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:43.121236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:43.121236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:43.130457 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 376/740] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:43.132010 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27d334-eb2d-4052-9f97-1772bc0a7bbd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:43.132968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4add1-bb4b-450a-bcf3-b58adcd9cb2c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:43.175717 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8806d-c3d7-4c53-9328-0f165353bad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:43.176416 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8806d-c3d7-4c53-9328-0f165353bad1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:43.176696 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8806d-c3d7-4c53-9328-0f165353bad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:43.176968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8806d-c3d7-4c53-9328-0f165353bad1 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:43.177820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8806d-c3d7-4c53-9328-0f165353bad1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:43.178130 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8806d-c3d7-4c53-9328-0f165353bad1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:43.179995 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8806d-c3d7-4c53-9328-0f165353bad1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:43.199952 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 365/741] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Jun 27 15:12:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:43.201429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c2ac1-b54c-48d5-81d0-1ad70bb27e69 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:43.201719 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c2ac1-b54c-48d5-81d0-1ad70bb27e69 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:43.202013 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c2ac1-b54c-48d5-81d0-1ad70bb27e69 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:43.206374 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 366/742] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:43.206374 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c2ac1-b54c-48d5-81d0-1ad70bb27e69 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:43.295255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27d334-eb2d-4052-9f97-1772bc0a7bbd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:43.313614 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:43.344344 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:43.355903 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c2ac1-b54c-48d5-81d0-1ad70bb27e69 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:43.363044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd9e5f-3fdc-4c70-8e54-bc54f1ed7bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:43.364211 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd9e5f-3fdc-4c70-8e54-bc54f1ed7bc9 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:43.364718 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd9e5f-3fdc-4c70-8e54-bc54f1ed7bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:43.365206 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd9e5f-3fdc-4c70-8e54-bc54f1ed7bc9 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:43.366629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd9e5f-3fdc-4c70-8e54-bc54f1ed7bc9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:43.370094 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd9e5f-3fdc-4c70-8e54-bc54f1ed7bc9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:43.392967 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 377/743] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 27 15:12:43 2022] POST /identity/v3/services => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:12:43.394848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd9e5f-3fdc-4c70-8e54-bc54f1ed7bc9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:43.440219 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbfb8f-c804-4384-9ae5-82d9f40c7466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:43.441658 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbfb8f-c804-4384-9ae5-82d9f40c7466 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:43.442316 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbfb8f-c804-4384-9ae5-82d9f40c7466 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:43.443003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbfb8f-c804-4384-9ae5-82d9f40c7466 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:43.444811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbfb8f-c804-4384-9ae5-82d9f40c7466 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:43.445529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbfb8f-c804-4384-9ae5-82d9f40c7466 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:43.448770 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbfb8f-c804-4384-9ae5-82d9f40c7466 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:43.474467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 367/744] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:43.476970 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e8d0c-7071-476b-b12c-37e676506af0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:43.477576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e8d0c-7071-476b-b12c-37e676506af0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:43.478209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e8d0c-7071-476b-b12c-37e676506af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:43.511502 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-498e8d0c-7071-476b-b12c-37e676506af0 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:43.513821 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-498e8d0c-7071-476b-b12c-37e676506af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:43.615708 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd9e5f-3fdc-4c70-8e54-bc54f1ed7bc9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:43.658737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 368/745] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 15:12:43.660587 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e8d0c-7071-476b-b12c-37e676506af0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:43.706883 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3894e-cad3-47d4-87e4-da170ecd4323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:43.708536 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3894e-cad3-47d4-87e4-da170ecd4323 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:43.708999 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3894e-cad3-47d4-87e4-da170ecd4323 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:43.709464 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3894e-cad3-47d4-87e4-da170ecd4323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:43.776526 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:43.833369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3894e-cad3-47d4-87e4-da170ecd4323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:43.835116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3894e-cad3-47d4-87e4-da170ecd4323 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:43.842087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:43.869349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e8d0c-7071-476b-b12c-37e676506af0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:43.916974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfb641-b618-4d9b-8470-1473a2d6ebbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:43.917922 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfb641-b618-4d9b-8470-1473a2d6ebbe None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:43.918425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfb641-b618-4d9b-8470-1473a2d6ebbe None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:43.918894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfb641-b618-4d9b-8470-1473a2d6ebbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:43.920396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfb641-b618-4d9b-8470-1473a2d6ebbe None admin] RBAC: Adding query filter params (role.id=c5b95b7a83d94e99a828c836efe01929, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=6f3dfc12a3ac499da540065c03bd2a82) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:43.920914 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfb641-b618-4d9b-8470-1473a2d6ebbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:43.923535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfb641-b618-4d9b-8470-1473a2d6ebbe None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:43.934348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 369/746] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:12:43 2022] GET /identity/v3/role_assignments?user.id=6f3dfc12a3ac499da540065c03bd2a82&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=c5b95b7a83d94e99a828c836efe01929 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:43.935704 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfb641-b618-4d9b-8470-1473a2d6ebbe None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:43.987912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 378/747] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:43 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 15:12:43.990142 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb2cb5-03cc-429a-97b8-73a2d3035833 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:43.990623 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb2cb5-03cc-429a-97b8-73a2d3035833 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:43.991112 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb2cb5-03cc-429a-97b8-73a2d3035833 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:43.999684 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 379/748] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:43.999684 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb2cb5-03cc-429a-97b8-73a2d3035833 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:44.129531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:44.145134 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfb641-b618-4d9b-8470-1473a2d6ebbe None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:44.191397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb2cb5-03cc-429a-97b8-73a2d3035833 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:44.191950 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cde6e4-438b-4836-bc55-59f754b5aeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:44.192655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cde6e4-438b-4836-bc55-59f754b5aeec None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:44.192944 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cde6e4-438b-4836-bc55-59f754b5aeec None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:44.193226 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cde6e4-438b-4836-bc55-59f754b5aeec None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:44.193983 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cde6e4-438b-4836-bc55-59f754b5aeec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:44.195438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cde6e4-438b-4836-bc55-59f754b5aeec None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:44.233816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 370/749] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 27 15:12:43 2022] POST /identity/v3/services => generated 240 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:12:44.237242 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b2f6f-da54-49a8-aa1a-f1692c9879c3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:44.238265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b2f6f-da54-49a8-aa1a-f1692c9879c3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:44.239058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b2f6f-da54-49a8-aa1a-f1692c9879c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:44.250383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:44.268639 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1735066-fd13-44f5-90fc-8af5d6c701c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:44.269961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1735066-fd13-44f5-90fc-8af5d6c701c8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:44.270528 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1735066-fd13-44f5-90fc-8af5d6c701c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:44.274320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3c7b2f6f-da54-49a8-aa1a-f1692c9879c3 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:44.274320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3c7b2f6f-da54-49a8-aa1a-f1692c9879c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:44.278801 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1735066-fd13-44f5-90fc-8af5d6c701c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:44.299134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1735066-fd13-44f5-90fc-8af5d6c701c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:44.300659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1735066-fd13-44f5-90fc-8af5d6c701c8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:44.341267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f1735066-fd13-44f5-90fc-8af5d6c701c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:44.341267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:44.341267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:44.341267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:44.341267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:44.341267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:44.341267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:44.341267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:44.341267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:44.341267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:44.341267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:44.341267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:44.341267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:44.341267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:44.341267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:44.342287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:44.343201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:44.343201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:44.343201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:44.343201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:44.343201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 380/750] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:44.348959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1735066-fd13-44f5-90fc-8af5d6c701c8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:44.420263 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 371/751] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:12:44.454498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b2f6f-da54-49a8-aa1a-f1692c9879c3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:44.554174 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1735066-fd13-44f5-90fc-8af5d6c701c8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:44.609962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:44.614529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b2f6f-da54-49a8-aa1a-f1692c9879c3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:44.660806 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbab0e7-d9a3-4fa6-8e0f-e8721568cfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:44.661800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbab0e7-d9a3-4fa6-8e0f-e8721568cfac None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:44.662254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbab0e7-d9a3-4fa6-8e0f-e8721568cfac None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:44.662383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a159e7c-5003-4b41-bf27-ca36816b14d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:44.662747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbab0e7-d9a3-4fa6-8e0f-e8721568cfac None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:44.663865 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a159e7c-5003-4b41-bf27-ca36816b14d5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:44.663978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbab0e7-d9a3-4fa6-8e0f-e8721568cfac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:44.664449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbab0e7-d9a3-4fa6-8e0f-e8721568cfac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:44.664765 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a159e7c-5003-4b41-bf27-ca36816b14d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:44.665227 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a159e7c-5003-4b41-bf27-ca36816b14d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:44.666774 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbab0e7-d9a3-4fa6-8e0f-e8721568cfac None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:44.668335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:44.682949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a159e7c-5003-4b41-bf27-ca36816b14d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:44.691917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4a159e7c-5003-4b41-bf27-ca36816b14d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:12:44.691917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:44.691917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:44.691917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:44.691917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:44.691917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:44.691917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:44.691917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:44.691917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:44.691917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:44.691917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:44.691917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:44.691917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:44.691917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:44.691917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:44.691917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:44.692949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:44.692949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:44.692949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:44.692949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:44.692949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:44.692949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:44.692949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:44.692949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:44.692949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:44.692949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:44.692949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:44.692949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:44.692949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:44.692949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:44.692949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:44.692949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:44.693782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:44.693782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:44.693782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:44.693782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:44.693782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:44.693782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:44.693782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:44.693782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:44.693782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:44.693782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:44.693782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:12:44.693782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:44.695850 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 381/752] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:44.696590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 372/753] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:12:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:44.702000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbab0e7-d9a3-4fa6-8e0f-e8721568cfac None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:44.713050 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a159e7c-5003-4b41-bf27-ca36816b14d5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:44.916759 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a159e7c-5003-4b41-bf27-ca36816b14d5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:44.951288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbab0e7-d9a3-4fa6-8e0f-e8721568cfac None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:45.006908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ab7bc-8cba-4d4d-9f0f-90c84c69d877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:45.009177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab7bc-8cba-4d4d-9f0f-90c84c69d877 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:45.009737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab7bc-8cba-4d4d-9f0f-90c84c69d877 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:45.011377 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab7bc-8cba-4d4d-9f0f-90c84c69d877 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:45.012420 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ab7bc-8cba-4d4d-9f0f-90c84c69d877 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:45.014410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ab7bc-8cba-4d4d-9f0f-90c84c69d877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:45.017040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ab7bc-8cba-4d4d-9f0f-90c84c69d877 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:45.039221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 373/754] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:12:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:45.040299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf7b95-cb98-4d47-80a6-ddd215cb7c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:45.041403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf7b95-cb98-4d47-80a6-ddd215cb7c60 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:45.041915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf7b95-cb98-4d47-80a6-ddd215cb7c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:45.042413 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf7b95-cb98-4d47-80a6-ddd215cb7c60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:45.049302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ab7bc-8cba-4d4d-9f0f-90c84c69d877 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:45.068305 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf7b95-cb98-4d47-80a6-ddd215cb7c60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:45.071055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf7b95-cb98-4d47-80a6-ddd215cb7c60 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:45.121784 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:45.131088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e9cf7b95-cb98-4d47-80a6-ddd215cb7c60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:45.131088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:45.131088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:45.131088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:45.131088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:45.131088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:45.131088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:45.131088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:45.131088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:45.131088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:45.131088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:45.131088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:45.131088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:45.131088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:45.131088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:45.132096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:45.132982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:45.132982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:45.132982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:45.132982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:45.132982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:45.132982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:45.132982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:45.132982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:45.134021 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 382/755] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:45.144256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf7b95-cb98-4d47-80a6-ddd215cb7c60 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:45.179207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ab7bc-8cba-4d4d-9f0f-90c84c69d877 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:45.224095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fd580-65da-433a-a5ed-458b4ded69a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:45.224845 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fd580-65da-433a-a5ed-458b4ded69a5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:45.225125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fd580-65da-433a-a5ed-458b4ded69a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:45.225400 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fd580-65da-433a-a5ed-458b4ded69a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:45.254707 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fd580-65da-433a-a5ed-458b4ded69a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:45.260653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fd580-65da-433a-a5ed-458b4ded69a5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:45.284650 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:45.302127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b46fd580-65da-433a-a5ed-458b4ded69a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:45.302127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:45.302127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:45.302127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:45.302127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:45.302127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:45.302127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:45.302127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:45.302127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:45.302127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:45.302127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:45.302127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:45.302127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:45.302127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:45.302127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:45.304209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:45.306775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:45.306775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:45.306775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:45.306775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:45.311711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 374/756] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:45.314743 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fd580-65da-433a-a5ed-458b4ded69a5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:45.443149 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fd580-65da-433a-a5ed-458b4ded69a5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:45.453580 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf7b95-cb98-4d47-80a6-ddd215cb7c60 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:45.453950 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:45.507472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bc9a9-33d2-4892-823a-fe1480ee3932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:45.508085 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc9a9-33d2-4892-823a-fe1480ee3932 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:45.508369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc9a9-33d2-4892-823a-fe1480ee3932 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:45.508643 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc9a9-33d2-4892-823a-fe1480ee3932 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:45.509408 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bc9a9-33d2-4892-823a-fe1480ee3932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:45.509713 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bc9a9-33d2-4892-823a-fe1480ee3932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:45.511252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bc9a9-33d2-4892-823a-fe1480ee3932 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:45.533483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c5b4f-f77f-483c-916f-188072f57dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:45.534197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c5b4f-f77f-483c-916f-188072f57dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:45.534511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c5b4f-f77f-483c-916f-188072f57dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:45.534787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c5b4f-f77f-483c-916f-188072f57dc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:45.535609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c5b4f-f77f-483c-916f-188072f57dc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:45.535918 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c5b4f-f77f-483c-916f-188072f57dc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:45.537400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c5b4f-f77f-483c-916f-188072f57dc4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:45.543838 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 375/757] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:45.550341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bc9a9-33d2-4892-823a-fe1480ee3932 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:45.569120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 383/758] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:45.575323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c5b4f-f77f-483c-916f-188072f57dc4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:45.751592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bc9a9-33d2-4892-823a-fe1480ee3932 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:45.797842 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:45.809927 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c5b4f-f77f-483c-916f-188072f57dc4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:45.825040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7230b5-0f0f-4ec1-908a-19c0d7e9f075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:45.825883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7230b5-0f0f-4ec1-908a-19c0d7e9f075 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:45.826161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7230b5-0f0f-4ec1-908a-19c0d7e9f075 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:45.826471 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7230b5-0f0f-4ec1-908a-19c0d7e9f075 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:45.835974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7230b5-0f0f-4ec1-908a-19c0d7e9f075 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:45.837508 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7230b5-0f0f-4ec1-908a-19c0d7e9f075 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:45.865353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ee7230b5-0f0f-4ec1-908a-19c0d7e9f075 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:12:45.865353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:45.865353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:45.865353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:45.865353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:45.865353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:45.865353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:45.865353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:45.865353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:45.865353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:45.865353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:45.865353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:45.865353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:45.865353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:45.865353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:45.865353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:45.867036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:45.868803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:45.868803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:45.868803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:45.868803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:45.868803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:45.868803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:45.868803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:45.868803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:45.868803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:12:45.868803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:45.876738 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 376/759] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 27 15:12:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:12:45.876738 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55492a47-b387-4a18-9dd4-eba3d39fa9bc None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:45.876738 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55492a47-b387-4a18-9dd4-eba3d39fa9bc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:45.876738 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55492a47-b387-4a18-9dd4-eba3d39fa9bc None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:45.878747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 377/760] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:45.884869 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55492a47-b387-4a18-9dd4-eba3d39fa9bc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:45.893058 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba30dd-6ddc-4c2b-a7c6-df7f187fee95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:45.893829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba30dd-6ddc-4c2b-a7c6-df7f187fee95 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:45.894387 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba30dd-6ddc-4c2b-a7c6-df7f187fee95 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:45.894879 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba30dd-6ddc-4c2b-a7c6-df7f187fee95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:45.896629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba30dd-6ddc-4c2b-a7c6-df7f187fee95 None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=0e419f9caf0a4ccb8108d375f527006e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:45.897203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba30dd-6ddc-4c2b-a7c6-df7f187fee95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:45.899968 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba30dd-6ddc-4c2b-a7c6-df7f187fee95 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:45.917585 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 384/761] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:12:45 2022] GET /identity/v3/role_assignments?user.id=0e419f9caf0a4ccb8108d375f527006e&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:45.917585 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e96e8-5ce3-4eff-b34d-229f0db15fd4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:45.917585 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e96e8-5ce3-4eff-b34d-229f0db15fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:45.917585 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e96e8-5ce3-4eff-b34d-229f0db15fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:45.943771 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:45.945605 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-795e96e8-5ce3-4eff-b34d-229f0db15fd4 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:45.948089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-795e96e8-5ce3-4eff-b34d-229f0db15fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:46.100103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 385/762] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:12:46.143731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e96e8-5ce3-4eff-b34d-229f0db15fd4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:46.162687 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55492a47-b387-4a18-9dd4-eba3d39fa9bc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:46.225005 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e87f8-c758-4369-bf6e-2051f7604c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:46.225711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e87f8-c758-4369-bf6e-2051f7604c15 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:46.226009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e87f8-c758-4369-bf6e-2051f7604c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:46.226287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e87f8-c758-4369-bf6e-2051f7604c15 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:46.227186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e87f8-c758-4369-bf6e-2051f7604c15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:46.227498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e87f8-c758-4369-bf6e-2051f7604c15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:46.229022 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e87f8-c758-4369-bf6e-2051f7604c15 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:46.254358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 378/763] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 27 15:12:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:46.258171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e87f8-c758-4369-bf6e-2051f7604c15 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:46.315823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:46.338012 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e96e8-5ce3-4eff-b34d-229f0db15fd4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:46.382769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:46.412218 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dade26-a574-4db3-9945-629f1973f1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:46.413645 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dade26-a574-4db3-9945-629f1973f1ad None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:46.414125 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dade26-a574-4db3-9945-629f1973f1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:46.414578 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e87f8-c758-4369-bf6e-2051f7604c15 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:46.414741 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dade26-a574-4db3-9945-629f1973f1ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:46.415813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dade26-a574-4db3-9945-629f1973f1ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:46.418923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dade26-a574-4db3-9945-629f1973f1ad None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:46.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-52dade26-a574-4db3-9945-629f1973f1ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 15:12:46.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:46.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:12:46.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:12:46.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:12:46.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:12:46.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:12:46.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:12:46.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 15:12:46.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:46.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:12:46.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:46.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:46.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:46.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:46.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:46.479815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:46.479815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:46.479815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:46.479815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:46.479815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:46.479815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:46.479815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:46.479815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:12:46.479815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:12:46.479815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:12:46.479815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:12:46.479815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:46.479815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:46.479815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:46.479815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:46.479815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:46.481476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:46.481476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:46.481476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:46.481476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:46.481476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:46.481476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:46.481476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:46.481476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:46.481476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:46.481476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:46.481476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:46.481476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:12:46.481476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:12:46.481476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 15:12:46.481476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:46.487665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 386/764] 10.222.0.33 () {56 vars in 1129 bytes} [Mon Jun 27 15:12:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:12:46.494144 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dade26-a574-4db3-9945-629f1973f1ad None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:46.518028 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435fb7c-8685-4d9b-a505-4dd2ce2f1c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:46.520160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435fb7c-8685-4d9b-a505-4dd2ce2f1c5b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:46.520960 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435fb7c-8685-4d9b-a505-4dd2ce2f1c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:46.521671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435fb7c-8685-4d9b-a505-4dd2ce2f1c5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:46.566433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435fb7c-8685-4d9b-a505-4dd2ce2f1c5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:46.569759 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435fb7c-8685-4d9b-a505-4dd2ce2f1c5b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:46.603261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-8435fb7c-8685-4d9b-a505-4dd2ce2f1c5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:46.603261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:46.603261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:46.603261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:46.603261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:46.603261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:46.603261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:46.603261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:46.603261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:46.603261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:46.603261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:46.603261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:46.603261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:46.603261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:46.603261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:46.605053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:46.607562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:46.607562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:46.607562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:46.607562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:46.608446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 379/765] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:46.610769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435fb7c-8685-4d9b-a505-4dd2ce2f1c5b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:46.750818 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dade26-a574-4db3-9945-629f1973f1ad None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:46.827649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6df34a-51cd-400a-87f3-7190761b50ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:46.829488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6df34a-51cd-400a-87f3-7190761b50ff None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:46.830353 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6df34a-51cd-400a-87f3-7190761b50ff None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:46.831289 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6df34a-51cd-400a-87f3-7190761b50ff None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:46.833009 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6df34a-51cd-400a-87f3-7190761b50ff None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:46.835969 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6df34a-51cd-400a-87f3-7190761b50ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:46.846025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6df34a-51cd-400a-87f3-7190761b50ff None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:46.860174 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 387/766] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Jun 27 15:12:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:46.872033 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6df34a-51cd-400a-87f3-7190761b50ff None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:46.894255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435fb7c-8685-4d9b-a505-4dd2ce2f1c5b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:46.929381 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77773d49-f4ba-4910-a69c-1c691e6d70e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:46.930463 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77773d49-f4ba-4910-a69c-1c691e6d70e5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:46.930744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77773d49-f4ba-4910-a69c-1c691e6d70e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:46.931025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77773d49-f4ba-4910-a69c-1c691e6d70e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:46.931765 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77773d49-f4ba-4910-a69c-1c691e6d70e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:46.932069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77773d49-f4ba-4910-a69c-1c691e6d70e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:46.933705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77773d49-f4ba-4910-a69c-1c691e6d70e5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:46.943006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:46.950788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 380/767] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:46.956979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:46.959392 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77773d49-f4ba-4910-a69c-1c691e6d70e5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:47.167310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6df34a-51cd-400a-87f3-7190761b50ff None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:47.175945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77773d49-f4ba-4910-a69c-1c691e6d70e5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:47.249280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc771d8-13db-4335-aeda-47c31c0f3f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:47.249979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc771d8-13db-4335-aeda-47c31c0f3f9c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:47.250379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc771d8-13db-4335-aeda-47c31c0f3f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:47.250671 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc771d8-13db-4335-aeda-47c31c0f3f9c None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:47.251396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc771d8-13db-4335-aeda-47c31c0f3f9c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:47.251700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc771d8-13db-4335-aeda-47c31c0f3f9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:47.253357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc771d8-13db-4335-aeda-47c31c0f3f9c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:47.264391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 388/768] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Jun 27 15:12:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:47.265952 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc771d8-13db-4335-aeda-47c31c0f3f9c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:47.276390 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9111e-fdb1-4b65-a8fb-841f3504d9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:47.277768 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9111e-fdb1-4b65-a8fb-841f3504d9ea None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:47.278293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9111e-fdb1-4b65-a8fb-841f3504d9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:47.278803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9111e-fdb1-4b65-a8fb-841f3504d9ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:47.307557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9111e-fdb1-4b65-a8fb-841f3504d9ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:47.310566 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9111e-fdb1-4b65-a8fb-841f3504d9ea None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:47.361166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:47.362625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-95e9111e-fdb1-4b65-a8fb-841f3504d9ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:47.362625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:47.362625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:47.362625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:47.362625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:47.362625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:47.362625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:47.362625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:47.362625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:47.362625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:47.362625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:47.362625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:47.362625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:47.362625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:47.362625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:47.363498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:47.364386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:47.364386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:47.364386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:47.364386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:47.364386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:47.364386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:47.364386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:47.364386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:47.366444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 381/769] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:47.380061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9111e-fdb1-4b65-a8fb-841f3504d9ea None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:47.382983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc771d8-13db-4335-aeda-47c31c0f3f9c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:47.421267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002bf29-d57f-44bd-a340-aa57ee44eeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:47.422191 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002bf29-d57f-44bd-a340-aa57ee44eeca None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:47.422718 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002bf29-d57f-44bd-a340-aa57ee44eeca None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:47.423110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002bf29-d57f-44bd-a340-aa57ee44eeca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:47.424031 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002bf29-d57f-44bd-a340-aa57ee44eeca None admin] RBAC: Adding query filter params (interface=public, service_id=7823389bc80e4b22ae0c9b1a330b8e4a, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:47.424443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002bf29-d57f-44bd-a340-aa57ee44eeca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:47.427766 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002bf29-d57f-44bd-a340-aa57ee44eeca None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:47.439436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 389/770] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Jun 27 15:12:47 2022] GET /identity/v3/endpoints?service_id=7823389bc80e4b22ae0c9b1a330b8e4a&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:47.442085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002bf29-d57f-44bd-a340-aa57ee44eeca None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:47.499129 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:47.561348 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002bf29-d57f-44bd-a340-aa57ee44eeca None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:47.585692 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9111e-fdb1-4b65-a8fb-841f3504d9ea None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:47.599587 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64da50-750f-4bc6-957c-1156f8543804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:47.600396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64da50-750f-4bc6-957c-1156f8543804 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:47.600739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64da50-750f-4bc6-957c-1156f8543804 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:47.601078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64da50-750f-4bc6-957c-1156f8543804 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:47.601834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64da50-750f-4bc6-957c-1156f8543804 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:47.603458 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64da50-750f-4bc6-957c-1156f8543804 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:47.618510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 390/771] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 27 15:12:47 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:47.620266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd276c-c392-4d69-be22-baf9701d3801 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:47.620618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd276c-c392-4d69-be22-baf9701d3801 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:47.620968 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd276c-c392-4d69-be22-baf9701d3801 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:47.629401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 391/772] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:47.631539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e6f23-f51c-471c-b113-39cf40e16bbb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:47.631918 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e6f23-f51c-471c-b113-39cf40e16bbb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:47.632257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e6f23-f51c-471c-b113-39cf40e16bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:47.678097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0a8e6f23-f51c-471c-b113-39cf40e16bbb None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:47.681429 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0a8e6f23-f51c-471c-b113-39cf40e16bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:47.692222 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efa106-6c1c-4bed-8188-c1ab109ce9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:47.693858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efa106-6c1c-4bed-8188-c1ab109ce9ce None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:47.694634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efa106-6c1c-4bed-8188-c1ab109ce9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:47.695688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efa106-6c1c-4bed-8188-c1ab109ce9ce None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:47.699102 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efa106-6c1c-4bed-8188-c1ab109ce9ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:47.699993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:47.701718 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efa106-6c1c-4bed-8188-c1ab109ce9ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:47.709802 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efa106-6c1c-4bed-8188-c1ab109ce9ce None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:47.752245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 382/773] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:47.761887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efa106-6c1c-4bed-8188-c1ab109ce9ce None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:47.883271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 392/774] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:12:47.906874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e6f23-f51c-471c-b113-39cf40e16bbb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:47.955753 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efa106-6c1c-4bed-8188-c1ab109ce9ce None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:47.983026 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:48.026073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06f306-8543-46f5-8ae7-f72b2f0e5fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:48.027703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06f306-8543-46f5-8ae7-f72b2f0e5fee None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:48.028201 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06f306-8543-46f5-8ae7-f72b2f0e5fee None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:48.028689 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06f306-8543-46f5-8ae7-f72b2f0e5fee None admin] PATH_INFO: `/v3/projects/3f8ec287061141028659ab504e7707de/users/37a36c30e9dc472d97d762d236dd865a/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:48.035933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06f306-8543-46f5-8ae7-f72b2f0e5fee None admin] RBAC: Authorizing `identity:create_grant(project_id=3f8ec287061141028659ab504e7707de, user_id=37a36c30e9dc472d97d762d236dd865a, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:48.039060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06f306-8543-46f5-8ae7-f72b2f0e5fee None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:48.083909 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 383/775] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:12:47 2022] PUT /identity/v3/projects/3f8ec287061141028659ab504e7707de/users/37a36c30e9dc472d97d762d236dd865a/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:12:48.178866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e6f23-f51c-471c-b113-39cf40e16bbb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:48.268118 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a106d7d-afef-47e9-bf33-c4e82666d30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:48.269451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a106d7d-afef-47e9-bf33-c4e82666d30e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:48.269904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a106d7d-afef-47e9-bf33-c4e82666d30e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:48.270410 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a106d7d-afef-47e9-bf33-c4e82666d30e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:48.297301 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:48.298688 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a106d7d-afef-47e9-bf33-c4e82666d30e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:48.323840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5a106d7d-afef-47e9-bf33-c4e82666d30e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:48.323840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:48.323840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:48.323840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:48.323840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:48.323840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:48.323840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:48.323840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:48.323840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:48.323840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:48.323840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:48.323840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:48.323840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:48.323840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:48.323840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:48.323840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:48.324903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:48.324903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:48.324903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:48.324903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:48.324903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:48.324903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:48.324903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:48.324903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:48.324903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:48.324903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:48.324903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:48.324903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:48.324903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:48.324903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:48.324903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:48.324903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:48.325771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:48.325771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:48.325771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:48.325771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:48.325771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:48.325771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:48.325771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:48.325771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:48.325771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:48.325771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:48.325771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:48.325771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:48.326694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 393/776] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:48.334195 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06f306-8543-46f5-8ae7-f72b2f0e5fee None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:48.545931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06f306-8543-46f5-8ae7-f72b2f0e5fee None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:48.613552 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b364ef-c153-4624-afe6-ee8356b6518a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:48.614784 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b364ef-c153-4624-afe6-ee8356b6518a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:48.615274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b364ef-c153-4624-afe6-ee8356b6518a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:48.615778 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b364ef-c153-4624-afe6-ee8356b6518a None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:48.617219 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b364ef-c153-4624-afe6-ee8356b6518a None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:48.617769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b364ef-c153-4624-afe6-ee8356b6518a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:48.620492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b364ef-c153-4624-afe6-ee8356b6518a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:48.637533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 384/777] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:48.644201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a106d7d-afef-47e9-bf33-c4e82666d30e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:48.711942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc39368-0964-4645-8006-7473a5213cf0 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:48.712286 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc39368-0964-4645-8006-7473a5213cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:48.712507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc39368-0964-4645-8006-7473a5213cf0 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:48.714186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 385/778] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:48.723615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcab64-b2f6-4815-9c91-fac3de04e41e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:48.723927 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcab64-b2f6-4815-9c91-fac3de04e41e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:48.724166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcab64-b2f6-4815-9c91-fac3de04e41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:48.753642 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ffdcab64-b2f6-4815-9c91-fac3de04e41e None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:48.754917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ffdcab64-b2f6-4815-9c91-fac3de04e41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:48.824320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:48.865216 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a106d7d-afef-47e9-bf33-c4e82666d30e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:48.902606 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 386/779] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:12:48.905412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b7690-6c10-4a12-8f20-ebad18092e0c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:48.906031 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b7690-6c10-4a12-8f20-ebad18092e0c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:48.907248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b7690-6c10-4a12-8f20-ebad18092e0c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:48.920469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 387/780] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:48 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:48.929957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d547f1-273a-48e3-9604-58393d099ca7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:48.930554 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d547f1-273a-48e3-9604-58393d099ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:48.931076 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d547f1-273a-48e3-9604-58393d099ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:48.940382 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa585d06-691b-4f1f-baa5-f6e2865f1fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:48.941883 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa585d06-691b-4f1f-baa5-f6e2865f1fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:48.942436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa585d06-691b-4f1f-baa5-f6e2865f1fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:48.943046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa585d06-691b-4f1f-baa5-f6e2865f1fc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:48.971558 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa585d06-691b-4f1f-baa5-f6e2865f1fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:48.975450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa585d06-691b-4f1f-baa5-f6e2865f1fc8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:48.983428 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e3d547f1-273a-48e3-9604-58393d099ca7 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:48.985580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e3d547f1-273a-48e3-9604-58393d099ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:49.016950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-aa585d06-691b-4f1f-baa5-f6e2865f1fc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:49.016950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:49.016950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:49.016950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:49.016950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:49.016950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:49.016950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:49.016950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:49.016950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:49.016950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:49.016950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:49.016950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:49.016950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:49.016950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:49.016950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:49.019026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:49.020877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:49.020877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:49.020877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:49.020877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:49.020877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 394/781] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:49.022453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa585d06-691b-4f1f-baa5-f6e2865f1fc8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:49.114687 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 388/782] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:12:49.115906 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d547f1-273a-48e3-9604-58393d099ca7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:49.131899 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:49.231184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa585d06-691b-4f1f-baa5-f6e2865f1fc8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:49.238094 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:49.242975 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d547f1-273a-48e3-9604-58393d099ca7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:49.294613 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932d035-56f2-4dd6-8945-4389ee24523e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:49.295907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932d035-56f2-4dd6-8945-4389ee24523e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:49.296316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932d035-56f2-4dd6-8945-4389ee24523e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:49.296738 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932d035-56f2-4dd6-8945-4389ee24523e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:49.297554 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd2414-b065-4af6-9f85-73db6242cfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:49.298833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd2414-b065-4af6-9f85-73db6242cfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:49.299320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd2414-b065-4af6-9f85-73db6242cfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:49.299790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd2414-b065-4af6-9f85-73db6242cfc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:49.300736 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd2414-b065-4af6-9f85-73db6242cfc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:49.301245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd2414-b065-4af6-9f85-73db6242cfc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:49.302916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd2414-b065-4af6-9f85-73db6242cfc7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:49.316501 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932d035-56f2-4dd6-8945-4389ee24523e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:49.324234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 389/783] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:49.326147 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd2414-b065-4af6-9f85-73db6242cfc7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:49.335857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f932d035-56f2-4dd6-8945-4389ee24523e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:12:49.335857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:49.335857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:49.335857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:49.335857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:49.335857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:49.335857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:49.335857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:49.335857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:49.335857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:49.335857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:49.335857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:49.335857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:49.335857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:49.335857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:49.335857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:49.337679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:49.337679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:49.337679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:49.337679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:49.337679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:49.337679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:49.337679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:49.337679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:49.337679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:49.337679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:49.337679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:49.337679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:49.337679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:49.337679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:49.337679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:49.337679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:49.339146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:49.339146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:49.339146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:49.339146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:49.339146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:49.339146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:49.339146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:49.339146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:49.339146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:49.339146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:49.339146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:12:49.339146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:49.340716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 395/784] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:12:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:49.342438 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932d035-56f2-4dd6-8945-4389ee24523e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:49.509673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932d035-56f2-4dd6-8945-4389ee24523e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:49.529797 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:49.534118 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd2414-b065-4af6-9f85-73db6242cfc7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:49.562000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ffa4e-ee75-45d7-a9f4-60323f4e44bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:49.564022 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ffa4e-ee75-45d7-a9f4-60323f4e44bf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:49.564660 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ffa4e-ee75-45d7-a9f4-60323f4e44bf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:49.565090 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ffa4e-ee75-45d7-a9f4-60323f4e44bf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:49.576319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ffa4e-ee75-45d7-a9f4-60323f4e44bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:49.578178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ffa4e-ee75-45d7-a9f4-60323f4e44bf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:49.601659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7c8ffa4e-ee75-45d7-a9f4-60323f4e44bf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 15:12:49.601659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:49.601659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:49.601659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:49.601659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:49.601659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:49.601659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:49.601659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:49.601659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:49.601659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:49.601659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:49.601659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:49.601659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:49.601659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:49.601659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:49.601659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:49.602926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:49.604051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:49.604051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:49.604051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:49.604051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:49.604051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:49.604051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:49.604051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:49.604051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:49.604051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 15:12:49.604051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:49.606915 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914f36c-0908-4a12-8349-e98971683629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:49.608119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914f36c-0908-4a12-8349-e98971683629 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:49.608593 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914f36c-0908-4a12-8349-e98971683629 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:49.609050 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914f36c-0908-4a12-8349-e98971683629 None admin] PATH_INFO: `/v3/services/network` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:49.610176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914f36c-0908-4a12-8349-e98971683629 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:49.612026 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914f36c-0908-4a12-8349-e98971683629 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:49.613282 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 396/785] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 27 15:12:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:49.615069 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ffa4e-ee75-45d7-a9f4-60323f4e44bf None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b914f36c-0908-4a12-8349-e98971683629 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:49.632731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:49.633813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:49.633813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:49.633813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:49.633813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:49.633813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:49.633813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:49.633813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:12:49.633813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:12:49.633813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:12:49.633813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:12:49.633813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:49.633813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:49.633813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:49.633813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:49.633813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:49.633813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:49.634683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:49.634683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:49.634683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:49.634683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:49.634683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:49.634683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:49.634683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:49.634683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:49.634683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:49.634683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:49.634683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:12:49.634683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:12:49.634683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 15:12:49.634683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:49.638850 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 390/786] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:49 2022] GET /identity/v3/services/network => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:49.640393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914f36c-0908-4a12-8349-e98971683629 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:49.691533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:49.796717 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ffa4e-ee75-45d7-a9f4-60323f4e44bf None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:49.816253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914f36c-0908-4a12-8349-e98971683629 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:49.837288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1bc66-668f-4424-9a72-b00718804a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:49.837983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1bc66-668f-4424-9a72-b00718804a13 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:49.838696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1bc66-668f-4424-9a72-b00718804a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:49.838696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1bc66-668f-4424-9a72-b00718804a13 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:49.839388 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1bc66-668f-4424-9a72-b00718804a13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:49.839702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1bc66-668f-4424-9a72-b00718804a13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:49.841113 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1bc66-668f-4424-9a72-b00718804a13 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:49.851613 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 397/787] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:12:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:49.852554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1bc66-668f-4424-9a72-b00718804a13 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:49.867136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fedbcc-2daf-40e4-9756-7c01b4275c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:49.868198 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fedbcc-2daf-40e4-9756-7c01b4275c55 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:49.868675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fedbcc-2daf-40e4-9756-7c01b4275c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:49.869137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fedbcc-2daf-40e4-9756-7c01b4275c55 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:49.870842 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fedbcc-2daf-40e4-9756-7c01b4275c55 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:49.871382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fedbcc-2daf-40e4-9756-7c01b4275c55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:49.873631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fedbcc-2daf-40e4-9756-7c01b4275c55 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:49.898456 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 391/788] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Jun 27 15:12:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:49.899640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fedbcc-2daf-40e4-9756-7c01b4275c55 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:49.926816 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:50.006923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1bc66-668f-4424-9a72-b00718804a13 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:50.029780 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:50.049267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c8091-8cf7-414d-95d5-af46853e742c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:50.050354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c8091-8cf7-414d-95d5-af46853e742c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:50.050899 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c8091-8cf7-414d-95d5-af46853e742c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:50.051381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c8091-8cf7-414d-95d5-af46853e742c None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:50.052385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c8091-8cf7-414d-95d5-af46853e742c None admin] RBAC: Adding query filter params (name=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:50.052926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c8091-8cf7-414d-95d5-af46853e742c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:50.054931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c8091-8cf7-414d-95d5-af46853e742c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:50.055921 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fedbcc-2daf-40e4-9756-7c01b4275c55 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:50.061393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 398/789] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 27 15:12:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:50.062796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c8091-8cf7-414d-95d5-af46853e742c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:50.128436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec65068-bdd8-4576-9e6f-d680365ade39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:50.129740 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec65068-bdd8-4576-9e6f-d680365ade39 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:50.130252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec65068-bdd8-4576-9e6f-d680365ade39 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:50.130781 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec65068-bdd8-4576-9e6f-d680365ade39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:50.158160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec65068-bdd8-4576-9e6f-d680365ade39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:50.162852 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec65068-bdd8-4576-9e6f-d680365ade39 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:50.194120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-9ec65068-bdd8-4576-9e6f-d680365ade39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:50.194120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:50.194120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:50.194120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:50.194120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:50.194120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:50.194120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:50.194120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:50.194120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:50.194120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:50.194120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:50.194120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:50.194120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:50.194120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:50.194120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:50.195335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:50.196296 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:50.196296 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:50.196296 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:50.196296 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:50.199606 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 392/790] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:50.200978 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec65068-bdd8-4576-9e6f-d680365ade39 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:50.212644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:50.217455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c8091-8cf7-414d-95d5-af46853e742c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:50.267779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df36e9c-0a9d-45ee-84a9-14817b38a559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:50.269421 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df36e9c-0a9d-45ee-84a9-14817b38a559 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:50.270570 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df36e9c-0a9d-45ee-84a9-14817b38a559 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:50.271041 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df36e9c-0a9d-45ee-84a9-14817b38a559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:50.288141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df36e9c-0a9d-45ee-84a9-14817b38a559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:50.290688 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df36e9c-0a9d-45ee-84a9-14817b38a559 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:50.316638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-0df36e9c-0a9d-45ee-84a9-14817b38a559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:50.316638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:50.316638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:50.316638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:50.316638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:50.316638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:50.316638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:50.316638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:50.316638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:50.316638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:50.316638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:50.316638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:50.316638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:50.316638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:50.316638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:50.317576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:50.318545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:50.318545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:50.318545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:50.318545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:50.321591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 399/791] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:50.323273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df36e9c-0a9d-45ee-84a9-14817b38a559 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:50.357843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec65068-bdd8-4576-9e6f-d680365ade39 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:50.406716 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2bae7-3f9d-4e1f-9927-345d50b5c268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:50.408351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2bae7-3f9d-4e1f-9927-345d50b5c268 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:50.408689 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2bae7-3f9d-4e1f-9927-345d50b5c268 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:50.409626 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2bae7-3f9d-4e1f-9927-345d50b5c268 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:50.410443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2bae7-3f9d-4e1f-9927-345d50b5c268 None admin] RBAC: Adding query filter params (type=network) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:50.410754 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2bae7-3f9d-4e1f-9927-345d50b5c268 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:50.412489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2bae7-3f9d-4e1f-9927-345d50b5c268 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:50.414466 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:50.420719 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 393/792] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 27 15:12:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:50.423195 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2bae7-3f9d-4e1f-9927-345d50b5c268 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:50.499217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df36e9c-0a9d-45ee-84a9-14817b38a559 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:50.568403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235e0b4-082b-45f0-82de-0b1786376054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:50.569505 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235e0b4-082b-45f0-82de-0b1786376054 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:50.569976 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235e0b4-082b-45f0-82de-0b1786376054 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:50.570529 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235e0b4-082b-45f0-82de-0b1786376054 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:50.572001 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235e0b4-082b-45f0-82de-0b1786376054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:50.572536 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235e0b4-082b-45f0-82de-0b1786376054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:50.575314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235e0b4-082b-45f0-82de-0b1786376054 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:50.597228 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2bae7-3f9d-4e1f-9927-345d50b5c268 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:50.601038 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 400/793] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:50.603825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235e0b4-082b-45f0-82de-0b1786376054 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:50.634085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:50.644840 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4884d-0623-4d07-bd77-44f9cc609483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:50.645556 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4884d-0623-4d07-bd77-44f9cc609483 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:50.645889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4884d-0623-4d07-bd77-44f9cc609483 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:50.646125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4884d-0623-4d07-bd77-44f9cc609483 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:50.646871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4884d-0623-4d07-bd77-44f9cc609483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:50.647172 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4884d-0623-4d07-bd77-44f9cc609483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:50.648598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4884d-0623-4d07-bd77-44f9cc609483 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:50.662349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 394/794] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:50.663742 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb62b6-ba41-425e-b9d1-c12ce3f2a0f7 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:50.664107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb62b6-ba41-425e-b9d1-c12ce3f2a0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:50.664396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb62b6-ba41-425e-b9d1-c12ce3f2a0f7 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:50.672587 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 395/795] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:50.672587 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb62b6-ba41-425e-b9d1-c12ce3f2a0f7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:50.764362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:50.785156 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235e0b4-082b-45f0-82de-0b1786376054 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:50.826784 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2308f48-a738-4820-80b0-7e3bf127dd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:50.827368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2308f48-a738-4820-80b0-7e3bf127dd22 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:50.827651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2308f48-a738-4820-80b0-7e3bf127dd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:50.828099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2308f48-a738-4820-80b0-7e3bf127dd22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:50.829079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2308f48-a738-4820-80b0-7e3bf127dd22 None admin] RBAC: Adding query filter params (interface=public, service_id=a25c0630a6a3414bbe9e3316b76e302f, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:50.829388 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2308f48-a738-4820-80b0-7e3bf127dd22 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:50.831029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2308f48-a738-4820-80b0-7e3bf127dd22 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:50.837781 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 401/796] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Jun 27 15:12:50 2022] GET /identity/v3/endpoints?service_id=a25c0630a6a3414bbe9e3316b76e302f&interface=public®ion_id=RegionOne => generated 194 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:50.838602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2308f48-a738-4820-80b0-7e3bf127dd22 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:50.850276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb62b6-ba41-425e-b9d1-c12ce3f2a0f7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:50.928573 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6d8f1-58a3-4df0-b4c4-35a14f341a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:50.930292 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6d8f1-58a3-4df0-b4c4-35a14f341a23 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:50.930774 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6d8f1-58a3-4df0-b4c4-35a14f341a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:50.931234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6d8f1-58a3-4df0-b4c4-35a14f341a23 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:50.946292 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6d8f1-58a3-4df0-b4c4-35a14f341a23 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:50.949180 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6d8f1-58a3-4df0-b4c4-35a14f341a23 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:50.955859 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:50.979557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a8a6d8f1-58a3-4df0-b4c4-35a14f341a23 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 15:12:50.979557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:50.979557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:50.979557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:50.979557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:50.979557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:50.979557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:50.979557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:50.979557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:50.979557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:50.979557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:50.979557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:50.979557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:50.979557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:50.979557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:50.979557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:50.981510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:50.983589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:50.983589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:50.983589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:50.983589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:50.983589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:50.983589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:50.983589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:50.983589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:50.983589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 15:12:50.983589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:50.989788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2308f48-a738-4820-80b0-7e3bf127dd22 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:50.990129 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 396/797] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:12:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:50.992497 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f408462-a577-4936-a48d-9186cde4c814 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:50.993011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f408462-a577-4936-a48d-9186cde4c814 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:50.993513 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f408462-a577-4936-a48d-9186cde4c814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:51.023046 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2f408462-a577-4936-a48d-9186cde4c814 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:51.025160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2f408462-a577-4936-a48d-9186cde4c814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:51.030618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea27d95-91c7-440c-9cd2-a6683aa35334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:51.031686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea27d95-91c7-440c-9cd2-a6683aa35334 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:51.032072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea27d95-91c7-440c-9cd2-a6683aa35334 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:51.032522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea27d95-91c7-440c-9cd2-a6683aa35334 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:51.040290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea27d95-91c7-440c-9cd2-a6683aa35334 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:51.041759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea27d95-91c7-440c-9cd2-a6683aa35334 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:51.057573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3ea27d95-91c7-440c-9cd2-a6683aa35334 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:51.057573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:51.057573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:51.057573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:51.057573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:51.057573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:51.057573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:51.057573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:51.057573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:51.057573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:51.057573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:51.057573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:51.057573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:51.057573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:51.057573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:51.059317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:51.060287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:51.060287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:51.060287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:51.060287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:51.060287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:51.060287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:51.060287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:51.060287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:51.060287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 402/798] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:51.060287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea27d95-91c7-440c-9cd2-a6683aa35334 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:51.118308 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 397/799] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:12:51.119707 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c95e3c-c4f8-416e-8ec1-c0bdeb8f79d0 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:51.119999 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c95e3c-c4f8-416e-8ec1-c0bdeb8f79d0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:51.120275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c95e3c-c4f8-416e-8ec1-c0bdeb8f79d0 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:51.126390 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 398/800] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:51.126390 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c95e3c-c4f8-416e-8ec1-c0bdeb8f79d0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:51.189075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:51.221297 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea27d95-91c7-440c-9cd2-a6683aa35334 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:51.261041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c95e3c-c4f8-416e-8ec1-c0bdeb8f79d0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:51.279892 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29eaa8-d363-4678-aebe-8bdbcc970a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:51.280812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29eaa8-d363-4678-aebe-8bdbcc970a87 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:51.280968 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29eaa8-d363-4678-aebe-8bdbcc970a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:51.281138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29eaa8-d363-4678-aebe-8bdbcc970a87 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:51.281941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29eaa8-d363-4678-aebe-8bdbcc970a87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:51.283550 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29eaa8-d363-4678-aebe-8bdbcc970a87 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:51.285024 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:51.290777 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 403/801] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 27 15:12:51 2022] GET /identity/v3/services => generated 772 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:51.295746 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29eaa8-d363-4678-aebe-8bdbcc970a87 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:51.325811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247516e9-e25b-44f4-bab8-f1b36ea3df79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:51.327113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247516e9-e25b-44f4-bab8-f1b36ea3df79 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:51.328654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247516e9-e25b-44f4-bab8-f1b36ea3df79 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:51.329149 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247516e9-e25b-44f4-bab8-f1b36ea3df79 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:51.331401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247516e9-e25b-44f4-bab8-f1b36ea3df79 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:51.332262 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247516e9-e25b-44f4-bab8-f1b36ea3df79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:51.336571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247516e9-e25b-44f4-bab8-f1b36ea3df79 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:51.369159 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 399/802] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Jun 27 15:12:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:51.371414 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb4152-dd53-4f3d-a0ac-33d46351fe29 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:51.372042 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb4152-dd53-4f3d-a0ac-33d46351fe29 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:51.372502 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb4152-dd53-4f3d-a0ac-33d46351fe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:51.402890 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-31fb4152-dd53-4f3d-a0ac-33d46351fe29 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:51.404880 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-31fb4152-dd53-4f3d-a0ac-33d46351fe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:51.458130 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29eaa8-d363-4678-aebe-8bdbcc970a87 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:51.505753 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c769d1a-7dac-4eb1-8121-1c5271a0cf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:51.506476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c769d1a-7dac-4eb1-8121-1c5271a0cf2c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:51.506758 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c769d1a-7dac-4eb1-8121-1c5271a0cf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:51.507033 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c769d1a-7dac-4eb1-8121-1c5271a0cf2c None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:51.507834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c769d1a-7dac-4eb1-8121-1c5271a0cf2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:51.508142 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c769d1a-7dac-4eb1-8121-1c5271a0cf2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:51.509581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c769d1a-7dac-4eb1-8121-1c5271a0cf2c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:51.524430 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 404/803] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:51.525288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c769d1a-7dac-4eb1-8121-1c5271a0cf2c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:51.527012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 400/804] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:12:51.528713 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb4152-dd53-4f3d-a0ac-33d46351fe29 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:51.592657 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:51.644201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:51.718591 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb4152-dd53-4f3d-a0ac-33d46351fe29 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:51.719294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c769d1a-7dac-4eb1-8121-1c5271a0cf2c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:51.777498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3fe6d-5cf3-4403-8c07-8294f562e361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:51.778855 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3fe6d-5cf3-4403-8c07-8294f562e361 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:51.779331 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3fe6d-5cf3-4403-8c07-8294f562e361 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:51.779786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3fe6d-5cf3-4403-8c07-8294f562e361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:51.782487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688c4fe-5085-42ec-a50b-cddf9addbf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:51.784039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688c4fe-5085-42ec-a50b-cddf9addbf46 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:51.784677 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688c4fe-5085-42ec-a50b-cddf9addbf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:51.785284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688c4fe-5085-42ec-a50b-cddf9addbf46 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:51.786678 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688c4fe-5085-42ec-a50b-cddf9addbf46 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:51.789391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688c4fe-5085-42ec-a50b-cddf9addbf46 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:51.798666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3fe6d-5cf3-4403-8c07-8294f562e361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:51.801397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3fe6d-5cf3-4403-8c07-8294f562e361 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:51.813596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a688c4fe-5085-42ec-a50b-cddf9addbf46 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 15:12:51.813596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:51.813596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:12:51.813596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:12:51.813596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:12:51.813596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:12:51.813596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:12:51.813596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:12:51.813596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 15:12:51.813596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:51.813596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:12:51.813596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:51.813596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:51.813596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:51.813596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:51.813596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:51.814791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:51.814791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:51.814791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:51.814791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:51.814791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:51.814791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:51.814791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:51.814791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:12:51.814791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:12:51.814791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:12:51.814791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:12:51.814791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:51.814791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:51.814791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:51.814791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:51.814791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:51.815761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:51.815761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:51.815761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:51.815761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:51.815761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:51.815761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:51.815761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:51.815761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:51.815761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:51.815761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:51.815761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:51.815761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:12:51.815761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:12:51.815761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 15:12:51.815761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:51.817506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 405/805] 10.222.0.33 () {56 vars in 1129 bytes} [Mon Jun 27 15:12:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:51.818886 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688c4fe-5085-42ec-a50b-cddf9addbf46 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:51.831462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c1c3fe6d-5cf3-4403-8c07-8294f562e361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:51.831462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:51.831462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:51.831462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:51.831462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:51.831462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:51.831462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:51.831462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:51.831462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:51.831462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:51.831462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:51.831462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:51.831462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:51.831462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:51.831462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:51.833370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:51.835490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:51.835490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:51.835490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:51.835490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:51.835490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 401/806] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:51.839421 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3fe6d-5cf3-4403-8c07-8294f562e361 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:51.945611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:51.959482 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688c4fe-5085-42ec-a50b-cddf9addbf46 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:51.966555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3fe6d-5cf3-4403-8c07-8294f562e361 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:51.987460 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:52.002171 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00c679-32e0-4991-8bad-48429b13155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:52.003433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00c679-32e0-4991-8bad-48429b13155c None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:52.003884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00c679-32e0-4991-8bad-48429b13155c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:52.004352 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00c679-32e0-4991-8bad-48429b13155c None admin] PATH_INFO: `/v3/projects/3f8ec287061141028659ab504e7707de/users/6f3dfc12a3ac499da540065c03bd2a82/roles/c5b95b7a83d94e99a828c836efe01929` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:52.010176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb2316-c922-4744-b68b-f4447bfdacd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:52.011146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb2316-c922-4744-b68b-f4447bfdacd7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:52.011497 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb2316-c922-4744-b68b-f4447bfdacd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:52.011842 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb2316-c922-4744-b68b-f4447bfdacd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:52.023807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00c679-32e0-4991-8bad-48429b13155c None admin] RBAC: Authorizing `identity:create_grant(project_id=3f8ec287061141028659ab504e7707de, user_id=6f3dfc12a3ac499da540065c03bd2a82, role_id=c5b95b7a83d94e99a828c836efe01929)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:52.025145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb2316-c922-4744-b68b-f4447bfdacd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:52.025679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00c679-32e0-4991-8bad-48429b13155c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:52.034835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-7fbb2316-c922-4744-b68b-f4447bfdacd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:12:52.034835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:52.034835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:52.034835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:52.034835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:52.034835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:52.034835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:52.034835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:52.034835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:52.034835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:52.034835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:52.034835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:52.034835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:52.034835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:52.034835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:52.034835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:52.036882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:52.036882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:52.036882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:52.036882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:52.036882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:52.036882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:52.036882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:52.036882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:52.036882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:52.036882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:52.036882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:52.036882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:52.036882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:52.036882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:52.036882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:52.036882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:52.037943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:52.037943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:52.037943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:52.037943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:52.037943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:52.037943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:52.037943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:52.037943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:52.037943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:52.037943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:52.037943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:12:52.037943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:52.044189 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 402/807] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:12:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:52.045467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb2316-c922-4744-b68b-f4447bfdacd7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:52.055106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 406/808] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:12:51 2022] PUT /identity/v3/projects/3f8ec287061141028659ab504e7707de/users/6f3dfc12a3ac499da540065c03bd2a82/roles/c5b95b7a83d94e99a828c836efe01929 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:12:52.055106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00c679-32e0-4991-8bad-48429b13155c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:52.235272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb2316-c922-4744-b68b-f4447bfdacd7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:52.242557 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00c679-32e0-4991-8bad-48429b13155c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:52.284149 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e94a4f-f923-475b-bafa-d59f57b4e03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:52.285466 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e94a4f-f923-475b-bafa-d59f57b4e03a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:52.285967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e94a4f-f923-475b-bafa-d59f57b4e03a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:52.286515 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e94a4f-f923-475b-bafa-d59f57b4e03a None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:52.288008 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e94a4f-f923-475b-bafa-d59f57b4e03a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:52.288571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e94a4f-f923-475b-bafa-d59f57b4e03a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:52.291013 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e94a4f-f923-475b-bafa-d59f57b4e03a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:52.299311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 403/809] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Jun 27 15:12:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:52.300533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e94a4f-f923-475b-bafa-d59f57b4e03a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:52.314930 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960f145-2d0b-4c1a-8642-7965c3b285d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:52.316316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960f145-2d0b-4c1a-8642-7965c3b285d6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:52.316906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960f145-2d0b-4c1a-8642-7965c3b285d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:52.317480 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960f145-2d0b-4c1a-8642-7965c3b285d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:52.318953 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960f145-2d0b-4c1a-8642-7965c3b285d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:52.319636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960f145-2d0b-4c1a-8642-7965c3b285d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:52.323092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960f145-2d0b-4c1a-8642-7965c3b285d6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:52.335947 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:52.352579 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 407/810] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:52.355099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960f145-2d0b-4c1a-8642-7965c3b285d6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:52.425862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:52.533531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e94a4f-f923-475b-bafa-d59f57b4e03a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:52.575909 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960f145-2d0b-4c1a-8642-7965c3b285d6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:52.602330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e079a0a-6167-41a5-8bb4-ba612aec7013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:52.603449 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e079a0a-6167-41a5-8bb4-ba612aec7013 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:52.603974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e079a0a-6167-41a5-8bb4-ba612aec7013 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:52.604471 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e079a0a-6167-41a5-8bb4-ba612aec7013 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:52.606147 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e079a0a-6167-41a5-8bb4-ba612aec7013 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:52.606718 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e079a0a-6167-41a5-8bb4-ba612aec7013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:52.610260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e079a0a-6167-41a5-8bb4-ba612aec7013 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:52.630479 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 404/811] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:12:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:52.632429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e079a0a-6167-41a5-8bb4-ba612aec7013 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:52.655391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d484e-4edf-44a3-845a-d83f03075534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:52.656585 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d484e-4edf-44a3-845a-d83f03075534 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:52.657114 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d484e-4edf-44a3-845a-d83f03075534 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:52.657622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d484e-4edf-44a3-845a-d83f03075534 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:52.659428 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d484e-4edf-44a3-845a-d83f03075534 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:52.660056 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d484e-4edf-44a3-845a-d83f03075534 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:52.662935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d484e-4edf-44a3-845a-d83f03075534 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:52.678603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 408/812] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Jun 27 15:12:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:52.678603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d484e-4edf-44a3-845a-d83f03075534 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:52.788060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:52.810601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:52.823441 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d484e-4edf-44a3-845a-d83f03075534 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:52.833265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e079a0a-6167-41a5-8bb4-ba612aec7013 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:52.871324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1d053-b79e-4e44-aaf0-a7242eafd2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:52.872185 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1d053-b79e-4e44-aaf0-a7242eafd2ca None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:52.872532 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1d053-b79e-4e44-aaf0-a7242eafd2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:52.872952 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1d053-b79e-4e44-aaf0-a7242eafd2ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:52.874294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad9815-67bb-484e-a8ba-745d5a13bea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:52.876255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad9815-67bb-484e-a8ba-745d5a13bea2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:52.876740 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad9815-67bb-484e-a8ba-745d5a13bea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:52.877157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad9815-67bb-484e-a8ba-745d5a13bea2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:52.881158 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1d053-b79e-4e44-aaf0-a7242eafd2ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:52.882737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1d053-b79e-4e44-aaf0-a7242eafd2ca None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:52.890317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad9815-67bb-484e-a8ba-745d5a13bea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:52.892911 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad9815-67bb-484e-a8ba-745d5a13bea2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:52.898504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-06f1d053-b79e-4e44-aaf0-a7242eafd2ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:52.898504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:52.898504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:52.898504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:52.898504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:52.898504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:52.898504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:52.898504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:52.898504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:52.898504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:52.898504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:52.898504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:52.898504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:52.898504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:52.898504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:52.899504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:52.900493 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:52.900493 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:52.900493 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:52.900493 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:52.900493 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:52.900493 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:52.900493 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:52.900493 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:52.904750 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 405/813] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:52.906003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1d053-b79e-4e44-aaf0-a7242eafd2ca None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:52.916347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3cad9815-67bb-484e-a8ba-745d5a13bea2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:52.916347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:52.916347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:52.916347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:52.916347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:52.916347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:52.916347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:52.916347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:52.916347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:52.916347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:52.916347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:52.916347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:52.916347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:52.916347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:52.916347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:52.917379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:52.918371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:52.918371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:52.918371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:52.918371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:52.925609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 409/814] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:52.926955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad9815-67bb-484e-a8ba-745d5a13bea2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:53.019840 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1d053-b79e-4e44-aaf0-a7242eafd2ca None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:53.043885 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad9815-67bb-484e-a8ba-745d5a13bea2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:53.059681 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2279717-0a4b-4524-b10f-9266748f754f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:53.060678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279717-0a4b-4524-b10f-9266748f754f None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:53.060971 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279717-0a4b-4524-b10f-9266748f754f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:53.061252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279717-0a4b-4524-b10f-9266748f754f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:53.062108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2279717-0a4b-4524-b10f-9266748f754f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:53.063859 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2279717-0a4b-4524-b10f-9266748f754f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:53.067885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:53.090406 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688ab50-d670-4393-925c-0442423f9558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:53.091461 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688ab50-d670-4393-925c-0442423f9558 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:53.091897 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688ab50-d670-4393-925c-0442423f9558 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:53.092361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688ab50-d670-4393-925c-0442423f9558 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:53.093358 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688ab50-d670-4393-925c-0442423f9558 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:53.093958 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688ab50-d670-4393-925c-0442423f9558 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:53.096378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688ab50-d670-4393-925c-0442423f9558 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:53.101125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 406/815] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 27 15:12:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:12:53.102370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2279717-0a4b-4524-b10f-9266748f754f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:53.126660 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 410/816] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:53.135792 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688ab50-d670-4393-925c-0442423f9558 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:53.162806 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:53.369187 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688ab50-d670-4393-925c-0442423f9558 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:53.405669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2279717-0a4b-4524-b10f-9266748f754f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:53.433865 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea836a-d83b-4f23-935a-650881633873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:53.435247 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea836a-d83b-4f23-935a-650881633873 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:53.435534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea836a-d83b-4f23-935a-650881633873 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:53.435816 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea836a-d83b-4f23-935a-650881633873 None admin] PATH_INFO: `/v3/projects/3f8ec287061141028659ab504e7707de/users/0e419f9caf0a4ccb8108d375f527006e/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:53.443621 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea836a-d83b-4f23-935a-650881633873 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f8ec287061141028659ab504e7707de, user_id=0e419f9caf0a4ccb8108d375f527006e, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:53.445416 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea836a-d83b-4f23-935a-650881633873 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:53.462792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0e8e1-b2ff-44b5-a052-60a555bff040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:53.464328 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0e8e1-b2ff-44b5-a052-60a555bff040 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:53.464807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0e8e1-b2ff-44b5-a052-60a555bff040 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:53.465301 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0e8e1-b2ff-44b5-a052-60a555bff040 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:53.466730 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0e8e1-b2ff-44b5-a052-60a555bff040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:53.467247 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0e8e1-b2ff-44b5-a052-60a555bff040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:53.469730 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0e8e1-b2ff-44b5-a052-60a555bff040 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:53.473318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 411/817] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:12:53 2022] PUT /identity/v3/projects/3f8ec287061141028659ab504e7707de/users/0e419f9caf0a4ccb8108d375f527006e/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:12:53.498462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 407/818] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:53.505421 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea836a-d83b-4f23-935a-650881633873 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:53.629590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:53.684011 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea836a-d83b-4f23-935a-650881633873 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:53.729798 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097ab72-8753-44ce-8305-12123b686144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:53.730812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097ab72-8753-44ce-8305-12123b686144 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:53.731105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097ab72-8753-44ce-8305-12123b686144 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:53.731395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097ab72-8753-44ce-8305-12123b686144 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:53.741076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097ab72-8753-44ce-8305-12123b686144 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:53.742641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097ab72-8753-44ce-8305-12123b686144 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:53.760379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f097ab72-8753-44ce-8305-12123b686144 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:12:53.760379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:53.760379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:53.760379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:53.760379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:53.760379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:53.760379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:53.760379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:53.760379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:53.760379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:53.760379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:53.760379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:53.760379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:53.760379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:53.760379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:53.760379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:53.762739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:53.765023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:53.765023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:53.765023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:53.765023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:53.765023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:53.765023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:53.765023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:53.765023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:53.765023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:12:53.765023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:53.765023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 412/819] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 27 15:12:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:53.773921 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0e8e1-b2ff-44b5-a052-60a555bff040 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:53.841357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:53.909862 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0e8e1-b2ff-44b5-a052-60a555bff040 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:53.958606 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb791d9f-3a9c-4291-a88c-322abf3fb1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:53.959321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791d9f-3a9c-4291-a88c-322abf3fb1cc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:53.959612 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791d9f-3a9c-4291-a88c-322abf3fb1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:53.959896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791d9f-3a9c-4291-a88c-322abf3fb1cc None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:53.960777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb791d9f-3a9c-4291-a88c-322abf3fb1cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:53.961092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb791d9f-3a9c-4291-a88c-322abf3fb1cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:53.962614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb791d9f-3a9c-4291-a88c-322abf3fb1cc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:53.984630 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 408/820] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 27 15:12:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:53.993377 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097ab72-8753-44ce-8305-12123b686144 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:54.109267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097ab72-8753-44ce-8305-12123b686144 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:54.146635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:54.158772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1921b09-2035-4602-91f3-a52c1a54b897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:54.159566 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1921b09-2035-4602-91f3-a52c1a54b897 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:54.160204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1921b09-2035-4602-91f3-a52c1a54b897 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:54.160469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1921b09-2035-4602-91f3-a52c1a54b897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:54.272158 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1921b09-2035-4602-91f3-a52c1a54b897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:54.273735 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1921b09-2035-4602-91f3-a52c1a54b897 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:54.403754 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e053d6-f581-43d2-87c0-070e849a60be None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:54.404603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e053d6-f581-43d2-87c0-070e849a60be None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:54.405164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e053d6-f581-43d2-87c0-070e849a60be None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:54.408952 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 409/821] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:12:54.423484 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6698b2a-a26b-4511-9ea4-0d8d0ca65195 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:54.424006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6698b2a-a26b-4511-9ea4-0d8d0ca65195 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:54.424581 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6698b2a-a26b-4511-9ea4-0d8d0ca65195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:54.430926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 413/822] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:12:54.449147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1921b09-2035-4602-91f3-a52c1a54b897 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:54.482676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:54.484181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b6698b2a-a26b-4511-9ea4-0d8d0ca65195 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:54.487377 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b6698b2a-a26b-4511-9ea4-0d8d0ca65195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:54.618668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 410/823] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:12:54.651934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1921b09-2035-4602-91f3-a52c1a54b897 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:54.671915 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6698b2a-a26b-4511-9ea4-0d8d0ca65195 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:54.697462 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469230f-b575-4fc9-81ce-66cc1e93c99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:54.698655 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469230f-b575-4fc9-81ce-66cc1e93c99c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:54.698943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469230f-b575-4fc9-81ce-66cc1e93c99c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:54.699224 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469230f-b575-4fc9-81ce-66cc1e93c99c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:54.714468 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469230f-b575-4fc9-81ce-66cc1e93c99c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:54.716441 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469230f-b575-4fc9-81ce-66cc1e93c99c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:54.725447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:54.738874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1469230f-b575-4fc9-81ce-66cc1e93c99c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:54.738874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:54.738874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:54.738874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:54.738874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:54.738874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:54.738874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:54.738874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:54.738874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:54.738874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:54.738874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:54.738874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:54.738874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:54.738874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:54.738874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:54.740772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:54.742775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:54.742775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:54.742775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:54.742775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:54.745240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 414/824] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:54.747151 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773a63f-3950-4d75-b6f4-6ba2d05cdb28 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:54.747447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773a63f-3950-4d75-b6f4-6ba2d05cdb28 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:54.747731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773a63f-3950-4d75-b6f4-6ba2d05cdb28 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:54.749476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 415/825] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:54.756312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773a63f-3950-4d75-b6f4-6ba2d05cdb28 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:54.857278 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6698b2a-a26b-4511-9ea4-0d8d0ca65195 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:54.873441 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:54.901142 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773a63f-3950-4d75-b6f4-6ba2d05cdb28 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:54.925928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd7312-301b-4af6-b827-b4e3b8365ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:54.927866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd7312-301b-4af6-b827-b4e3b8365ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:54.928617 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd7312-301b-4af6-b827-b4e3b8365ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:54.929742 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd7312-301b-4af6-b827-b4e3b8365ec7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:54.931281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd7312-301b-4af6-b827-b4e3b8365ec7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:54.934150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd7312-301b-4af6-b827-b4e3b8365ec7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:54.944838 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d21690-e98c-4a61-88ca-46e871301025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:54.945516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d21690-e98c-4a61-88ca-46e871301025 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:54.946024 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d21690-e98c-4a61-88ca-46e871301025 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:54.946338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d21690-e98c-4a61-88ca-46e871301025 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:54.947077 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d21690-e98c-4a61-88ca-46e871301025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:54.947385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d21690-e98c-4a61-88ca-46e871301025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:54.948843 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d21690-e98c-4a61-88ca-46e871301025 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f3bd7312-301b-4af6-b827-b4e3b8365ec7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:54.959307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:54.961270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:54.961270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:54.961270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:54.961270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:54.961270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:54.961270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:54.961270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:12:54.961270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:12:54.961270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:12:54.961270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:12:54.961270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:54.961270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:54.961270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:54.961270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:54.961270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:54.961270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:54.963517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:54.963517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:54.963517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:54.963517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:54.963517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:54.963517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:54.963517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:54.963517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:54.963517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:54.963517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:54.963517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:12:54.963517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:12:54.963517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 15:12:54.963517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:54.965040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 416/826] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:54.965040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473a98d-d271-46f7-8d37-c26dc7f2069a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:54.965040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473a98d-d271-46f7-8d37-c26dc7f2069a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:54.965040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473a98d-d271-46f7-8d37-c26dc7f2069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:54.974449 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 411/827] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:54 2022] GET /identity/v3/services/network => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:12:54.976300 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd7312-301b-4af6-b827-b4e3b8365ec7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:54.982554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4473a98d-d271-46f7-8d37-c26dc7f2069a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:54.983851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4473a98d-d271-46f7-8d37-c26dc7f2069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:55.079094 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 417/828] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:12:55.083146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473a98d-d271-46f7-8d37-c26dc7f2069a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:55.167255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:55.173446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd7312-301b-4af6-b827-b4e3b8365ec7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:55.218375 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2c31e-2eab-4a49-8e66-60a2924cc252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:55.219367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2c31e-2eab-4a49-8e66-60a2924cc252 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:55.219768 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2c31e-2eab-4a49-8e66-60a2924cc252 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:55.220053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2c31e-2eab-4a49-8e66-60a2924cc252 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:55.230097 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2c31e-2eab-4a49-8e66-60a2924cc252 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:55.232167 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2c31e-2eab-4a49-8e66-60a2924cc252 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:55.251095 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:55.260669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ffe2c31e-2eab-4a49-8e66-60a2924cc252 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:55.260669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:55.260669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:55.260669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:55.260669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:55.260669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:55.260669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:55.260669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:55.260669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:55.260669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:55.260669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:55.260669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:55.260669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:55.260669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:55.260669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:55.262671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:55.264446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:55.264446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:55.264446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:55.264446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:55.264446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:55.264446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:55.264446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:55.264446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:55.264446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 412/829] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:55.265491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2c31e-2eab-4a49-8e66-60a2924cc252 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:55.309126 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473a98d-d271-46f7-8d37-c26dc7f2069a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:55.381381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1088ac-5a3b-4d32-a754-2313580a8b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:55.382599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2c31e-2eab-4a49-8e66-60a2924cc252 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:55.383515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1088ac-5a3b-4d32-a754-2313580a8b1c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:55.384708 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1088ac-5a3b-4d32-a754-2313580a8b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:55.386560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1088ac-5a3b-4d32-a754-2313580a8b1c None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:55.387326 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1088ac-5a3b-4d32-a754-2313580a8b1c None admin] RBAC: Adding query filter params (name=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:55.387635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1088ac-5a3b-4d32-a754-2313580a8b1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:55.389077 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1088ac-5a3b-4d32-a754-2313580a8b1c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:55.411175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 418/830] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 27 15:12:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:55.411175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1088ac-5a3b-4d32-a754-2313580a8b1c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:55.447159 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f62453-a28d-42a4-b49c-a599a18c682d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:55.448004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f62453-a28d-42a4-b49c-a599a18c682d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:55.448351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f62453-a28d-42a4-b49c-a599a18c682d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:55.448511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f62453-a28d-42a4-b49c-a599a18c682d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:55.462707 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f62453-a28d-42a4-b49c-a599a18c682d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:55.471150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e6f62453-a28d-42a4-b49c-a599a18c682d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:55.471150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:55.471150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:55.471150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:55.471150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:55.471150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:55.471150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:55.471150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:55.471150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:55.471150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:55.471150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:55.471150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:55.471150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:55.471150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:55.471150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:55.471150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:55.473431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:55.473431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:55.473431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:55.473431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:55.473431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:55.473431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:55.473431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:55.473431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:55.473431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:55.473431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:55.473431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:55.473431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:55.473431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:55.473431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:55.473431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:55.473431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:55.475335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:55.475335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:55.475335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:55.475335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:55.475335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:55.475335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:55.475335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:55.475335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:55.475335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:55.475335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:55.475335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:12:55.475335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:55.477750 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 413/831] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:12:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:55.478862 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f62453-a28d-42a4-b49c-a599a18c682d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:55.504502 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:55.590529 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1088ac-5a3b-4d32-a754-2313580a8b1c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:55.651935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1ff57-9666-4f1d-ac6f-2f96d5e0119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:55.652698 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1ff57-9666-4f1d-ac6f-2f96d5e0119f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:55.652942 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1ff57-9666-4f1d-ac6f-2f96d5e0119f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:55.653186 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1ff57-9666-4f1d-ac6f-2f96d5e0119f None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:55.653987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1ff57-9666-4f1d-ac6f-2f96d5e0119f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:55.654553 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1ff57-9666-4f1d-ac6f-2f96d5e0119f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:55.657390 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1ff57-9666-4f1d-ac6f-2f96d5e0119f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:55.658322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:55.676768 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 419/832] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:55.677734 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1ff57-9666-4f1d-ac6f-2f96d5e0119f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:55.696754 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f62453-a28d-42a4-b49c-a599a18c682d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:55.757915 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3819bac-a2ff-4133-8510-e4396fe9b1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:55.758522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3819bac-a2ff-4133-8510-e4396fe9b1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:55.758804 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3819bac-a2ff-4133-8510-e4396fe9b1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:55.759086 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3819bac-a2ff-4133-8510-e4396fe9b1d8 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:55.759831 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3819bac-a2ff-4133-8510-e4396fe9b1d8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:55.760118 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3819bac-a2ff-4133-8510-e4396fe9b1d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:55.761597 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3819bac-a2ff-4133-8510-e4396fe9b1d8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:55.778367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 414/833] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 27 15:12:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:55.778367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3819bac-a2ff-4133-8510-e4396fe9b1d8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:55.836662 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1ff57-9666-4f1d-ac6f-2f96d5e0119f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:55.877391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697d98c-e95b-45b9-a3e6-d724b145405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:55.878080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697d98c-e95b-45b9-a3e6-d724b145405e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:55.878389 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697d98c-e95b-45b9-a3e6-d724b145405e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:55.878664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697d98c-e95b-45b9-a3e6-d724b145405e None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:55.879424 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697d98c-e95b-45b9-a3e6-d724b145405e None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:55.879731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697d98c-e95b-45b9-a3e6-d724b145405e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:55.881142 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697d98c-e95b-45b9-a3e6-d724b145405e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:55.894501 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 420/834] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:12:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:55.895514 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697d98c-e95b-45b9-a3e6-d724b145405e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:55.963447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:55.969977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:55.996207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3819bac-a2ff-4133-8510-e4396fe9b1d8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:56.040301 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d0f4d-07aa-44ab-a4c3-fff5a4e1ab92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:56.041157 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d0f4d-07aa-44ab-a4c3-fff5a4e1ab92 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:56.041577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d0f4d-07aa-44ab-a4c3-fff5a4e1ab92 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:56.042029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d0f4d-07aa-44ab-a4c3-fff5a4e1ab92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:56.043118 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d0f4d-07aa-44ab-a4c3-fff5a4e1ab92 None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=37a36c30e9dc472d97d762d236dd865a) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:56.043570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d0f4d-07aa-44ab-a4c3-fff5a4e1ab92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:56.045258 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d0f4d-07aa-44ab-a4c3-fff5a4e1ab92 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:56.062742 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 415/835] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:12:55 2022] GET /identity/v3/role_assignments?user.id=37a36c30e9dc472d97d762d236dd865a&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:56.062742 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d0f4d-07aa-44ab-a4c3-fff5a4e1ab92 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:56.157414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697d98c-e95b-45b9-a3e6-d724b145405e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:56.205276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba1e52-ffe6-4955-96e7-85840a5575e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:56.205961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba1e52-ffe6-4955-96e7-85840a5575e4 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:56.206262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba1e52-ffe6-4955-96e7-85840a5575e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:56.206546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba1e52-ffe6-4955-96e7-85840a5575e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:56.207461 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba1e52-ffe6-4955-96e7-85840a5575e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:56.208888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba1e52-ffe6-4955-96e7-85840a5575e4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:56.243168 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 421/836] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 27 15:12:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:12:56.243168 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8121c-402e-471e-abd0-95a9db7ad56a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:56.243168 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8121c-402e-471e-abd0-95a9db7ad56a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:56.243168 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8121c-402e-471e-abd0-95a9db7ad56a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:56.243168 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 422/837] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:56.260469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80e52d-f9a4-4eb9-a695-48c2b012b7bc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:56.260919 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80e52d-f9a4-4eb9-a695-48c2b012b7bc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:56.261496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80e52d-f9a4-4eb9-a695-48c2b012b7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:56.303936 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8b80e52d-f9a4-4eb9-a695-48c2b012b7bc None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:56.306169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8b80e52d-f9a4-4eb9-a695-48c2b012b7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:56.323681 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d0f4d-07aa-44ab-a4c3-fff5a4e1ab92 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:56.388349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6ac47-5995-48f9-9377-aff1fbaaac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:56.389677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6ac47-5995-48f9-9377-aff1fbaaac80 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:56.390146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6ac47-5995-48f9-9377-aff1fbaaac80 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:56.390774 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6ac47-5995-48f9-9377-aff1fbaaac80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:56.423158 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6ac47-5995-48f9-9377-aff1fbaaac80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:56.427494 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6ac47-5995-48f9-9377-aff1fbaaac80 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:56.431659 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:56.449467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 423/838] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:12:56.471790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b4c6ac47-5995-48f9-9377-aff1fbaaac80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:56.471790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:56.471790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:56.471790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:56.471790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:56.471790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:56.471790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:56.471790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:56.471790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:56.471790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:56.471790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:56.471790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:56.471790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:56.471790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:56.471790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:56.474069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:56.476671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:56.476671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:56.476671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:56.476671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:56.476671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 416/839] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:56.481458 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80e52d-f9a4-4eb9-a695-48c2b012b7bc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:56.489564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6ac47-5995-48f9-9377-aff1fbaaac80 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:56.576238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:56.709904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80e52d-f9a4-4eb9-a695-48c2b012b7bc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:56.724411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6ac47-5995-48f9-9377-aff1fbaaac80 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:56.798505 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded566c5-294f-4923-84a1-e84aa73cd748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:56.800180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded566c5-294f-4923-84a1-e84aa73cd748 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:56.800990 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded566c5-294f-4923-84a1-e84aa73cd748 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:56.801757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded566c5-294f-4923-84a1-e84aa73cd748 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:56.803094 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f4ff9-5476-4e51-8e78-e47e05e3f310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:56.804040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded566c5-294f-4923-84a1-e84aa73cd748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:56.804685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f4ff9-5476-4e51-8e78-e47e05e3f310 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:56.805173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f4ff9-5476-4e51-8e78-e47e05e3f310 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:56.805632 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f4ff9-5476-4e51-8e78-e47e05e3f310 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:56.806364 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded566c5-294f-4923-84a1-e84aa73cd748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:56.807183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f4ff9-5476-4e51-8e78-e47e05e3f310 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:56.809534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded566c5-294f-4923-84a1-e84aa73cd748 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:56.809737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f4ff9-5476-4e51-8e78-e47e05e3f310 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:56.837005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 424/840] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a22f4ff9-5476-4e51-8e78-e47e05e3f310 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:56.838668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:56.840505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:56.840505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:56.840505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:56.840505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:56.840505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:56.840505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:56.840505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:12:56.840505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:12:56.840505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:12:56.840505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:12:56.840505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:56.840505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:56.840505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:56.840505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:56.840505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:56.840505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:56.842582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:56.842582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:56.842582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:56.842582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:56.842582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:56.842582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:56.842582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:56.842582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:56.842582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:56.842582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:56.842582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:12:56.842582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:12:56.842582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 15:12:56.842582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:56.842582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 417/841] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:12:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:56.845145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded566c5-294f-4923-84a1-e84aa73cd748 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:56.850319 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361a64-3121-439c-a0cb-4deddd1b83db None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:56.850319 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361a64-3121-439c-a0cb-4deddd1b83db None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:56.850319 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361a64-3121-439c-a0cb-4deddd1b83db None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:56.852863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 418/842] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:56.856751 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71361a64-3121-439c-a0cb-4deddd1b83db None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:56.969118 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:56.996869 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded566c5-294f-4923-84a1-e84aa73cd748 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:56.999882 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:57.049862 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71361a64-3121-439c-a0cb-4deddd1b83db None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:57.055133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e74b7-f81f-4b4b-b5ac-2a71634328c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:57.056451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e74b7-f81f-4b4b-b5ac-2a71634328c7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:57.058277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e74b7-f81f-4b4b-b5ac-2a71634328c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:57.058277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e74b7-f81f-4b4b-b5ac-2a71634328c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:57.071013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e74b7-f81f-4b4b-b5ac-2a71634328c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:57.073172 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e74b7-f81f-4b4b-b5ac-2a71634328c7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:57.101177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f74e74b7-f81f-4b4b-b5ac-2a71634328c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 15:12:57.101177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:57.101177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:57.101177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:57.101177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:57.101177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:57.101177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:57.101177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:57.101177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:57.101177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:57.101177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:57.101177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:57.101177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:57.101177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:57.101177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:57.101177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:57.103030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:57.105858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:57.105858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:57.105858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:57.105858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:57.105858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:57.105858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:57.105858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:57.105858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:57.105858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 15:12:57.105858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:57.108218 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 425/843] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 27 15:12:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:57.110677 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408a8e1-da7f-46d1-872a-3f74f72a4e8f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:57.110677 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408a8e1-da7f-46d1-872a-3f74f72a4e8f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:57.111359 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408a8e1-da7f-46d1-872a-3f74f72a4e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:57.118147 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811e571-fb18-4500-89d6-991c68a83887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:57.119369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811e571-fb18-4500-89d6-991c68a83887 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:57.119866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811e571-fb18-4500-89d6-991c68a83887 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:57.120354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811e571-fb18-4500-89d6-991c68a83887 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:57.121683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811e571-fb18-4500-89d6-991c68a83887 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:57.122258 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811e571-fb18-4500-89d6-991c68a83887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:57.124882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811e571-fb18-4500-89d6-991c68a83887 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:57.133791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a408a8e1-da7f-46d1-872a-3f74f72a4e8f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:57.133939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 419/844] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:12:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:57.135388 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a408a8e1-da7f-46d1-872a-3f74f72a4e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:57.135518 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811e571-fb18-4500-89d6-991c68a83887 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:57.270306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 426/845] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:12:57.270306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408a8e1-da7f-46d1-872a-3f74f72a4e8f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:57.281981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811e571-fb18-4500-89d6-991c68a83887 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:57.319892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:57.339226 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fcf04-4a0a-4dcb-bb2e-c09f649b2a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:57.340108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fcf04-4a0a-4dcb-bb2e-c09f649b2a40 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:57.340510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fcf04-4a0a-4dcb-bb2e-c09f649b2a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:57.340906 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fcf04-4a0a-4dcb-bb2e-c09f649b2a40 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:57.341906 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fcf04-4a0a-4dcb-bb2e-c09f649b2a40 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:57.342448 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fcf04-4a0a-4dcb-bb2e-c09f649b2a40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:57.344152 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fcf04-4a0a-4dcb-bb2e-c09f649b2a40 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:57.366768 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 420/846] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Jun 27 15:12:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:57.368623 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fcf04-4a0a-4dcb-bb2e-c09f649b2a40 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:57.454044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:57.465385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408a8e1-da7f-46d1-872a-3f74f72a4e8f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:57.525799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8964a6-e6c7-49b7-9658-57fe25c19155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:57.526499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8964a6-e6c7-49b7-9658-57fe25c19155 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:57.526786 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8964a6-e6c7-49b7-9658-57fe25c19155 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:57.527058 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8964a6-e6c7-49b7-9658-57fe25c19155 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:57.527779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8964a6-e6c7-49b7-9658-57fe25c19155 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:57.528080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8964a6-e6c7-49b7-9658-57fe25c19155 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:57.529475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8964a6-e6c7-49b7-9658-57fe25c19155 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:57.530251 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fcf04-4a0a-4dcb-bb2e-c09f649b2a40 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:57.536248 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 427/847] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:12:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:57.536492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8964a6-e6c7-49b7-9658-57fe25c19155 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:57.603938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41602aa-27c3-4b1c-b759-733e693fac3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:57.606523 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41602aa-27c3-4b1c-b759-733e693fac3a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:57.607386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41602aa-27c3-4b1c-b759-733e693fac3a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:57.609187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41602aa-27c3-4b1c-b759-733e693fac3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:57.641105 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41602aa-27c3-4b1c-b759-733e693fac3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:12:57.665795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b41602aa-27c3-4b1c-b759-733e693fac3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:12:57.665795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:57.665795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:57.665795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:57.665795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:57.665795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:57.665795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:57.665795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:57.665795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:57.665795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:57.665795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:57.665795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:57.665795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:12:57.665795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:12:57.665795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:12:57.665795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:12:57.667932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:12:57.667932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:12:57.667932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:12:57.667932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:12:57.667932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:57.667932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:57.667932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:57.667932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:57.667932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:57.667932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:57.667932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:57.667932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:57.667932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:57.667932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:57.667932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:57.667932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:57.669572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:57.669572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:57.669572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:57.669572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:57.669572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:12:57.669572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:12:57.669572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:12:57.669572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:12:57.669572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:12:57.669572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:12:57.669572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:12:57.669572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:57.673655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 421/848] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:12:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:57.678832 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8964a6-e6c7-49b7-9658-57fe25c19155 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:57.683826 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41602aa-27c3-4b1c-b759-733e693fac3a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:57.758789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7de1bb-95f0-4e5c-b773-e64546d0e737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:57.759629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7de1bb-95f0-4e5c-b773-e64546d0e737 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:57.759766 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7de1bb-95f0-4e5c-b773-e64546d0e737 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:57.760135 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7de1bb-95f0-4e5c-b773-e64546d0e737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:57.778706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:57.833006 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:57.852948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41602aa-27c3-4b1c-b759-733e693fac3a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:57.910166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbfe17-a14b-40f9-8fa4-78987cfba2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:57.910985 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbfe17-a14b-40f9-8fa4-78987cfba2dc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:57.911362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbfe17-a14b-40f9-8fa4-78987cfba2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:57.912204 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbfe17-a14b-40f9-8fa4-78987cfba2dc None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:57.913252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbfe17-a14b-40f9-8fa4-78987cfba2dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:57.913786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbfe17-a14b-40f9-8fa4-78987cfba2dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:57.915271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbfe17-a14b-40f9-8fa4-78987cfba2dc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:57.928211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 422/849] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:12:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:57.936244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbfe17-a14b-40f9-8fa4-78987cfba2dc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:57.944360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7de1bb-95f0-4e5c-b773-e64546d0e737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:57.947455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7de1bb-95f0-4e5c-b773-e64546d0e737 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:58.103308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 428/850] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:12:58.104555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7de1bb-95f0-4e5c-b773-e64546d0e737 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:58.120110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbfe17-a14b-40f9-8fa4-78987cfba2dc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:58.124471 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:58.181149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:58.195355 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5c69e-b310-4d00-8829-3e2cd03631be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:58.196762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5c69e-b310-4d00-8829-3e2cd03631be None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:58.197251 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5c69e-b310-4d00-8829-3e2cd03631be None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:58.197892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5c69e-b310-4d00-8829-3e2cd03631be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:58.221709 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5c69e-b310-4d00-8829-3e2cd03631be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:58.224442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5c69e-b310-4d00-8829-3e2cd03631be None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:58.231876 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7de1bb-95f0-4e5c-b773-e64546d0e737 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:58.259820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-85f5c69e-b310-4d00-8829-3e2cd03631be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:58.259820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:58.259820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:58.259820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:58.259820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:58.259820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:58.259820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:58.259820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:58.259820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:58.259820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:58.259820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:58.259820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:58.259820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:58.259820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:58.259820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:58.260800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:58.261773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:58.261773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:58.261773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:58.261773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:58.270624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 423/851] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:58.273070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5c69e-b310-4d00-8829-3e2cd03631be None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:58.273194 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11920440-f096-4522-8b5c-beda5e197420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:58.274256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11920440-f096-4522-8b5c-beda5e197420 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:58.274737 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11920440-f096-4522-8b5c-beda5e197420 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:58.275199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11920440-f096-4522-8b5c-beda5e197420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:58.287560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11920440-f096-4522-8b5c-beda5e197420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:58.289652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11920440-f096-4522-8b5c-beda5e197420 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:58.310525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-11920440-f096-4522-8b5c-beda5e197420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:58.310525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:58.310525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:58.310525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:58.310525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:58.310525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:58.310525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:58.310525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:58.310525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:58.310525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:58.310525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:58.310525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:58.310525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:58.310525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:58.310525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:58.311483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:58.312465 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:58.312465 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:58.312465 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:58.312465 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:58.321611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 429/852] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:58.324403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11920440-f096-4522-8b5c-beda5e197420 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:58.435873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5c69e-b310-4d00-8829-3e2cd03631be None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:58.479334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864b8a-3c3e-4e18-a690-d85858be2f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:58.480015 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864b8a-3c3e-4e18-a690-d85858be2f21 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:58.480306 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864b8a-3c3e-4e18-a690-d85858be2f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:58.480585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864b8a-3c3e-4e18-a690-d85858be2f21 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:58.481334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78864b8a-3c3e-4e18-a690-d85858be2f21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:58.481641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78864b8a-3c3e-4e18-a690-d85858be2f21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:58.483090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78864b8a-3c3e-4e18-a690-d85858be2f21 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:58.495275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11920440-f096-4522-8b5c-beda5e197420 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:58.502690 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 424/853] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:58.504826 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864b8a-3c3e-4e18-a690-d85858be2f21 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:58.507220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:58.525445 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:58.547494 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b72ed-57c2-4fa8-8c67-b4abc2d1037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:58.548592 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b72ed-57c2-4fa8-8c67-b4abc2d1037c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:58.549080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b72ed-57c2-4fa8-8c67-b4abc2d1037c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:58.549556 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b72ed-57c2-4fa8-8c67-b4abc2d1037c None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:58.550567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b72ed-57c2-4fa8-8c67-b4abc2d1037c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:58.551084 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b72ed-57c2-4fa8-8c67-b4abc2d1037c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:58.552759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b72ed-57c2-4fa8-8c67-b4abc2d1037c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:58.572677 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 430/854] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:58.574053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b72ed-57c2-4fa8-8c67-b4abc2d1037c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:58.633118 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864b8a-3c3e-4e18-a690-d85858be2f21 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:58.676887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7063fb0-e01e-4dab-9171-b1b1481a668b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:58.677728 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063fb0-e01e-4dab-9171-b1b1481a668b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:58.678010 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063fb0-e01e-4dab-9171-b1b1481a668b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:58.678342 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063fb0-e01e-4dab-9171-b1b1481a668b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:58.688530 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7063fb0-e01e-4dab-9171-b1b1481a668b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:58.689273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b72ed-57c2-4fa8-8c67-b4abc2d1037c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:58.689943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7063fb0-e01e-4dab-9171-b1b1481a668b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:58.707661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c7063fb0-e01e-4dab-9171-b1b1481a668b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 15:12:58.707661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:58.707661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:58.707661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:58.707661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:58.707661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:58.707661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:58.707661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:58.707661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:58.707661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:58.707661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:58.707661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:58.707661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:12:58.707661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:12:58.707661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:12:58.707661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:58.708703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:58.709645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:58.709645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:58.709645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:12:58.709645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:12:58.709645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:12:58.709645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:12:58.709645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:12:58.709645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:12:58.709645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 15:12:58.709645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:58.713809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 425/855] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:12:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:12:58.714962 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7063fb0-e01e-4dab-9171-b1b1481a668b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:58.733546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e696c-fac5-42b6-973f-362c28a9584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:58.735208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e696c-fac5-42b6-973f-362c28a9584f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:58.735745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e696c-fac5-42b6-973f-362c28a9584f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:58.736283 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e696c-fac5-42b6-973f-362c28a9584f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:58.744536 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e696c-fac5-42b6-973f-362c28a9584f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:58.746488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e696c-fac5-42b6-973f-362c28a9584f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:58.770654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-dd9e696c-fac5-42b6-973f-362c28a9584f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:58.770654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:58.770654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:58.770654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:58.770654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:58.770654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:58.770654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:58.770654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:58.770654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:58.770654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:58.770654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:58.770654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:58.770654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:12:58.770654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:12:58.770654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:58.773003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:58.774729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:12:58.774729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:12:58.774729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:12:58.774729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:12:58.774729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:12:58.774729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:12:58.774729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:12:58.774729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:58.786050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 431/856] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:12:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:58.789325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e696c-fac5-42b6-973f-362c28a9584f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:58.839562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:58.843590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:58.889590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7063fb0-e01e-4dab-9171-b1b1481a668b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:58.954737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1860011-efa1-4e8d-a616-401861e83850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:58.956132 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1860011-efa1-4e8d-a616-401861e83850 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:58.956766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1860011-efa1-4e8d-a616-401861e83850 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:58.957393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1860011-efa1-4e8d-a616-401861e83850 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:58.959897 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1860011-efa1-4e8d-a616-401861e83850 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:58.960644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1860011-efa1-4e8d-a616-401861e83850 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:58.964034 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1860011-efa1-4e8d-a616-401861e83850 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:58.980416 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e696c-fac5-42b6-973f-362c28a9584f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:59.007901 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 426/857] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Jun 27 15:12:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:59.009934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1860011-efa1-4e8d-a616-401861e83850 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:59.037385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6f354-2a3e-4a49-abcd-9b097aa1986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:59.038750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6f354-2a3e-4a49-abcd-9b097aa1986e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:59.039258 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6f354-2a3e-4a49-abcd-9b097aa1986e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:59.039926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6f354-2a3e-4a49-abcd-9b097aa1986e None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:59.041348 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6f354-2a3e-4a49-abcd-9b097aa1986e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:59.042156 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6f354-2a3e-4a49-abcd-9b097aa1986e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:59.043880 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6f354-2a3e-4a49-abcd-9b097aa1986e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:59.063067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 432/858] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:12:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:12:59.069876 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6f354-2a3e-4a49-abcd-9b097aa1986e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:59.152739 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1860011-efa1-4e8d-a616-401861e83850 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:59.185488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:59.201741 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:59.203808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6f354-2a3e-4a49-abcd-9b097aa1986e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:59.209744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c7e0a-fda4-4d76-85f9-405c31c913dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:59.210535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c7e0a-fda4-4d76-85f9-405c31c913dc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:59.210912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c7e0a-fda4-4d76-85f9-405c31c913dc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:59.211282 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c7e0a-fda4-4d76-85f9-405c31c913dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:59.249080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff4941-69cc-4084-9c58-fc285497ba89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:59.250109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff4941-69cc-4084-9c58-fc285497ba89 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:59.250597 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff4941-69cc-4084-9c58-fc285497ba89 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:59.251024 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff4941-69cc-4084-9c58-fc285497ba89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:59.252034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff4941-69cc-4084-9c58-fc285497ba89 None admin] RBAC: Adding query filter params (role.id=c5b95b7a83d94e99a828c836efe01929, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=6f3dfc12a3ac499da540065c03bd2a82) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:12:59.252504 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff4941-69cc-4084-9c58-fc285497ba89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:59.254143 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff4941-69cc-4084-9c58-fc285497ba89 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:59.270692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 433/859] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:12:59 2022] GET /identity/v3/role_assignments?user.id=6f3dfc12a3ac499da540065c03bd2a82&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=c5b95b7a83d94e99a828c836efe01929 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:12:59.307205 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c7e0a-fda4-4d76-85f9-405c31c913dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:59.308735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c7e0a-fda4-4d76-85f9-405c31c913dc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:59.442750 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 427/860] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:12:59 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:12:59.449069 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff4941-69cc-4084-9c58-fc285497ba89 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:59.488461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88195c9d-5796-4a05-8259-3843f55b8905 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:59.489372 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88195c9d-5796-4a05-8259-3843f55b8905 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:59.490038 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88195c9d-5796-4a05-8259-3843f55b8905 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:59.493620 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 428/861] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:12:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:12:59.502170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18060bb6-44de-44a8-915e-a08e20c49706 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:59.502622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18060bb6-44de-44a8-915e-a08e20c49706 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:59.502922 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18060bb6-44de-44a8-915e-a08e20c49706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:59.529630 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-18060bb6-44de-44a8-915e-a08e20c49706 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:12:59.531004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-18060bb6-44de-44a8-915e-a08e20c49706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:12:59.561208 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:59.616516 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 429/862] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:12:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:12:59.632280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff4941-69cc-4084-9c58-fc285497ba89 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:59.652428 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18060bb6-44de-44a8-915e-a08e20c49706 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:59.696043 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbe4ad-6acc-4af0-a833-21de7864005c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:59.696887 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbe4ad-6acc-4af0-a833-21de7864005c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:59.697171 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbe4ad-6acc-4af0-a833-21de7864005c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:59.697452 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbe4ad-6acc-4af0-a833-21de7864005c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:59.713294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbe4ad-6acc-4af0-a833-21de7864005c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:59.714814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbe4ad-6acc-4af0-a833-21de7864005c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:59.746626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-74cbe4ad-6acc-4af0-a833-21de7864005c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:59.746626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:59.746626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:59.746626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:59.746626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:59.746626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:59.746626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:59.746626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:59.746626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:59.746626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:59.746626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:59.746626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:59.746626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:12:59.746626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:12:59.746626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:59.748996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:59.750793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:12:59.750793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:12:59.750793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:12:59.750793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:12:59.750793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 434/863] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:59.753899 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbe4ad-6acc-4af0-a833-21de7864005c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:59.759978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:59.809562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18060bb6-44de-44a8-915e-a08e20c49706 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:12:59.864312 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203074e9-a164-40dd-a064-fa500871dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:12:59.865172 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203074e9-a164-40dd-a064-fa500871dad6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:12:59.865452 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203074e9-a164-40dd-a064-fa500871dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:12:59.865792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203074e9-a164-40dd-a064-fa500871dad6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:12:59.866498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203074e9-a164-40dd-a064-fa500871dad6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:12:59.876224 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203074e9-a164-40dd-a064-fa500871dad6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:12:59.897609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-203074e9-a164-40dd-a064-fa500871dad6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 15:12:59.897609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:59.897609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:12:59.897609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:12:59.897609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:12:59.897609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:12:59.897609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:12:59.897609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:12:59.897609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 15:12:59.897609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:59.897609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:12:59.897609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:59.897609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:12:59.897609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:12:59.897609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:12:59.897609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:12:59.899472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:12:59.899472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:12:59.899472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:12:59.899472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:12:59.899472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:12:59.899472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:12:59.899472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:12:59.899472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:12:59.899472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:12:59.899472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:12:59.899472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:12:59.899472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:12:59.899472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:12:59.899472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:12:59.899472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:12:59.899472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:12:59.901107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:12:59.901107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:12:59.901107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:12:59.901107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:12:59.901107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:12:59.901107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:12:59.901107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:12:59.901107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:12:59.901107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:12:59.901107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:12:59.901107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:12:59.901107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:12:59.901107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:12:59.901107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 15:12:59.901107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:12:59.907821 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 430/864] 10.222.0.33 () {56 vars in 1132 bytes} [Mon Jun 27 15:12:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:12:59.908836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203074e9-a164-40dd-a064-fa500871dad6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:12:59.959116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:12:59.995727 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbe4ad-6acc-4af0-a833-21de7864005c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:00.050599 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4a1f4-f7f6-465e-aadf-b7247b194d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:00.051203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a1f4-f7f6-465e-aadf-b7247b194d78 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:00.052052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a1f4-f7f6-465e-aadf-b7247b194d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:00.052332 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a1f4-f7f6-465e-aadf-b7247b194d78 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:00.053118 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4a1f4-f7f6-465e-aadf-b7247b194d78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:00.053723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4a1f4-f7f6-465e-aadf-b7247b194d78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:00.055583 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4a1f4-f7f6-465e-aadf-b7247b194d78 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:00.073424 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 435/865] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:00.079593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4a1f4-f7f6-465e-aadf-b7247b194d78 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:00.104458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203074e9-a164-40dd-a064-fa500871dad6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:00.215862 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a598767-d73c-418d-9752-2788bf84fa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:00.216568 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a598767-d73c-418d-9752-2788bf84fa75 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:00.216853 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a598767-d73c-418d-9752-2788bf84fa75 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:00.217133 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a598767-d73c-418d-9752-2788bf84fa75 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:00.217878 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a598767-d73c-418d-9752-2788bf84fa75 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:00.218276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a598767-d73c-418d-9752-2788bf84fa75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:00.219702 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a598767-d73c-418d-9752-2788bf84fa75 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:00.235520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 431/866] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 27 15:12:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:00.237921 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a598767-d73c-418d-9752-2788bf84fa75 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:00.243511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:00.325918 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4a1f4-f7f6-465e-aadf-b7247b194d78 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:00.401362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e37536-fa82-4341-a0b8-3496049e6091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:00.402187 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e37536-fa82-4341-a0b8-3496049e6091 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:00.402570 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e37536-fa82-4341-a0b8-3496049e6091 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:00.402854 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e37536-fa82-4341-a0b8-3496049e6091 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:00.418571 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e37536-fa82-4341-a0b8-3496049e6091 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:00.420159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e37536-fa82-4341-a0b8-3496049e6091 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:00.437646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-60e37536-fa82-4341-a0b8-3496049e6091 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:13:00.437646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:00.437646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:00.437646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:00.437646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:00.437646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:00.437646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:00.437646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:00.437646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:00.437646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:00.437646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:00.437646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:00.437646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:13:00.437646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:13:00.437646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:00.439319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:00.442181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:13:00.442181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:13:00.442181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:13:00.442181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:13:00.442181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:13:00.442181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:13:00.442181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:13:00.442181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:00.444354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 436/867] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:13:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:13:00.445923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709d2e3-50b5-479e-8a04-a3653afe64f6 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:00.446363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709d2e3-50b5-479e-8a04-a3653afe64f6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:00.446694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709d2e3-50b5-479e-8a04-a3653afe64f6 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:00.452305 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 437/868] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:00.452305 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709d2e3-50b5-479e-8a04-a3653afe64f6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:00.484180 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:00.504277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a598767-d73c-418d-9752-2788bf84fa75 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:00.555095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90d244-b569-4757-b6bc-e403684fce9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:00.556582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90d244-b569-4757-b6bc-e403684fce9b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:00.557450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90d244-b569-4757-b6bc-e403684fce9b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:00.557890 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90d244-b569-4757-b6bc-e403684fce9b None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:00.559080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90d244-b569-4757-b6bc-e403684fce9b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:00.559844 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90d244-b569-4757-b6bc-e403684fce9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:00.563582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90d244-b569-4757-b6bc-e403684fce9b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:00.571074 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 432/869] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 27 15:13:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:00.572938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285828f-438b-470e-8d39-c1238949c191 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:00.573465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285828f-438b-470e-8d39-c1238949c191 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:00.574743 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285828f-438b-470e-8d39-c1238949c191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:00.607668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c285828f-438b-470e-8d39-c1238949c191 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:00.611258 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c285828f-438b-470e-8d39-c1238949c191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:00.624140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709d2e3-50b5-479e-8a04-a3653afe64f6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:00.675761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:00.699812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feeb2a-65ce-4638-90da-3ea12df1e0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:00.701520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feeb2a-65ce-4638-90da-3ea12df1e0cd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:00.702323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feeb2a-65ce-4638-90da-3ea12df1e0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:00.704271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feeb2a-65ce-4638-90da-3ea12df1e0cd None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:00.706403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feeb2a-65ce-4638-90da-3ea12df1e0cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:00.707291 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feeb2a-65ce-4638-90da-3ea12df1e0cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:00.710109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feeb2a-65ce-4638-90da-3ea12df1e0cd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:00.738487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 438/870] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:13:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:00.744478 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feeb2a-65ce-4638-90da-3ea12df1e0cd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:00.780443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 433/871] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:00.807273 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285828f-438b-470e-8d39-c1238949c191 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:00.905763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feeb2a-65ce-4638-90da-3ea12df1e0cd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:00.945913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5e489-f9c9-4a9e-9926-83f39f88ca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:00.946833 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5e489-f9c9-4a9e-9926-83f39f88ca7f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:00.947121 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5e489-f9c9-4a9e-9926-83f39f88ca7f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:00.947400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5e489-f9c9-4a9e-9926-83f39f88ca7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:00.948270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5e489-f9c9-4a9e-9926-83f39f88ca7f None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=0e419f9caf0a4ccb8108d375f527006e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:00.948588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5e489-f9c9-4a9e-9926-83f39f88ca7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:00.950084 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5e489-f9c9-4a9e-9926-83f39f88ca7f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:00.957878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 439/872] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:13:00 2022] GET /identity/v3/role_assignments?user.id=0e419f9caf0a4ccb8108d375f527006e&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:00.960919 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:00.996541 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285828f-438b-470e-8d39-c1238949c191 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:01.071887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17925cf-b36e-4652-bac2-a4e8d9e4bfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:01.073019 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17925cf-b36e-4652-bac2-a4e8d9e4bfb9 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:01.073486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17925cf-b36e-4652-bac2-a4e8d9e4bfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:01.073931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17925cf-b36e-4652-bac2-a4e8d9e4bfb9 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:01.075226 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17925cf-b36e-4652-bac2-a4e8d9e4bfb9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:01.076874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17925cf-b36e-4652-bac2-a4e8d9e4bfb9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:01.110974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 434/873] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 27 15:13:00 2022] POST /identity/v3/services => generated 251 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:13:02.262541 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e168-c12b-4897-a12e-2e06e6e0dd41 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:02.263507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e168-c12b-4897-a12e-2e06e6e0dd41 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:02.263507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e168-c12b-4897-a12e-2e06e6e0dd41 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:02.266773 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 440/874] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:02.275931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e1046-eb28-48b9-a893-703f9b139adc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:02.276757 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e1046-eb28-48b9-a893-703f9b139adc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:02.276910 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e1046-eb28-48b9-a893-703f9b139adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:02.306898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-525e1046-eb28-48b9-a893-703f9b139adc None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:02.310433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-525e1046-eb28-48b9-a893-703f9b139adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:02.465661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 435/875] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:02.508844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96e168-c12b-4897-a12e-2e06e6e0dd41 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:02.605884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:02.676407 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96e168-c12b-4897-a12e-2e06e6e0dd41 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:02.738949 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6fb31-b5bd-4d0b-b22d-eb56c01141f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:02.740314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6fb31-b5bd-4d0b-b22d-eb56c01141f5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:02.740807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6fb31-b5bd-4d0b-b22d-eb56c01141f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:02.741287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6fb31-b5bd-4d0b-b22d-eb56c01141f5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:02.761824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6fb31-b5bd-4d0b-b22d-eb56c01141f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:13:02.778304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-dfd6fb31-b5bd-4d0b-b22d-eb56c01141f5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 15:13:02.778304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:02.778304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:02.778304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:02.778304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:02.778304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:02.778304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:02.778304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:02.778304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:02.778304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:02.778304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:02.778304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:02.778304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:13:02.778304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:13:02.778304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:13:02.778304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:13:02.780518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:13:02.780518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:13:02.780518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:13:02.780518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:13:02.780518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:02.780518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:02.780518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:02.780518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:02.780518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:02.780518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:02.780518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:02.780518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:02.780518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:02.780518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:02.780518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:02.780518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:02.782752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:02.782752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:02.782752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:02.782752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:02.782752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:13:02.782752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:13:02.782752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:13:02.782752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:13:02.782752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:13:02.782752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:13:02.782752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 15:13:02.782752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:02.782752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 441/876] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Jun 27 15:13:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:02.790990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e1046-eb28-48b9-a893-703f9b139adc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:02.910241 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c9ce7-0942-4de3-bb15-35f3e8712e37 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:02.910794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c9ce7-0942-4de3-bb15-35f3e8712e37 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:02.911227 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c9ce7-0942-4de3-bb15-35f3e8712e37 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:02.913969 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 442/877] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:13:02.923243 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8249f5d-c141-43af-a5f5-e0f136fe9c46 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:02.923742 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8249f5d-c141-43af-a5f5-e0f136fe9c46 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:02.924248 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8249f5d-c141-43af-a5f5-e0f136fe9c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:02.940137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:02.961871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e8249f5d-c141-43af-a5f5-e0f136fe9c46 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:02.964947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e8249f5d-c141-43af-a5f5-e0f136fe9c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:03.011996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e1046-eb28-48b9-a893-703f9b139adc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:03.084014 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c695f91-82ea-4518-852f-1802e8a70ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:03.085752 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c695f91-82ea-4518-852f-1802e8a70ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:03.086589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c695f91-82ea-4518-852f-1802e8a70ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:03.087337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c695f91-82ea-4518-852f-1802e8a70ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:03.088976 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c695f91-82ea-4518-852f-1802e8a70ba5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:03.089876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c695f91-82ea-4518-852f-1802e8a70ba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:03.092930 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c695f91-82ea-4518-852f-1802e8a70ba5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:03.114696 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 436/878] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Jun 27 15:13:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:03.119776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 443/879] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:03.122476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c695f91-82ea-4518-852f-1802e8a70ba5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:03.142200 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8249f5d-c141-43af-a5f5-e0f136fe9c46 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:03.230778 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:03.329135 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8249f5d-c141-43af-a5f5-e0f136fe9c46 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:03.329744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c695f91-82ea-4518-852f-1802e8a70ba5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:03.385434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:03.391582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c3063-5832-4a2b-bf38-7a9d00d8321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:03.392787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c3063-5832-4a2b-bf38-7a9d00d8321e None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:03.393309 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c3063-5832-4a2b-bf38-7a9d00d8321e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:03.393746 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c3063-5832-4a2b-bf38-7a9d00d8321e None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:03.395196 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c3063-5832-4a2b-bf38-7a9d00d8321e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:03.395370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60748fb-e738-493c-ae4d-8a3c30c9220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:03.396772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60748fb-e738-493c-ae4d-8a3c30c9220e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:03.397289 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60748fb-e738-493c-ae4d-8a3c30c9220e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:03.397799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c3063-5832-4a2b-bf38-7a9d00d8321e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:03.397894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60748fb-e738-493c-ae4d-8a3c30c9220e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:03.430251 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 444/880] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 27 15:13:03 2022] POST /identity/v3/services => generated 269 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:13:03.430566 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60748fb-e738-493c-ae4d-8a3c30c9220e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:03.430566 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60748fb-e738-493c-ae4d-8a3c30c9220e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:03.430825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4c892-a28d-4c9c-a303-1f0925c4e52a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:03.430825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4c892-a28d-4c9c-a303-1f0925c4e52a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:03.430825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4c892-a28d-4c9c-a303-1f0925c4e52a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:03.433500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 445/881] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:03.448752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30ae8c-27d1-47d4-8c4f-89f759bd2e0f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:03.449269 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30ae8c-27d1-47d4-8c4f-89f759bd2e0f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:03.449787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30ae8c-27d1-47d4-8c4f-89f759bd2e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:03.455168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e60748fb-e738-493c-ae4d-8a3c30c9220e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:03.455168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:03.455168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:03.455168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:03.455168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:03.455168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:03.455168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:03.455168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:03.455168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:03.455168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:03.455168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:03.455168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:03.455168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:13:03.455168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:13:03.455168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:03.456938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:03.459341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:13:03.459341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:13:03.459341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:03.459341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:03.459341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 437/882] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:03.467883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60748fb-e738-493c-ae4d-8a3c30c9220e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:03.481914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3e30ae8c-27d1-47d4-8c4f-89f759bd2e0f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:03.483764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3e30ae8c-27d1-47d4-8c4f-89f759bd2e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:03.615993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 446/883] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:13:03.658893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30ae8c-27d1-47d4-8c4f-89f759bd2e0f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:03.683054 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60748fb-e738-493c-ae4d-8a3c30c9220e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:03.708374 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:03.752830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2acdd3-bc08-4b00-882c-e04883efbfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:03.754041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acdd3-bc08-4b00-882c-e04883efbfbf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:03.754205 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acdd3-bc08-4b00-882c-e04883efbfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:03.754503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acdd3-bc08-4b00-882c-e04883efbfbf None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:03.755501 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2acdd3-bc08-4b00-882c-e04883efbfbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:03.755990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2acdd3-bc08-4b00-882c-e04883efbfbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:03.758378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2acdd3-bc08-4b00-882c-e04883efbfbf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:03.781086 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 438/884] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:03.790737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2acdd3-bc08-4b00-882c-e04883efbfbf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:03.869527 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30ae8c-27d1-47d4-8c4f-89f759bd2e0f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:03.886662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:03.952980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db396a16-a4eb-4a92-b8ed-b8762ee39f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:03.954787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db396a16-a4eb-4a92-b8ed-b8762ee39f83 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:03.954787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db396a16-a4eb-4a92-b8ed-b8762ee39f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:03.955069 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db396a16-a4eb-4a92-b8ed-b8762ee39f83 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:03.956260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db396a16-a4eb-4a92-b8ed-b8762ee39f83 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:03.959093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db396a16-a4eb-4a92-b8ed-b8762ee39f83 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-db396a16-a4eb-4a92-b8ed-b8762ee39f83 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:03.982522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:03.985139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:03.985139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:03.985139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:03.985139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:03.985139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:03.985139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:03.985139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:13:03.985139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:13:03.985139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:13:03.985139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:13:03.985139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:03.985139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:03.985139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:03.985139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:03.985139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:03.985139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:03.986700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:03.986700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:03.986700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:03.986700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:03.986700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:03.986700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:03.986700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:03.986700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:03.986700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:03.986700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:03.986700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:13:03.986700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:03.986700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 15:13:03.986700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:03.990603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 447/885] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:13:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:13:03.994789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db396a16-a4eb-4a92-b8ed-b8762ee39f83 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:04.011878 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2acdd3-bc08-4b00-882c-e04883efbfbf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:04.097615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65e201-ff6f-4fd8-adf4-c89ef167759f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:04.099703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65e201-ff6f-4fd8-adf4-c89ef167759f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:04.100186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65e201-ff6f-4fd8-adf4-c89ef167759f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:04.100660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65e201-ff6f-4fd8-adf4-c89ef167759f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:04.117665 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65e201-ff6f-4fd8-adf4-c89ef167759f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:04.121282 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65e201-ff6f-4fd8-adf4-c89ef167759f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:04.146391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2f65e201-ff6f-4fd8-adf4-c89ef167759f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 15:13:04.146391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:04.146391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:04.146391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:04.146391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:04.146391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:04.146391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:04.146391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:04.146391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:04.146391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:04.146391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:04.146391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:04.146391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:13:04.146391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:13:04.146391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:13:04.146391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:04.156029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:04.158128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:04.158128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:04.158128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:13:04.158128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:13:04.158128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:13:04.158128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:13:04.158128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:13:04.158128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:13:04.158128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 15:13:04.158128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:04.158128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 439/886] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 27 15:13:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:13:04.158128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754577e5-422a-4fa0-ba77-997123d4d126 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:04.158128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754577e5-422a-4fa0-ba77-997123d4d126 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:04.159599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754577e5-422a-4fa0-ba77-997123d4d126 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:04.159599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 440/887] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:04.159599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca19c0a-e343-4cbd-a80a-f9078c9f9333 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:04.159599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca19c0a-e343-4cbd-a80a-f9078c9f9333 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:04.160080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca19c0a-e343-4cbd-a80a-f9078c9f9333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:04.175801 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:04.191826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db396a16-a4eb-4a92-b8ed-b8762ee39f83 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:04.200181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-eca19c0a-e343-4cbd-a80a-f9078c9f9333 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:04.204725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-eca19c0a-e343-4cbd-a80a-f9078c9f9333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:04.234492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9473b2-49b4-4dff-ab87-d3c15ac19383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:04.235210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9473b2-49b4-4dff-ab87-d3c15ac19383 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:04.235563 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9473b2-49b4-4dff-ab87-d3c15ac19383 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:04.235750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9473b2-49b4-4dff-ab87-d3c15ac19383 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:04.236457 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9473b2-49b4-4dff-ab87-d3c15ac19383 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:04.236764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9473b2-49b4-4dff-ab87-d3c15ac19383 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:04.238249 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9473b2-49b4-4dff-ab87-d3c15ac19383 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:04.252079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 448/888] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:13:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:04.252079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9473b2-49b4-4dff-ab87-d3c15ac19383 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:04.330347 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 441/889] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:04.330347 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca19c0a-e343-4cbd-a80a-f9078c9f9333 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:04.394891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:04.422742 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9473b2-49b4-4dff-ab87-d3c15ac19383 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:04.480110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bf424-1e5f-4520-a8d3-119d1cfb9ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:04.480987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bf424-1e5f-4520-a8d3-119d1cfb9ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:04.481461 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bf424-1e5f-4520-a8d3-119d1cfb9ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:04.481915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bf424-1e5f-4520-a8d3-119d1cfb9ef7 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:04.483397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bf424-1e5f-4520-a8d3-119d1cfb9ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:04.483825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bf424-1e5f-4520-a8d3-119d1cfb9ef7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:04.486273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bf424-1e5f-4520-a8d3-119d1cfb9ef7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:04.504919 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca19c0a-e343-4cbd-a80a-f9078c9f9333 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:04.523112 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 449/890] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Jun 27 15:13:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:04.523112 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bf424-1e5f-4520-a8d3-119d1cfb9ef7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:04.544316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:04.570964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bf9cc-323d-4e6e-a14c-14e9bc497b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:04.571918 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf9cc-323d-4e6e-a14c-14e9bc497b5e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:04.572375 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf9cc-323d-4e6e-a14c-14e9bc497b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:04.572818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf9cc-323d-4e6e-a14c-14e9bc497b5e None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:04.573947 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bf9cc-323d-4e6e-a14c-14e9bc497b5e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:04.574480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bf9cc-323d-4e6e-a14c-14e9bc497b5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:04.576549 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bf9cc-323d-4e6e-a14c-14e9bc497b5e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:04.593585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 442/891] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:13:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:04.593585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bf9cc-323d-4e6e-a14c-14e9bc497b5e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:04.678578 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bf424-1e5f-4520-a8d3-119d1cfb9ef7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:04.719794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453db229-b2d0-4d45-93b4-00f35bff9704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:04.720645 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453db229-b2d0-4d45-93b4-00f35bff9704 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:04.720928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453db229-b2d0-4d45-93b4-00f35bff9704 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:04.721200 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453db229-b2d0-4d45-93b4-00f35bff9704 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:04.721890 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453db229-b2d0-4d45-93b4-00f35bff9704 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:04.723372 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453db229-b2d0-4d45-93b4-00f35bff9704 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-453db229-b2d0-4d45-93b4-00f35bff9704 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:04.737279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:04.739432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:04.739432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:04.739432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:04.739432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:04.739432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:04.739432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:04.739432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:13:04.739432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:13:04.739432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:13:04.739432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:13:04.739432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:04.739432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:04.739432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:04.739432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:04.739432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:04.739432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:04.741928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:04.741928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:04.741928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:04.741928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:04.741928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:04.741928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:04.741928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:04.741928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:04.741928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:04.741928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:04.741928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:13:04.741928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:04.741928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 15:13:04.741928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:04.747770 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 450/892] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 27 15:13:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:04.748801 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453db229-b2d0-4d45-93b4-00f35bff9704 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:04.785312 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:04.792481 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bf9cc-323d-4e6e-a14c-14e9bc497b5e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:04.842168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1238c-e1f3-4769-b7c3-6410c7eace46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:04.843722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1238c-e1f3-4769-b7c3-6410c7eace46 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:04.844427 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1238c-e1f3-4769-b7c3-6410c7eace46 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:04.845085 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1238c-e1f3-4769-b7c3-6410c7eace46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:04.883696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:04.934534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453db229-b2d0-4d45-93b4-00f35bff9704 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:04.940386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1238c-e1f3-4769-b7c3-6410c7eace46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:04.941892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1238c-e1f3-4769-b7c3-6410c7eace46 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:04.997262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b373800-d9b0-4f2e-8824-176242591510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:04.998456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b373800-d9b0-4f2e-8824-176242591510 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:04.998952 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b373800-d9b0-4f2e-8824-176242591510 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:04.999499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b373800-d9b0-4f2e-8824-176242591510 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:05.001093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b373800-d9b0-4f2e-8824-176242591510 None admin] RBAC: Adding query filter params (interface=public, service_id=d77ac969f7824d33b67f19cbc8f73e06, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:05.001529 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b373800-d9b0-4f2e-8824-176242591510 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:05.004194 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b373800-d9b0-4f2e-8824-176242591510 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:05.018172 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 451/893] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Jun 27 15:13:04 2022] GET /identity/v3/endpoints?service_id=d77ac969f7824d33b67f19cbc8f73e06&interface=public®ion_id=RegionOne => generated 194 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:05.018172 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b373800-d9b0-4f2e-8824-176242591510 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:05.107988 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:05.119020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 443/894] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:13:04 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:13:05.124176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1238c-e1f3-4769-b7c3-6410c7eace46 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:05.211246 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b373800-d9b0-4f2e-8824-176242591510 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:05.264110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d6e54-53b3-42f6-9701-d8380a8ac44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:05.264818 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d6e54-53b3-42f6-9701-d8380a8ac44f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:05.265449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d6e54-53b3-42f6-9701-d8380a8ac44f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:05.265583 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d6e54-53b3-42f6-9701-d8380a8ac44f None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:05.266540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d6e54-53b3-42f6-9701-d8380a8ac44f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:05.267235 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d6e54-53b3-42f6-9701-d8380a8ac44f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:05.268271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d6e54-53b3-42f6-9701-d8380a8ac44f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:05.273809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1238c-e1f3-4769-b7c3-6410c7eace46 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:05.282038 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 452/895] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 27 15:13:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:05.282038 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d6e54-53b3-42f6-9701-d8380a8ac44f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:05.286303 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:05.433608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d6e54-53b3-42f6-9701-d8380a8ac44f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:05.472503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceccb97-2190-4afa-afe9-cdcb2fd4489a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:05.473480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceccb97-2190-4afa-afe9-cdcb2fd4489a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:05.473956 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceccb97-2190-4afa-afe9-cdcb2fd4489a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:05.474476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceccb97-2190-4afa-afe9-cdcb2fd4489a None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:05.475457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceccb97-2190-4afa-afe9-cdcb2fd4489a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:05.477188 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceccb97-2190-4afa-afe9-cdcb2fd4489a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:05.478834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd8c78-1fbe-48cd-a764-d3df930c1e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:05.479694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd8c78-1fbe-48cd-a764-d3df930c1e9e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:05.479992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd8c78-1fbe-48cd-a764-d3df930c1e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:05.480269 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd8c78-1fbe-48cd-a764-d3df930c1e9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:05.485754 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 444/896] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 27 15:13:05 2022] GET /identity/v3/services => generated 1268 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:13:05.487861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceccb97-2190-4afa-afe9-cdcb2fd4489a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:05.504174 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd8c78-1fbe-48cd-a764-d3df930c1e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:05.507277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd8c78-1fbe-48cd-a764-d3df930c1e9e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:05.539728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1fdd8c78-1fbe-48cd-a764-d3df930c1e9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:05.539728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:05.539728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:05.539728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:05.539728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:05.539728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:05.539728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:05.539728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:05.539728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:05.539728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:05.539728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:05.539728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:05.539728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:13:05.539728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:13:05.539728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:05.541565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:05.543181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:13:05.543181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:13:05.543181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:05.543181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:05.547148 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 453/897] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:05.554154 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd8c78-1fbe-48cd-a764-d3df930c1e9e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:05.608066 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:05.657082 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:05.685940 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceccb97-2190-4afa-afe9-cdcb2fd4489a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:05.739722 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd8c78-1fbe-48cd-a764-d3df930c1e9e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:05.763346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff965-b868-41e4-910a-4e4ca34fdb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:05.764595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff965-b868-41e4-910a-4e4ca34fdb87 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:05.765175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff965-b868-41e4-910a-4e4ca34fdb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:05.765752 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff965-b868-41e4-910a-4e4ca34fdb87 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:05.767419 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ff965-b868-41e4-910a-4e4ca34fdb87 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:05.767968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ff965-b868-41e4-910a-4e4ca34fdb87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:05.770498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ff965-b868-41e4-910a-4e4ca34fdb87 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:05.775952 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 445/898] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 27 15:13:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:05.787801 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042e70d-f8bc-4473-b718-43d32384398d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:05.788519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042e70d-f8bc-4473-b718-43d32384398d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:05.788807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042e70d-f8bc-4473-b718-43d32384398d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:05.789084 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042e70d-f8bc-4473-b718-43d32384398d None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:05.789864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042e70d-f8bc-4473-b718-43d32384398d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:05.790177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042e70d-f8bc-4473-b718-43d32384398d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:05.791704 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042e70d-f8bc-4473-b718-43d32384398d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:05.808317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 454/899] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:05.816741 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff965-b868-41e4-910a-4e4ca34fdb87 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:05.940514 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff965-b868-41e4-910a-4e4ca34fdb87 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:05.970949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:05.981551 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4930c97-6e00-42f8-a17a-a81a10ca1be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:05.982426 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4930c97-6e00-42f8-a17a-a81a10ca1be9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:05.982713 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4930c97-6e00-42f8-a17a-a81a10ca1be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:05.982997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4930c97-6e00-42f8-a17a-a81a10ca1be9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:05.991571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4930c97-6e00-42f8-a17a-a81a10ca1be9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:05.993077 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4930c97-6e00-42f8-a17a-a81a10ca1be9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:06.009362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e4930c97-6e00-42f8-a17a-a81a10ca1be9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:13:06.009362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:06.009362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:06.009362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:06.009362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:06.009362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:06.009362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:06.009362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:06.009362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:06.009362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:06.009362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:06.009362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:06.009362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:13:06.009362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:13:06.009362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:06.010460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:06.011601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:13:06.011601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:13:06.011601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:13:06.011601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:13:06.011601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:13:06.011601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:13:06.011601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:13:06.011601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:06.011601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 446/900] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:13:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:06.019732 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042e70d-f8bc-4473-b718-43d32384398d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:06.045077 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd937ad-ff3f-45ae-9520-acf0ab3b4184 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:06.045626 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd937ad-ff3f-45ae-9520-acf0ab3b4184 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:06.045906 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd937ad-ff3f-45ae-9520-acf0ab3b4184 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:06.048010 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 447/901] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:06.055437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea93203-5313-4970-a9dd-b1392b092649 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:06.055775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea93203-5313-4970-a9dd-b1392b092649 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:06.055996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea93203-5313-4970-a9dd-b1392b092649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:06.079078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5ea93203-5313-4970-a9dd-b1392b092649 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:06.080332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5ea93203-5313-4970-a9dd-b1392b092649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:06.168941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042e70d-f8bc-4473-b718-43d32384398d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:06.197086 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 448/902] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:13:06.207517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:06.229092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea93203-5313-4970-a9dd-b1392b092649 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:06.240602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee98f-5e93-4250-a226-8fe29b429dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:06.242371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee98f-5e93-4250-a226-8fe29b429dac None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:06.243193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee98f-5e93-4250-a226-8fe29b429dac None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:06.243824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee98f-5e93-4250-a226-8fe29b429dac None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:06.245475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bee98f-5e93-4250-a226-8fe29b429dac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:06.246374 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bee98f-5e93-4250-a226-8fe29b429dac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:06.249067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bee98f-5e93-4250-a226-8fe29b429dac None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:06.274704 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 455/903] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:13:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:06.287581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee98f-5e93-4250-a226-8fe29b429dac None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:06.418276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea93203-5313-4970-a9dd-b1392b092649 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:06.448000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:06.475488 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824d843-eafe-4e49-a307-4f2c50f40573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:06.476335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824d843-eafe-4e49-a307-4f2c50f40573 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:06.476637 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824d843-eafe-4e49-a307-4f2c50f40573 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:06.476919 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824d843-eafe-4e49-a307-4f2c50f40573 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:06.477709 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824d843-eafe-4e49-a307-4f2c50f40573 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:06.479510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824d843-eafe-4e49-a307-4f2c50f40573 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:06.505864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e824d843-eafe-4e49-a307-4f2c50f40573 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 15:13:06.505864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:06.505864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:13:06.505864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:13:06.505864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:13:06.505864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:13:06.505864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:13:06.505864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:06.505864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 15:13:06.505864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:06.505864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:06.505864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:06.505864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:06.505864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:06.505864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:06.505864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:06.507411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:06.507411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:06.507411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:06.507411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:06.507411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:06.507411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:06.507411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:06.507411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:13:06.507411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:13:06.507411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:13:06.507411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:13:06.507411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:06.507411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:06.507411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:06.507411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:06.507411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:06.509073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:06.509073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:06.509073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:06.509073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:06.509073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:06.509073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:06.509073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:06.509073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:06.509073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:06.509073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:06.509073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:06.509073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:13:06.509073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:06.509073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 15:13:06.509073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:06.510688 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee98f-5e93-4250-a226-8fe29b429dac None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:06.518270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 449/904] 10.222.0.33 () {56 vars in 1132 bytes} [Mon Jun 27 15:13:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:13:06.522984 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824d843-eafe-4e49-a307-4f2c50f40573 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:06.570429 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d1ba5-8682-4c93-ad44-0bc1e490d321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:06.571117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d1ba5-8682-4c93-ad44-0bc1e490d321 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:06.571400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d1ba5-8682-4c93-ad44-0bc1e490d321 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:06.571676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d1ba5-8682-4c93-ad44-0bc1e490d321 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:06.572825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d1ba5-8682-4c93-ad44-0bc1e490d321 None admin] RBAC: Adding query filter params (role.id=340cdc0c7fc94ce1b6a527c006d0c86b, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=6f3dfc12a3ac499da540065c03bd2a82) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:06.573138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d1ba5-8682-4c93-ad44-0bc1e490d321 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:06.575066 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d1ba5-8682-4c93-ad44-0bc1e490d321 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:06.589968 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 456/905] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:13:06 2022] GET /identity/v3/role_assignments?user.id=6f3dfc12a3ac499da540065c03bd2a82&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=340cdc0c7fc94ce1b6a527c006d0c86b => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:06.699219 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824d843-eafe-4e49-a307-4f2c50f40573 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:06.744217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf99ec0-53af-4c7e-9813-e4eab68930f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:06.744943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf99ec0-53af-4c7e-9813-e4eab68930f7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:06.745232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf99ec0-53af-4c7e-9813-e4eab68930f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:06.745510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf99ec0-53af-4c7e-9813-e4eab68930f7 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:06.746541 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf99ec0-53af-4c7e-9813-e4eab68930f7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:06.746858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf99ec0-53af-4c7e-9813-e4eab68930f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:06.748358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf99ec0-53af-4c7e-9813-e4eab68930f7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:06.755761 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 450/906] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 27 15:13:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:06.761876 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d1ba5-8682-4c93-ad44-0bc1e490d321 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:06.816662 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:06.930922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d1ba5-8682-4c93-ad44-0bc1e490d321 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:06.973028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f58f0-525a-48c2-8d92-96bba1cec6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:06.974095 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f58f0-525a-48c2-8d92-96bba1cec6ec None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:06.974644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f58f0-525a-48c2-8d92-96bba1cec6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:06.975198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f58f0-525a-48c2-8d92-96bba1cec6ec None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:06.976163 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f58f0-525a-48c2-8d92-96bba1cec6ec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:06.976733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f58f0-525a-48c2-8d92-96bba1cec6ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:06.978438 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f58f0-525a-48c2-8d92-96bba1cec6ec None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:06.984876 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 457/907] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 27 15:13:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:06.992011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf99ec0-53af-4c7e-9813-e4eab68930f7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:07.065059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:07.176002 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf99ec0-53af-4c7e-9813-e4eab68930f7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:07.241255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749e6bf-c968-481e-830b-8552f96849f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:07.242541 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e6bf-c968-481e-830b-8552f96849f1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:07.242870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e6bf-c968-481e-830b-8552f96849f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:07.243154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e6bf-c968-481e-830b-8552f96849f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:07.244671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749e6bf-c968-481e-830b-8552f96849f1 None admin] RBAC: Adding query filter params (interface=public, service_id=35ba3a6c0b444cd8a5834492711a097e, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:07.245209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749e6bf-c968-481e-830b-8552f96849f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:07.247638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749e6bf-c968-481e-830b-8552f96849f1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:07.260905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 451/908] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Jun 27 15:13:06 2022] GET /identity/v3/endpoints?service_id=35ba3a6c0b444cd8a5834492711a097e&interface=public®ion_id=RegionOne => generated 194 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:07.266724 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f58f0-525a-48c2-8d92-96bba1cec6ec None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:07.381661 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f58f0-525a-48c2-8d92-96bba1cec6ec None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:07.383835 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:07.426685 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800a5ab-8acd-463f-b113-83aae56b6b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:07.427393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800a5ab-8acd-463f-b113-83aae56b6b99 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:07.427675 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800a5ab-8acd-463f-b113-83aae56b6b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:07.427950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800a5ab-8acd-463f-b113-83aae56b6b99 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:07.428659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800a5ab-8acd-463f-b113-83aae56b6b99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:07.430461 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800a5ab-8acd-463f-b113-83aae56b6b99 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:07.438035 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 458/909] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 27 15:13:07 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:13:07.942439 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af46d3c-44cd-488f-b8a9-925dff26eb09 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:07.943498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af46d3c-44cd-488f-b8a9-925dff26eb09 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:07.943997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af46d3c-44cd-488f-b8a9-925dff26eb09 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:07.946133 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 452/910] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:07.952097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16ec2b-f46d-4f4d-8118-6f3baebe4685 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:07.953252 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16ec2b-f46d-4f4d-8118-6f3baebe4685 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:07.953820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16ec2b-f46d-4f4d-8118-6f3baebe4685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:07.972672 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5e16ec2b-f46d-4f4d-8118-6f3baebe4685 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:07.974304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5e16ec2b-f46d-4f4d-8118-6f3baebe4685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:08.051417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 459/911] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:08.075287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af46d3c-44cd-488f-b8a9-925dff26eb09 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:08.195835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af46d3c-44cd-488f-b8a9-925dff26eb09 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:08.206442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:08.234277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca924bc-8ff8-4c10-a965-177fc691bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:08.235119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca924bc-8ff8-4c10-a965-177fc691bbcf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:08.235402 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca924bc-8ff8-4c10-a965-177fc691bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:08.235679 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca924bc-8ff8-4c10-a965-177fc691bbcf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:08.236349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca924bc-8ff8-4c10-a965-177fc691bbcf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:08.237748 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca924bc-8ff8-4c10-a965-177fc691bbcf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-fca924bc-8ff8-4c10-a965-177fc691bbcf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:08.250905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:08.253175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:08.253175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:08.253175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:08.253175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:08.253175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:08.253175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:08.253175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:13:08.253175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:13:08.253175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:13:08.253175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:13:08.253175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:08.253175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:08.253175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:08.253175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:08.253175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:08.253175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:08.255213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:08.255213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:08.255213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:08.255213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:08.255213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:08.255213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:08.255213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:08.255213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:08.255213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:08.255213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:08.255213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:13:08.255213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:08.255213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 15:13:08.255213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:08.255213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 453/912] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:13:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:08.263101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16ec2b-f46d-4f4d-8118-6f3baebe4685 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:08.364923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:08.371601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16ec2b-f46d-4f4d-8118-6f3baebe4685 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:08.408757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f9955-d30e-44d2-b525-21ed6255a843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:08.409532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f9955-d30e-44d2-b525-21ed6255a843 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:08.409821 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f9955-d30e-44d2-b525-21ed6255a843 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:08.410096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f9955-d30e-44d2-b525-21ed6255a843 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:08.410892 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f9955-d30e-44d2-b525-21ed6255a843 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:08.411260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f9955-d30e-44d2-b525-21ed6255a843 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:08.412777 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f9955-d30e-44d2-b525-21ed6255a843 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:08.418637 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 460/913] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:13:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:08.424671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca924bc-8ff8-4c10-a965-177fc691bbcf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:08.439895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0dca69-c9a9-4b07-ac46-db25620e783d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:08.439895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0dca69-c9a9-4b07-ac46-db25620e783d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:08.439895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0dca69-c9a9-4b07-ac46-db25620e783d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:08.439895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 461/914] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:08.449623 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec7bf4-99c1-4ba3-a587-d863f542a0a5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:08.450548 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec7bf4-99c1-4ba3-a587-d863f542a0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:08.451236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec7bf4-99c1-4ba3-a587-d863f542a0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:08.478816 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-40ec7bf4-99c1-4ba3-a587-d863f542a0a5 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:08.481406 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-40ec7bf4-99c1-4ba3-a587-d863f542a0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:08.558432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca924bc-8ff8-4c10-a965-177fc691bbcf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:08.605215 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627be2eb-c1a9-488e-adbc-124731a13e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:08.606266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be2eb-c1a9-488e-adbc-124731a13e03 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:08.606696 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be2eb-c1a9-488e-adbc-124731a13e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:08.607109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be2eb-c1a9-488e-adbc-124731a13e03 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:08.608072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627be2eb-c1a9-488e-adbc-124731a13e03 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:08.608538 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627be2eb-c1a9-488e-adbc-124731a13e03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:08.610499 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627be2eb-c1a9-488e-adbc-124731a13e03 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:08.610760 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 462/915] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:13:08.622266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 454/916] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 27 15:13:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:08.624165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec7bf4-99c1-4ba3-a587-d863f542a0a5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:08.645054 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627be2eb-c1a9-488e-adbc-124731a13e03 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:08.708437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:08.750692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:08.759396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec7bf4-99c1-4ba3-a587-d863f542a0a5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:08.804859 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269c102-6ba9-4908-9361-52b5d5ea3844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:08.805555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269c102-6ba9-4908-9361-52b5d5ea3844 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:08.805841 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269c102-6ba9-4908-9361-52b5d5ea3844 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:08.806120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269c102-6ba9-4908-9361-52b5d5ea3844 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:08.807105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269c102-6ba9-4908-9361-52b5d5ea3844 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:08.808903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269c102-6ba9-4908-9361-52b5d5ea3844 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:08.833346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627be2eb-c1a9-488e-adbc-124731a13e03 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:08.836828 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 463/917] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 27 15:13:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:13:08.838809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd9a48-db2b-4f2d-be30-97b5ca84a2a8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:08.839341 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd9a48-db2b-4f2d-be30-97b5ca84a2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:08.839827 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd9a48-db2b-4f2d-be30-97b5ca84a2a8 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:08.843076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 464/918] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:08.856072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1846e7-6293-4eef-8be5-6e32886b3390 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:08.856072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1846e7-6293-4eef-8be5-6e32886b3390 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:08.856485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1846e7-6293-4eef-8be5-6e32886b3390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:08.882274 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fe1846e7-6293-4eef-8be5-6e32886b3390 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:08.883537 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fe1846e7-6293-4eef-8be5-6e32886b3390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:08.930881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993574a-1250-443b-ad23-8cb3f96d2b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:08.932131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993574a-1250-443b-ad23-8cb3f96d2b75 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:08.932615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993574a-1250-443b-ad23-8cb3f96d2b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:08.933102 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993574a-1250-443b-ad23-8cb3f96d2b75 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:08.934566 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993574a-1250-443b-ad23-8cb3f96d2b75 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:08.936955 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993574a-1250-443b-ad23-8cb3f96d2b75 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:08.963049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 455/919] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 27 15:13:08 2022] POST /identity/v3/services => generated 241 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:13:08.994715 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 465/920] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:09.034716 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993574a-1250-443b-ad23-8cb3f96d2b75 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:09.185011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:09.196143 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993574a-1250-443b-ad23-8cb3f96d2b75 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:09.237172 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f2900-93b2-4efb-947b-0f02959177fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:09.237949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f2900-93b2-4efb-947b-0f02959177fa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:09.238248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f2900-93b2-4efb-947b-0f02959177fa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:09.238544 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f2900-93b2-4efb-947b-0f02959177fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:09.252130 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f2900-93b2-4efb-947b-0f02959177fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:13:09.260705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4d3f2900-93b2-4efb-947b-0f02959177fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 15:13:09.260705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:09.260705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:09.260705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:09.260705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:09.260705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:09.260705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:09.260705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:09.260705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:09.260705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:09.260705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:09.260705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:09.260705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:13:09.260705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:13:09.260705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:13:09.260705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:13:09.261731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:13:09.261731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:13:09.261731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:13:09.261731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:13:09.261731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:09.261731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:09.261731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:09.261731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:09.261731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:09.261731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:09.261731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:09.261731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:09.261731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:09.261731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:09.261731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:09.261731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:09.262847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:09.262847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:09.262847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:09.262847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:09.262847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:13:09.262847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:13:09.262847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:13:09.262847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:13:09.262847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:13:09.262847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:13:09.262847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 15:13:09.262847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:09.262847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 456/921] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Jun 27 15:13:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:09.271335 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1846e7-6293-4eef-8be5-6e32886b3390 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:09.402915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:09.460554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1846e7-6293-4eef-8be5-6e32886b3390 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:09.499383 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938080c-a85d-4fb0-9fa5-55fe58603e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:09.499988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938080c-a85d-4fb0-9fa5-55fe58603e02 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:09.500278 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938080c-a85d-4fb0-9fa5-55fe58603e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:09.500558 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938080c-a85d-4fb0-9fa5-55fe58603e02 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:09.501327 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938080c-a85d-4fb0-9fa5-55fe58603e02 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:09.501640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938080c-a85d-4fb0-9fa5-55fe58603e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:09.503084 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938080c-a85d-4fb0-9fa5-55fe58603e02 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:09.512906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 466/922] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Jun 27 15:13:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:09.522021 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f2900-93b2-4efb-947b-0f02959177fa None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:09.620219 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dc907-173f-41c5-8320-d27b5573bb94 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:09.620694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dc907-173f-41c5-8320-d27b5573bb94 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:09.621456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dc907-173f-41c5-8320-d27b5573bb94 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:09.623088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 467/923] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:09.629271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735cdd6-18a0-4d72-822f-4dac9ca744fa None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:09.629672 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735cdd6-18a0-4d72-822f-4dac9ca744fa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:09.630047 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735cdd6-18a0-4d72-822f-4dac9ca744fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:09.648933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9735cdd6-18a0-4d72-822f-4dac9ca744fa None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:09.650394 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9735cdd6-18a0-4d72-822f-4dac9ca744fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:09.672953 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f2900-93b2-4efb-947b-0f02959177fa None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:09.712507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12770a74-cfee-4743-9810-8c58418d99eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:09.713596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12770a74-cfee-4743-9810-8c58418d99eb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:09.714032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12770a74-cfee-4743-9810-8c58418d99eb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:09.714536 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12770a74-cfee-4743-9810-8c58418d99eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:09.727171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12770a74-cfee-4743-9810-8c58418d99eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:09.728908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12770a74-cfee-4743-9810-8c58418d99eb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:09.734654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 468/924] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:13:09.748343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-12770a74-cfee-4743-9810-8c58418d99eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:09.748343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:09.748343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:09.748343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:09.748343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:09.748343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:09.748343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:09.748343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:09.748343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:09.748343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:09.748343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:09.748343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:09.748343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:13:09.748343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:13:09.748343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:09.749592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:09.751084 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:13:09.751084 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:13:09.751084 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:09.751084 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:09.751817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735cdd6-18a0-4d72-822f-4dac9ca744fa None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:09.753370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 457/925] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:09.760462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12770a74-cfee-4743-9810-8c58418d99eb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:09.765186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:09.826850 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:09.881316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735cdd6-18a0-4d72-822f-4dac9ca744fa None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:09.889129 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12770a74-cfee-4743-9810-8c58418d99eb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:09.923849 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbf6bf-1723-41a8-99a5-ae56a7b55e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:09.925066 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbf6bf-1723-41a8-99a5-ae56a7b55e97 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:09.925522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbf6bf-1723-41a8-99a5-ae56a7b55e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:09.925959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbf6bf-1723-41a8-99a5-ae56a7b55e97 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:09.926855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbf6bf-1723-41a8-99a5-ae56a7b55e97 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:09.928571 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbf6bf-1723-41a8-99a5-ae56a7b55e97 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:09.937573 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef78475-a90a-4861-a70f-deb1a85d3946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:09.938451 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef78475-a90a-4861-a70f-deb1a85d3946 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:09.938743 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef78475-a90a-4861-a70f-deb1a85d3946 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:09.939025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef78475-a90a-4861-a70f-deb1a85d3946 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:09.939777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef78475-a90a-4861-a70f-deb1a85d3946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:09.940090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef78475-a90a-4861-a70f-deb1a85d3946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:09.941500 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef78475-a90a-4861-a70f-deb1a85d3946 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:09.943729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3ebbf6bf-1723-41a8-99a5-ae56a7b55e97 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 15:13:09.943729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:09.943729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:13:09.943729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:13:09.943729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:13:09.943729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:13:09.943729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:13:09.943729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:09.943729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 15:13:09.943729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:09.943729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:09.943729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:09.943729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:09.943729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:09.943729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:09.943729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:09.944853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:09.944853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:09.944853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:09.944853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:09.944853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:09.944853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:09.944853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:09.944853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:13:09.944853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:13:09.944853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:13:09.944853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:13:09.944853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:09.944853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:09.944853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:09.944853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:09.944853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:09.945857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:09.945857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:09.945857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:09.945857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:09.945857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:09.945857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:09.945857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:09.945857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:09.945857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:09.945857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:09.945857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:09.945857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:13:09.945857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:09.945857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 15:13:09.945857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:09.953501 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 469/926] 10.222.0.33 () {56 vars in 1132 bytes} [Mon Jun 27 15:13:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:09.955291 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbf6bf-1723-41a8-99a5-ae56a7b55e97 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:09.956520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 458/927] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:09.961752 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef78475-a90a-4861-a70f-deb1a85d3946 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:10.032735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:10.073573 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef78475-a90a-4861-a70f-deb1a85d3946 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:10.082800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbf6bf-1723-41a8-99a5-ae56a7b55e97 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:10.110346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76123d23-a1de-40d6-8299-3233845292ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:10.111191 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76123d23-a1de-40d6-8299-3233845292ab None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:10.111473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76123d23-a1de-40d6-8299-3233845292ab None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:10.111745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76123d23-a1de-40d6-8299-3233845292ab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:10.116803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:10.119800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76123d23-a1de-40d6-8299-3233845292ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:10.121263 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76123d23-a1de-40d6-8299-3233845292ab None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:10.126325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dd585-a0bc-481c-a09c-6894c3376566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:10.127376 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dd585-a0bc-481c-a09c-6894c3376566 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:10.127884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dd585-a0bc-481c-a09c-6894c3376566 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:10.128370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dd585-a0bc-481c-a09c-6894c3376566 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:10.129371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dd585-a0bc-481c-a09c-6894c3376566 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:10.129949 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dd585-a0bc-481c-a09c-6894c3376566 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:10.132314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dd585-a0bc-481c-a09c-6894c3376566 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:10.142872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-76123d23-a1de-40d6-8299-3233845292ab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 15:13:10.142872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:10.142872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:10.142872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:10.142872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:10.142872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:10.142872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:10.142872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:10.142872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:10.142872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:10.142872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:10.142872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:10.142872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:13:10.142872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:13:10.142872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:13:10.142872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:10.143920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:10.144871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:10.144871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:10.144871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:13:10.144871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:13:10.144871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:13:10.144871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:13:10.144871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:13:10.144871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:13:10.144871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 15:13:10.144871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:10.144871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 459/928] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 27 15:13:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:10.146655 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 470/929] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 27 15:13:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:10.148025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76123d23-a1de-40d6-8299-3233845292ab None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:10.150246 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dd585-a0bc-481c-a09c-6894c3376566 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:10.264013 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76123d23-a1de-40d6-8299-3233845292ab None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:10.312163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:10.330607 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ace81-b1c8-4ff7-b342-dc384158d666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:10.331269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ace81-b1c8-4ff7-b342-dc384158d666 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:10.331743 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ace81-b1c8-4ff7-b342-dc384158d666 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:10.332210 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ace81-b1c8-4ff7-b342-dc384158d666 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:10.333682 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ace81-b1c8-4ff7-b342-dc384158d666 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:10.334202 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ace81-b1c8-4ff7-b342-dc384158d666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:10.336858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ace81-b1c8-4ff7-b342-dc384158d666 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:10.359338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dd585-a0bc-481c-a09c-6894c3376566 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:10.378902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 460/930] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Jun 27 15:13:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:10.387470 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ace81-b1c8-4ff7-b342-dc384158d666 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:10.401748 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1bd5-233a-4a73-af06-a0182f9f6ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:10.403013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1bd5-233a-4a73-af06-a0182f9f6ebf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:10.403660 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1bd5-233a-4a73-af06-a0182f9f6ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:10.404001 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1bd5-233a-4a73-af06-a0182f9f6ebf None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:10.404803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e1bd5-233a-4a73-af06-a0182f9f6ebf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:10.405180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e1bd5-233a-4a73-af06-a0182f9f6ebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:10.406943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e1bd5-233a-4a73-af06-a0182f9f6ebf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:10.413635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 471/931] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 27 15:13:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:10.419366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1bd5-233a-4a73-af06-a0182f9f6ebf None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:10.484927 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:10.528083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ace81-b1c8-4ff7-b342-dc384158d666 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:10.555028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1bd5-233a-4a73-af06-a0182f9f6ebf None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:10.568679 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0baa82-9b80-4ed6-9faf-2aa3e371702f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:10.569403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0baa82-9b80-4ed6-9faf-2aa3e371702f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:10.569689 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0baa82-9b80-4ed6-9faf-2aa3e371702f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:10.569966 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0baa82-9b80-4ed6-9faf-2aa3e371702f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:10.583723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0baa82-9b80-4ed6-9faf-2aa3e371702f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:10.585459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0baa82-9b80-4ed6-9faf-2aa3e371702f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:10.599347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606034d-5ede-473e-9435-ce5930154f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:10.600049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606034d-5ede-473e-9435-ce5930154f34 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:10.600338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606034d-5ede-473e-9435-ce5930154f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:10.600618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606034d-5ede-473e-9435-ce5930154f34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:10.601418 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606034d-5ede-473e-9435-ce5930154f34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:10.602929 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606034d-5ede-473e-9435-ce5930154f34 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:10.606858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4a0baa82-9b80-4ed6-9faf-2aa3e371702f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:10.606858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:10.606858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:10.606858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:10.606858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:10.606858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:10.606858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:10.606858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:10.606858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:10.606858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:10.606858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:10.606858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:10.606858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:13:10.606858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:13:10.606858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:10.609980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:10.612675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:13:10.612675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:13:10.612675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:10.612675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:10.618280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 461/932] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:10.618280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0baa82-9b80-4ed6-9faf-2aa3e371702f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:10.638286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 472/933] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 27 15:13:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:13:10.670656 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:10.755260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0baa82-9b80-4ed6-9faf-2aa3e371702f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:10.803946 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a30e43-61a8-4459-98b7-0e5cf4eda53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:10.804649 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a30e43-61a8-4459-98b7-0e5cf4eda53a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:10.805094 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a30e43-61a8-4459-98b7-0e5cf4eda53a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:10.805441 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a30e43-61a8-4459-98b7-0e5cf4eda53a None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:10.806244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a30e43-61a8-4459-98b7-0e5cf4eda53a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:10.806683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a30e43-61a8-4459-98b7-0e5cf4eda53a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:10.808194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a30e43-61a8-4459-98b7-0e5cf4eda53a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:10.821742 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 462/934] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:10.827435 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606034d-5ede-473e-9435-ce5930154f34 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:10.939569 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606034d-5ede-473e-9435-ce5930154f34 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:10.954745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:10.978329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7dae9-499d-4d4d-9f1b-691c31fb454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:10.979157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7dae9-499d-4d4d-9f1b-691c31fb454b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:10.979441 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7dae9-499d-4d4d-9f1b-691c31fb454b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:10.979717 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7dae9-499d-4d4d-9f1b-691c31fb454b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:10.987771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7dae9-499d-4d4d-9f1b-691c31fb454b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:10.989321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7dae9-499d-4d4d-9f1b-691c31fb454b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:11.005640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c9a7dae9-499d-4d4d-9f1b-691c31fb454b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:13:11.005640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:11.005640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:11.005640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:11.005640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:11.005640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:11.005640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:11.005640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:11.005640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:11.005640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:11.005640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:11.005640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:11.005640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:13:11.005640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:13:11.005640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:11.006644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:11.007546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:13:11.007546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:13:11.007546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:13:11.007546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:13:11.007546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:13:11.007546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:13:11.007546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:13:11.007546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:11.007546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 473/935] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:13:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:11.014498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a30e43-61a8-4459-98b7-0e5cf4eda53a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:11.123915 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:11.142064 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a30e43-61a8-4459-98b7-0e5cf4eda53a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:11.185498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6737c06-2fa6-4ada-b224-c079efa47163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:11.186189 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6737c06-2fa6-4ada-b224-c079efa47163 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:11.186513 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6737c06-2fa6-4ada-b224-c079efa47163 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:11.186890 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6737c06-2fa6-4ada-b224-c079efa47163 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:11.187827 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6737c06-2fa6-4ada-b224-c079efa47163 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:11.188165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6737c06-2fa6-4ada-b224-c079efa47163 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:11.189645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6737c06-2fa6-4ada-b224-c079efa47163 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:11.204988 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 463/936] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:13:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:11.211053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7dae9-499d-4d4d-9f1b-691c31fb454b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:11.329245 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7dae9-499d-4d4d-9f1b-691c31fb454b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:11.367880 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c552447-de00-42cb-ab5d-e96525a1e4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:11.369161 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c552447-de00-42cb-ab5d-e96525a1e4c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:11.369625 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c552447-de00-42cb-ab5d-e96525a1e4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:11.370087 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c552447-de00-42cb-ab5d-e96525a1e4c8 None admin] PATH_INFO: `/v3/projects/3f8ec287061141028659ab504e7707de/users/6f3dfc12a3ac499da540065c03bd2a82/roles/340cdc0c7fc94ce1b6a527c006d0c86b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:11.372585 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c552447-de00-42cb-ab5d-e96525a1e4c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f8ec287061141028659ab504e7707de, user_id=6f3dfc12a3ac499da540065c03bd2a82, role_id=340cdc0c7fc94ce1b6a527c006d0c86b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:11.374600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c552447-de00-42cb-ab5d-e96525a1e4c8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:11.395643 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 474/937] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:13:11 2022] PUT /identity/v3/projects/3f8ec287061141028659ab504e7707de/users/6f3dfc12a3ac499da540065c03bd2a82/roles/340cdc0c7fc94ce1b6a527c006d0c86b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:13:11.877167 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86953ae1-dbd9-4cd1-a4e1-962ce0ed6a82 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:11.877450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86953ae1-dbd9-4cd1-a4e1-962ce0ed6a82 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:11.877725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86953ae1-dbd9-4cd1-a4e1-962ce0ed6a82 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:11.879613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 464/938] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:11.885467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5607c2e-4bbf-4ddf-a2d3-ac4b291e69f5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:11.885826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5607c2e-4bbf-4ddf-a2d3-ac4b291e69f5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:11.886048 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5607c2e-4bbf-4ddf-a2d3-ac4b291e69f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:11.905587 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c5607c2e-4bbf-4ddf-a2d3-ac4b291e69f5 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:11.906853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c5607c2e-4bbf-4ddf-a2d3-ac4b291e69f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:11.943519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:12.018371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 475/939] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:12.049858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86953ae1-dbd9-4cd1-a4e1-962ce0ed6a82 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:12.118012 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59e18e-2a25-41e2-9f94-0fe32f7f322c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:12.118386 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59e18e-2a25-41e2-9f94-0fe32f7f322c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:12.118608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59e18e-2a25-41e2-9f94-0fe32f7f322c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:12.120183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 476/940] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:12.131037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfef5d2-4684-46d5-8083-537a78d2ee16 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:12.131329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfef5d2-4684-46d5-8083-537a78d2ee16 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:12.131731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfef5d2-4684-46d5-8083-537a78d2ee16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:12.150996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3cfef5d2-4684-46d5-8083-537a78d2ee16 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:12.152351 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3cfef5d2-4684-46d5-8083-537a78d2ee16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:12.196108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86953ae1-dbd9-4cd1-a4e1-962ce0ed6a82 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:12.247054 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdbabd-5242-431f-944d-6df2164c5128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:12.248625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdbabd-5242-431f-944d-6df2164c5128 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:12.249504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdbabd-5242-431f-944d-6df2164c5128 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:12.250274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdbabd-5242-431f-944d-6df2164c5128 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:12.258252 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 477/941] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:13:12.259025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdbabd-5242-431f-944d-6df2164c5128 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:12.259025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdbabd-5242-431f-944d-6df2164c5128 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:12.259025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: WARNING keystone.server.flask.common [None req-d6bdbabd-5242-431f-944d-6df2164c5128 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 27 15:13:12.283443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.sql.core [None req-d6bdbabd-5242-431f-944d-6df2164c5128 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 27 15:13:12.283443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 27 15:13:12.283443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [parameters: {'id': '0e4f45483922450e84542fbfca2a0cf0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 27 15:13:12.283443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80193) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 27 15:13:12.298118 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfef5d2-4684-46d5-8083-537a78d2ee16 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:12.314636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d6bdbabd-5242-431f-944d-6df2164c5128 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0e4f45483922450e84542fbfca2a0cf0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0e4f45483922450e84542fbfca2a0cf0. Jun 27 15:13:12.314636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:12.314636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 15:13:12.314636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 15:13:12.314636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 15:13:12.314636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 15:13:12.314636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 15:13:12.314636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 15:13:12.314636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 15:13:12.314636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application conn.query(q) Jun 27 15:13:12.314636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 15:13:12.314636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 15:13:12.314636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result.read() Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 27 15:13:12.316280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application next(self.gen) Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application yield resource Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application next(self.gen) Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.session.rollback() Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.force_reraise() Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise self.value Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application session.commit() Jun 27 15:13:12.318160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._prepare_impl() Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.session.flush() Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._flush(objects) Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application compat.raise_( Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application flush_context.execute() Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 27 15:13:12.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rec.execute(self) Jun 27 15:13:12.321526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 27 15:13:12.321526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 27 15:13:12.321526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 27 15:13:12.321526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 27 15:13:12.321526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 27 15:13:12.321526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 27 15:13:12.321526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 27 15:13:12.321526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 27 15:13:12.321526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 27 15:13:12.321526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 27 15:13:12.321526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 27 15:13:12.321526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 27 15:13:12.321526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 27 15:13:12.321526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 27 15:13:12.321526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application conn.query(q) Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result.read() Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 15:13:12.325281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 15:13:12.332193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 15:13:12.332193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 15:13:12.332193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 15:13:12.332193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 15:13:12.332193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 15:13:12.332193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 15:13:12.332193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 27 15:13:12.332193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 27 15:13:12.332193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [parameters: {'id': '0e4f45483922450e84542fbfca2a0cf0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 27 15:13:12.332193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 27 15:13:12.332193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:12.332193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:12.332193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:12.332193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:12.332193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:12.335245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:12.338726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:12.338726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 27 15:13:12.338726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 27 15:13:12.338726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:12.338726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:12.338726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 27 15:13:12.338726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 27 15:13:12.338726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0e4f45483922450e84542fbfca2a0cf0. Jun 27 15:13:12.338726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:12.338726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 465/942] 10.222.0.33 () {60 vars in 1140 bytes} [Mon Jun 27 15:13:12 2022] POST /identity/v3/projects => generated 262 bytes in 267 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:12.338726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdbabd-5242-431f-944d-6df2164c5128 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:12.338726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:12.443370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdbabd-5242-431f-944d-6df2164c5128 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:12.474790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:12.486941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfef5d2-4684-46d5-8083-537a78d2ee16 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:12.487176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc0de6-5d43-423c-acb7-0317f234cb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:12.487881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc0de6-5d43-423c-acb7-0317f234cb55 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:12.488167 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc0de6-5d43-423c-acb7-0317f234cb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:12.488446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc0de6-5d43-423c-acb7-0317f234cb55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:12.496746 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc0de6-5d43-423c-acb7-0317f234cb55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:12.498821 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc0de6-5d43-423c-acb7-0317f234cb55 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:12.514891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-dbcc0de6-5d43-423c-acb7-0317f234cb55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:13:12.514891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:12.514891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:12.514891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:12.514891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:12.514891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:12.514891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:12.514891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:12.514891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:12.514891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:12.514891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:12.514891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:12.514891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:13:12.514891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:13:12.514891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:12.516080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:12.516964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:13:12.516964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:13:12.516964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:13:12.516964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:13:12.516964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:13:12.516964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:13:12.516964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:13:12.516964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:12.521158 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 466/943] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:13:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:13:12.522507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc0de6-5d43-423c-acb7-0317f234cb55 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:12.531769 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cb655-b166-4d60-bf97-ee79414748eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:12.532975 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cb655-b166-4d60-bf97-ee79414748eb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:12.533448 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cb655-b166-4d60-bf97-ee79414748eb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:12.533906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cb655-b166-4d60-bf97-ee79414748eb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:12.534830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308cb655-b166-4d60-bf97-ee79414748eb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:12.536469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308cb655-b166-4d60-bf97-ee79414748eb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-308cb655-b166-4d60-bf97-ee79414748eb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:12.549776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:12.551000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:12.551000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:12.551000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:12.551000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:12.551000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:12.551000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:12.551000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:13:12.551000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:13:12.551000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:13:12.551000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:13:12.551000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:12.551000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:12.551000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:12.551000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:12.551000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:12.551000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:12.551963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:12.551963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:12.551963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:12.551963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:12.551963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:12.551963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:12.551963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:12.551963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:12.551963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:12.551963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:12.551963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:13:12.551963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:12.551963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 15:13:12.551963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:12.559555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 478/944] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 27 15:13:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:13:12.560753 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cb655-b166-4d60-bf97-ee79414748eb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:12.601290 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:12.642463 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc0de6-5d43-423c-acb7-0317f234cb55 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:12.688532 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70b690-ccb8-426a-872c-44bbb6c8d110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:12.689428 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cb655-b166-4d60-bf97-ee79414748eb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:12.689683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70b690-ccb8-426a-872c-44bbb6c8d110 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:12.690111 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70b690-ccb8-426a-872c-44bbb6c8d110 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:12.690570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70b690-ccb8-426a-872c-44bbb6c8d110 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:12.691613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70b690-ccb8-426a-872c-44bbb6c8d110 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:12.692071 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70b690-ccb8-426a-872c-44bbb6c8d110 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:12.693847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70b690-ccb8-426a-872c-44bbb6c8d110 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:12.719741 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 467/945] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 27 15:13:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:12.736045 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990181f-1ad0-499c-a858-fc85ec25b706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:12.737149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990181f-1ad0-499c-a858-fc85ec25b706 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:12.737687 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990181f-1ad0-499c-a858-fc85ec25b706 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:12.738118 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990181f-1ad0-499c-a858-fc85ec25b706 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:12.739210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990181f-1ad0-499c-a858-fc85ec25b706 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:12.739750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990181f-1ad0-499c-a858-fc85ec25b706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:12.741682 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990181f-1ad0-499c-a858-fc85ec25b706 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:12.748337 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 479/946] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 27 15:13:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:12.755048 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70b690-ccb8-426a-872c-44bbb6c8d110 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:12.884361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70b690-ccb8-426a-872c-44bbb6c8d110 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:12.930801 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271da0d-cdb8-4742-a0f8-86caf8d22e12 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:12.931227 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271da0d-cdb8-4742-a0f8-86caf8d22e12 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:12.932107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271da0d-cdb8-4742-a0f8-86caf8d22e12 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:12.935033 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:12.938975 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 480/947] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:12.948985 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3b2dd-c8c1-4846-bb21-25f6a66abdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:12.949849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3b2dd-c8c1-4846-bb21-25f6a66abdbb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:12.950331 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3b2dd-c8c1-4846-bb21-25f6a66abdbb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:12.950677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3b2dd-c8c1-4846-bb21-25f6a66abdbb None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:12.951705 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb56d5-d038-4df0-bfd3-f851be0c0533 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:12.951813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3b2dd-c8c1-4846-bb21-25f6a66abdbb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:12.952039 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3b2dd-c8c1-4846-bb21-25f6a66abdbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:12.952244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb56d5-d038-4df0-bfd3-f851be0c0533 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:12.953140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb56d5-d038-4df0-bfd3-f851be0c0533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:12.954501 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3b2dd-c8c1-4846-bb21-25f6a66abdbb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:12.963087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 468/948] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 27 15:13:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:12.972913 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3b2dd-c8c1-4846-bb21-25f6a66abdbb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:12.985576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d9cb56d5-d038-4df0-bfd3-f851be0c0533 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:12.987140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d9cb56d5-d038-4df0-bfd3-f851be0c0533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:13.015909 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:13.111693 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 481/949] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:13.149520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb56d5-d038-4df0-bfd3-f851be0c0533 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:13.164387 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3b2dd-c8c1-4846-bb21-25f6a66abdbb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:13.230833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e147acb-20ee-45d5-8150-348e386f3c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:13.233387 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e147acb-20ee-45d5-8150-348e386f3c5c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:13.234454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e147acb-20ee-45d5-8150-348e386f3c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:13.235261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e147acb-20ee-45d5-8150-348e386f3c5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:13.237323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e147acb-20ee-45d5-8150-348e386f3c5c None admin] RBAC: Adding query filter params (interface=public, service_id=979c5e487e264d71906ff92784acd3c8, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:13.238358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e147acb-20ee-45d5-8150-348e386f3c5c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:13.241346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e147acb-20ee-45d5-8150-348e386f3c5c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:13.251100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 469/950] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Jun 27 15:13:12 2022] GET /identity/v3/endpoints?service_id=979c5e487e264d71906ff92784acd3c8&interface=public®ion_id=RegionOne => generated 194 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:13.257122 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e147acb-20ee-45d5-8150-348e386f3c5c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:13.281260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb56d5-d038-4df0-bfd3-f851be0c0533 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:13.325167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10146b-4818-4983-aa40-dfd6e80ef677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:13.326116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10146b-4818-4983-aa40-dfd6e80ef677 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:13.326329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10146b-4818-4983-aa40-dfd6e80ef677 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:13.326626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10146b-4818-4983-aa40-dfd6e80ef677 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:13.327348 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10146b-4818-4983-aa40-dfd6e80ef677 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:13.328826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10146b-4818-4983-aa40-dfd6e80ef677 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7f10146b-4818-4983-aa40-dfd6e80ef677 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:13.342338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:13.344079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:13.344079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:13.344079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:13.344079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:13.344079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:13.344079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:13.344079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:13:13.344079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:13:13.344079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:13:13.344079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:13:13.344079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:13.344079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:13.344079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:13.344079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:13.344079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:13.344079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:13.345676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:13.345676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:13.345676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:13.345676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:13.345676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:13.345676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:13.345676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:13.345676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:13.345676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:13.345676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:13.345676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:13:13.345676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:13.345676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 15:13:13.345676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:13.348845 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 482/951] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:13:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:13:13.350082 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10146b-4818-4983-aa40-dfd6e80ef677 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:13.370696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:13.385954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:13.441987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e147acb-20ee-45d5-8150-348e386f3c5c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:13.482244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54a34e-cc28-40a5-a007-fc5d5b1cde5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:13.482244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54a34e-cc28-40a5-a007-fc5d5b1cde5b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:13.482513 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54a34e-cc28-40a5-a007-fc5d5b1cde5b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:13.482616 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54a34e-cc28-40a5-a007-fc5d5b1cde5b None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:13.483318 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54a34e-cc28-40a5-a007-fc5d5b1cde5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:13.485315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54a34e-cc28-40a5-a007-fc5d5b1cde5b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:13.498989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 470/952] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 27 15:13:13 2022] GET /identity/v3/services => generated 1497 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:13:13.522901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10146b-4818-4983-aa40-dfd6e80ef677 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:13.567436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f281e89-f728-44e7-85a5-9ac62954dd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:13.568589 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f281e89-f728-44e7-85a5-9ac62954dd40 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:13.569119 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f281e89-f728-44e7-85a5-9ac62954dd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:13.569609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f281e89-f728-44e7-85a5-9ac62954dd40 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:13.570771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f281e89-f728-44e7-85a5-9ac62954dd40 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:13.571355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f281e89-f728-44e7-85a5-9ac62954dd40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:13.573136 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f281e89-f728-44e7-85a5-9ac62954dd40 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:13.579997 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 483/953] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 27 15:13:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:13.590283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54a34e-cc28-40a5-a007-fc5d5b1cde5b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:13.656556 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0f4cd-7992-4730-a704-d912517e905e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:13.656925 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0f4cd-7992-4730-a704-d912517e905e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:13.657131 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0f4cd-7992-4730-a704-d912517e905e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:13.662912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 484/954] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:13:13.665169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc189283-b612-4b44-a3db-4c595da78d31 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:13.665630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc189283-b612-4b44-a3db-4c595da78d31 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:13.666025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc189283-b612-4b44-a3db-4c595da78d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:13.686482 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fc189283-b612-4b44-a3db-4c595da78d31 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:13.688279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fc189283-b612-4b44-a3db-4c595da78d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:13.722763 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54a34e-cc28-40a5-a007-fc5d5b1cde5b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:13.758158 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:13.777627 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 485/955] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:13.783898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c3deb-1172-4b52-a65c-f95751e51fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:13.783898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c3deb-1172-4b52-a65c-f95751e51fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:13.783898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c3deb-1172-4b52-a65c-f95751e51fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:13.783898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c3deb-1172-4b52-a65c-f95751e51fe8 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:13.784304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c3deb-1172-4b52-a65c-f95751e51fe8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:13.784304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c3deb-1172-4b52-a65c-f95751e51fe8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:13.784304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c3deb-1172-4b52-a65c-f95751e51fe8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:13.788834 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 471/956] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 27 15:13:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:13.804561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc189283-b612-4b44-a3db-4c595da78d31 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:13.816266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:13.929297 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc189283-b612-4b44-a3db-4c595da78d31 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:13.973161 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c864cb3-bf56-41e0-9ef9-14a6c1f30f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:13.974043 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c864cb3-bf56-41e0-9ef9-14a6c1f30f34 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:13.974369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c864cb3-bf56-41e0-9ef9-14a6c1f30f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:13.974642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c864cb3-bf56-41e0-9ef9-14a6c1f30f34 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:13.988665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c864cb3-bf56-41e0-9ef9-14a6c1f30f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:13:13.997110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-0c864cb3-bf56-41e0-9ef9-14a6c1f30f34 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 15:13:13.997110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:13.997110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:13.997110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:13.997110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:13.997110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:13.997110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:13.997110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:13.997110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:13.997110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:13.997110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:13.997110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:13.997110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:13:13.997110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:13:13.997110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:13:13.997110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:13:13.998212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:13:13.998212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:13:13.998212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:13:13.998212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:13:13.998212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:13.998212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:13.998212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:13.998212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:13.998212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:13.998212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:13.998212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:13.998212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:13.998212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:13.998212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:13.998212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:13.998212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:13.999463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:13.999463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:13.999463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:13.999463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:13.999463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:13:13.999463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:13:13.999463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:13:13.999463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:13:13.999463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:13:13.999463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:13:13.999463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 15:13:13.999463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:13.999463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 486/957] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Jun 27 15:13:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:14.007517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c3deb-1172-4b52-a65c-f95751e51fe8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:14.153385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c3deb-1172-4b52-a65c-f95751e51fe8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:14.197706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41131a3d-2d66-4c4e-b6a0-1fee7bbfb12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:14.198494 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131a3d-2d66-4c4e-b6a0-1fee7bbfb12e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:14.198778 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131a3d-2d66-4c4e-b6a0-1fee7bbfb12e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:14.199143 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131a3d-2d66-4c4e-b6a0-1fee7bbfb12e None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:14.200008 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41131a3d-2d66-4c4e-b6a0-1fee7bbfb12e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:14.200317 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41131a3d-2d66-4c4e-b6a0-1fee7bbfb12e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:14.201867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41131a3d-2d66-4c4e-b6a0-1fee7bbfb12e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:14.213262 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 472/958] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Jun 27 15:13:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:14.219453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c864cb3-bf56-41e0-9ef9-14a6c1f30f34 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:14.293568 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:14.331474 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c864cb3-bf56-41e0-9ef9-14a6c1f30f34 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:14.371815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bbff6-648a-4fa3-b0ae-91c68546fb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:14.372653 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bbff6-648a-4fa3-b0ae-91c68546fb5e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:14.372934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bbff6-648a-4fa3-b0ae-91c68546fb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:14.373209 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bbff6-648a-4fa3-b0ae-91c68546fb5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:14.385917 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bbff6-648a-4fa3-b0ae-91c68546fb5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:14.387372 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bbff6-648a-4fa3-b0ae-91c68546fb5e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:14.407180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8d2bbff6-648a-4fa3-b0ae-91c68546fb5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:14.407180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:14.407180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:14.407180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:14.407180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:14.407180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:14.407180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:14.407180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:14.407180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:14.407180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:14.407180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:14.407180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:14.407180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:13:14.407180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:13:14.407180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:14.408317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:14.409543 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:13:14.409543 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:13:14.409543 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:14.409543 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:14.409543 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 487/959] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:14.415883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41131a3d-2d66-4c4e-b6a0-1fee7bbfb12e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:14.477827 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:14.545828 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41131a3d-2d66-4c4e-b6a0-1fee7bbfb12e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:14.586674 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba4f0c-3831-4d1d-adc3-1d336d730498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:14.587427 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba4f0c-3831-4d1d-adc3-1d336d730498 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:14.587716 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba4f0c-3831-4d1d-adc3-1d336d730498 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:14.587999 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba4f0c-3831-4d1d-adc3-1d336d730498 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:14.588801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba4f0c-3831-4d1d-adc3-1d336d730498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:14.589117 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba4f0c-3831-4d1d-adc3-1d336d730498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:14.590647 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba4f0c-3831-4d1d-adc3-1d336d730498 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:14.605461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 473/960] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:14.612013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bbff6-648a-4fa3-b0ae-91c68546fb5e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:14.736222 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bbff6-648a-4fa3-b0ae-91c68546fb5e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:14.759221 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:14.773996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e7061-227e-4a33-9a96-a283d8a82f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:14.775387 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e7061-227e-4a33-9a96-a283d8a82f30 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:14.775915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e7061-227e-4a33-9a96-a283d8a82f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:14.776515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e7061-227e-4a33-9a96-a283d8a82f30 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:14.785995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e7061-227e-4a33-9a96-a283d8a82f30 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:14.787505 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e7061-227e-4a33-9a96-a283d8a82f30 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:14.804013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7f6e7061-227e-4a33-9a96-a283d8a82f30 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 15:13:14.804013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:14.804013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:14.804013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:14.804013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:14.804013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:14.804013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:14.804013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:14.804013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:14.804013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:14.804013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:14.804013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:14.804013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:13:14.804013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:13:14.804013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:13:14.804013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:14.805075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:14.806322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:14.806322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:14.806322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:13:14.806322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:13:14.806322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:13:14.806322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:13:14.806322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:13:14.806322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:13:14.806322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 15:13:14.806322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:14.806322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 488/961] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 27 15:13:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:14.813530 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba4f0c-3831-4d1d-adc3-1d336d730498 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:14.929829 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba4f0c-3831-4d1d-adc3-1d336d730498 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:14.932309 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:14.973160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284b059-b3d1-41f5-9101-b565b2f0b299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:14.973854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284b059-b3d1-41f5-9101-b565b2f0b299 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:14.974135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284b059-b3d1-41f5-9101-b565b2f0b299 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:14.974447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284b059-b3d1-41f5-9101-b565b2f0b299 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:14.975300 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284b059-b3d1-41f5-9101-b565b2f0b299 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:14.975608 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284b059-b3d1-41f5-9101-b565b2f0b299 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:14.977052 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284b059-b3d1-41f5-9101-b565b2f0b299 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:15.002410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 474/962] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Jun 27 15:13:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:15.008337 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e7061-227e-4a33-9a96-a283d8a82f30 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:15.018110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec07695-802d-4cb6-8b37-15fee5b5cd4a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:15.018443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec07695-802d-4cb6-8b37-15fee5b5cd4a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:15.018705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec07695-802d-4cb6-8b37-15fee5b5cd4a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:15.020378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 475/963] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:13:15.025684 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6cd3-2d8a-4f88-8530-c407968a51ab None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:15.025981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6cd3-2d8a-4f88-8530-c407968a51ab None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:15.026296 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6cd3-2d8a-4f88-8530-c407968a51ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:15.053031 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-91ec6cd3-2d8a-4f88-8530-c407968a51ab None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:15.055341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-91ec6cd3-2d8a-4f88-8530-c407968a51ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:15.139991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 476/964] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:13:15.157210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e7061-227e-4a33-9a96-a283d8a82f30 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:15.172644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec6cd3-2d8a-4f88-8530-c407968a51ab None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:15.216615 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d77c6a-0ae8-491e-8596-f431a9801da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:15.217356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d77c6a-0ae8-491e-8596-f431a9801da8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:15.218055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d77c6a-0ae8-491e-8596-f431a9801da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:15.218612 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d77c6a-0ae8-491e-8596-f431a9801da8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:15.285526 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:15.313698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:15.315725 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d77c6a-0ae8-491e-8596-f431a9801da8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:15.318456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d77c6a-0ae8-491e-8596-f431a9801da8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:15.333587 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec6cd3-2d8a-4f88-8530-c407968a51ab None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:15.391800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46961a-e4ad-4d8e-970e-80e3aa1aeff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:15.392546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46961a-e4ad-4d8e-970e-80e3aa1aeff3 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:15.393211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46961a-e4ad-4d8e-970e-80e3aa1aeff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:15.393827 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46961a-e4ad-4d8e-970e-80e3aa1aeff3 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:15.395133 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46961a-e4ad-4d8e-970e-80e3aa1aeff3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:15.397284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46961a-e4ad-4d8e-970e-80e3aa1aeff3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:15.417383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.sql.core [None req-4b46961a-e4ad-4d8e-970e-80e3aa1aeff3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 27 15:13:15.417383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 27 15:13:15.417383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [parameters: {'user_id': '2c7e108a7057472fb2d31c538f30c77f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 27 15:13:15.417383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80193) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 27 15:13:15.430357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4b46961a-e4ad-4d8e-970e-80e3aa1aeff3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 27 15:13:15.430357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:15.430357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 15:13:15.430357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 15:13:15.430357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 15:13:15.430357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 15:13:15.430357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 15:13:15.430357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 15:13:15.430357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 15:13:15.430357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application conn.query(q) Jun 27 15:13:15.430357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 15:13:15.430357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 15:13:15.430357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 15:13:15.430357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result.read() Jun 27 15:13:15.430357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 15:13:15.431892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application next(self.gen) Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application yield resource Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application next(self.gen) Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.session.rollback() Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.force_reraise() Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise self.value Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application session.commit() Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 27 15:13:15.433722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._prepare_impl() Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.session.flush() Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._flush(objects) Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application compat.raise_( Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application flush_context.execute() Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rec.execute(self) Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 27 15:13:15.435293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 27 15:13:15.437404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 27 15:13:15.437404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 27 15:13:15.437404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 27 15:13:15.437404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 27 15:13:15.437404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 27 15:13:15.437404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 27 15:13:15.437404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 27 15:13:15.437404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 27 15:13:15.437404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 27 15:13:15.437404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 27 15:13:15.437404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 27 15:13:15.437404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 27 15:13:15.437404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 27 15:13:15.437404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 27 15:13:15.437404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 15:13:15.437404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception Jun 27 15:13:15.439431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 15:13:15.439431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 15:13:15.439431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 15:13:15.439431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 15:13:15.439431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 15:13:15.439431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 15:13:15.439431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 15:13:15.439431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application conn.query(q) Jun 27 15:13:15.439431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 15:13:15.439431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 15:13:15.439431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 15:13:15.439431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result.read() Jun 27 15:13:15.439431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 15:13:15.439431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 15:13:15.439431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 15:13:15.439431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 15:13:15.441186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 15:13:15.441186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 15:13:15.441186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 15:13:15.441186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 15:13:15.441186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 27 15:13:15.441186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 27 15:13:15.441186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [parameters: {'user_id': '2c7e108a7057472fb2d31c538f30c77f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 27 15:13:15.441186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 27 15:13:15.441186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:15.441186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:15.441186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:15.441186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:15.441186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:15.441186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:15.441186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 27 15:13:15.444160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 27 15:13:15.453460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 27 15:13:15.453460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 27 15:13:15.453460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 27 15:13:15.453460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 27 15:13:15.453460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 27 15:13:15.453460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:15.458102 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 477/965] 10.222.0.33 () {60 vars in 1131 bytes} [Mon Jun 27 15:13:15 2022] POST /identity/v3/users => generated 160 bytes in 281 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:15.458102 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46961a-e4ad-4d8e-970e-80e3aa1aeff3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:15.518554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 489/966] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:13:15 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:13:15.522888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d77c6a-0ae8-491e-8596-f431a9801da8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:15.662813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46961a-e4ad-4d8e-970e-80e3aa1aeff3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:15.683639 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:15.719197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d77c6a-0ae8-491e-8596-f431a9801da8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:15.736103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a0966-c42f-488e-811b-a0fc7ade2d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:15.737914 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a0966-c42f-488e-811b-a0fc7ade2d60 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:15.738693 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a0966-c42f-488e-811b-a0fc7ade2d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:15.739587 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a0966-c42f-488e-811b-a0fc7ade2d60 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:15.755625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a0966-c42f-488e-811b-a0fc7ade2d60 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:15.759266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a0966-c42f-488e-811b-a0fc7ade2d60 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:15.788588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9bd0bb-25f8-4947-9489-ce063c2e06e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:15.789631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e59a0966-c42f-488e-811b-a0fc7ade2d60 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 15:13:15.789631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:15.789631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:15.789631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:15.789631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:15.789631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:15.789631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:15.789631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:15.789631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:15.789631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:15.789631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:15.789631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:15.789631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:13:15.789631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:13:15.789631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:13:15.789631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:15.791447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:15.793571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:15.793571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:15.793571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:13:15.793571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:13:15.793571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:13:15.793571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:13:15.793571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:13:15.793571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:13:15.793571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 15:13:15.793571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:15.794727 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bd0bb-25f8-4947-9489-ce063c2e06e9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:15.794727 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bd0bb-25f8-4947-9489-ce063c2e06e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:15.794727 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bd0bb-25f8-4947-9489-ce063c2e06e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:15.806595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 478/967] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:13:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:15.806595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0739e5-fac8-4449-9ff9-9efa5418c2c5 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:15.806595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0739e5-fac8-4449-9ff9-9efa5418c2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:15.807407 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0739e5-fac8-4449-9ff9-9efa5418c2c5 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:15.811815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9bd0bb-25f8-4947-9489-ce063c2e06e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:15.813310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9bd0bb-25f8-4947-9489-ce063c2e06e9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:15.819135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 479/968] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:15 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:15.820414 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0739e5-fac8-4449-9ff9-9efa5418c2c5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:15.843079 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:15.849398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1d9bd0bb-25f8-4947-9489-ce063c2e06e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:15.849398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:15.849398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:15.849398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:15.849398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:15.849398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:15.849398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:15.849398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:15.849398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:15.849398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:15.849398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:15.849398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:15.849398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:13:15.849398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:13:15.849398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:15.851220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:15.860981 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:13:15.860981 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:13:15.860981 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:15.860981 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:15.860981 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 490/969] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:15.860981 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dba00-e9a0-4fa7-b5b5-eabe4bbc1068 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:15.860981 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dba00-e9a0-4fa7-b5b5-eabe4bbc1068 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:15.860981 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dba00-e9a0-4fa7-b5b5-eabe4bbc1068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:15.878782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a16dba00-e9a0-4fa7-b5b5-eabe4bbc1068 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:15.879902 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a16dba00-e9a0-4fa7-b5b5-eabe4bbc1068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:15.994256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 491/970] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:15.994256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dba00-e9a0-4fa7-b5b5-eabe4bbc1068 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:15.997588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0739e5-fac8-4449-9ff9-9efa5418c2c5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:16.048801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc4ef5-6a23-44d7-8b02-a10ccf4c71e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:16.049618 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc4ef5-6a23-44d7-8b02-a10ccf4c71e9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:16.050089 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc4ef5-6a23-44d7-8b02-a10ccf4c71e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:16.050568 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc4ef5-6a23-44d7-8b02-a10ccf4c71e9 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:16.051635 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc4ef5-6a23-44d7-8b02-a10ccf4c71e9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:16.052034 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc4ef5-6a23-44d7-8b02-a10ccf4c71e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:16.053970 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc4ef5-6a23-44d7-8b02-a10ccf4c71e9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:16.090695 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 480/971] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 27 15:13:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:16.091566 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc4ef5-6a23-44d7-8b02-a10ccf4c71e9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:16.103847 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:16.183442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dba00-e9a0-4fa7-b5b5-eabe4bbc1068 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:16.234128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:16.250071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe573d-41aa-419e-b40d-c731c272af89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:16.251335 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe573d-41aa-419e-b40d-c731c272af89 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:16.252177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe573d-41aa-419e-b40d-c731c272af89 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:16.252492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe573d-41aa-419e-b40d-c731c272af89 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:16.253933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe573d-41aa-419e-b40d-c731c272af89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:16.254611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe573d-41aa-419e-b40d-c731c272af89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:16.257312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe573d-41aa-419e-b40d-c731c272af89 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:16.278311 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 492/972] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:16.280874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fc8bb-107f-4179-a427-157478518bac None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:16.281378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fc8bb-107f-4179-a427-157478518bac None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:16.281863 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fc8bb-107f-4179-a427-157478518bac None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:16.282038 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc4ef5-6a23-44d7-8b02-a10ccf4c71e9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:16.284674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 493/973] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:16.288646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fc8bb-107f-4179-a427-157478518bac None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:16.344571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27bc22-372b-430b-b21c-78a12879568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:16.345960 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27bc22-372b-430b-b21c-78a12879568d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:16.350304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27bc22-372b-430b-b21c-78a12879568d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:16.350304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27bc22-372b-430b-b21c-78a12879568d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:16.350304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27bc22-372b-430b-b21c-78a12879568d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:16.350919 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27bc22-372b-430b-b21c-78a12879568d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-cd27bc22-372b-430b-b21c-78a12879568d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:16.370580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:16.372733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:16.372733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:16.372733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:16.372733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:16.372733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:16.372733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:16.372733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:13:16.372733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:13:16.372733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:13:16.372733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:13:16.372733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:16.372733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:16.372733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:16.372733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:16.372733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:16.372733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:16.375072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:16.375072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:16.375072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:16.375072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:16.375072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:16.375072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:16.375072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:16.375072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:16.375072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:16.375072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:16.375072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:13:16.375072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:16.375072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 15:13:16.375072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:16.375072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 481/974] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 27 15:13:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:16.377217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffbe18-bf53-405e-84f8-7dbccefe1f5e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:16.377217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffbe18-bf53-405e-84f8-7dbccefe1f5e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:16.377217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffbe18-bf53-405e-84f8-7dbccefe1f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:16.402603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-72ffbe18-bf53-405e-84f8-7dbccefe1f5e None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:16.404166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-72ffbe18-bf53-405e-84f8-7dbccefe1f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:16.458952 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fc8bb-107f-4179-a427-157478518bac None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:16.484593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:16.494261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 482/975] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:16.494261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffbe18-bf53-405e-84f8-7dbccefe1f5e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:16.510069 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad456c-443f-44b9-ac21-33a08a2c773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:16.511056 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad456c-443f-44b9-ac21-33a08a2c773c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:16.511475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad456c-443f-44b9-ac21-33a08a2c773c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:16.511945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad456c-443f-44b9-ac21-33a08a2c773c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:16.520590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad456c-443f-44b9-ac21-33a08a2c773c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:16.522256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad456c-443f-44b9-ac21-33a08a2c773c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:16.537604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-03ad456c-443f-44b9-ac21-33a08a2c773c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:13:16.537604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:16.537604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:16.537604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:16.537604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:16.537604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:16.537604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:16.537604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:16.537604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:16.537604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:16.537604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:16.537604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:16.537604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:13:16.537604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:13:16.537604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:16.544620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:16.545546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:13:16.545546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:13:16.545546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:13:16.545546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:13:16.545546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:13:16.545546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:13:16.545546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:13:16.545546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:16.545546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 494/976] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:13:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:16.545546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad456c-443f-44b9-ac21-33a08a2c773c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:16.590662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:16.639882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffbe18-bf53-405e-84f8-7dbccefe1f5e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:16.680127 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad456c-443f-44b9-ac21-33a08a2c773c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:16.684145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245125cd-d949-4cde-81e2-5cbf428bb992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:16.684939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245125cd-d949-4cde-81e2-5cbf428bb992 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:16.685304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245125cd-d949-4cde-81e2-5cbf428bb992 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:16.685766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245125cd-d949-4cde-81e2-5cbf428bb992 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:16.686687 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245125cd-d949-4cde-81e2-5cbf428bb992 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:16.687068 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245125cd-d949-4cde-81e2-5cbf428bb992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:16.688610 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245125cd-d949-4cde-81e2-5cbf428bb992 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:16.694727 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 483/977] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 27 15:13:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:16.696049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245125cd-d949-4cde-81e2-5cbf428bb992 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:16.722033 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40db1e-2b2f-49e0-8f70-dac507e67abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:16.722917 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40db1e-2b2f-49e0-8f70-dac507e67abb None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:16.723327 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40db1e-2b2f-49e0-8f70-dac507e67abb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:16.723714 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40db1e-2b2f-49e0-8f70-dac507e67abb None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:16.724844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40db1e-2b2f-49e0-8f70-dac507e67abb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:16.726623 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40db1e-2b2f-49e0-8f70-dac507e67abb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:16.744361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 495/978] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 27 15:13:16 2022] POST /identity/v3/services => generated 242 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:13:16.745461 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40db1e-2b2f-49e0-8f70-dac507e67abb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:16.816993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:16.860592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245125cd-d949-4cde-81e2-5cbf428bb992 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:16.912194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:16.935133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40db1e-2b2f-49e0-8f70-dac507e67abb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:16.935467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73624479-8816-49c0-8ba4-236d74e1ed96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:16.936593 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73624479-8816-49c0-8ba4-236d74e1ed96 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:16.938122 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73624479-8816-49c0-8ba4-236d74e1ed96 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:16.938580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73624479-8816-49c0-8ba4-236d74e1ed96 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:16.939968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73624479-8816-49c0-8ba4-236d74e1ed96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:16.940502 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73624479-8816-49c0-8ba4-236d74e1ed96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:16.943090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73624479-8816-49c0-8ba4-236d74e1ed96 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:16.967198 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 484/979] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:13:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:16.973996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73624479-8816-49c0-8ba4-236d74e1ed96 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:16.992729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90f129-85e7-4ba0-8d41-c33616a02ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:16.993555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90f129-85e7-4ba0-8d41-c33616a02ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:16.994023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90f129-85e7-4ba0-8d41-c33616a02ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:16.994505 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90f129-85e7-4ba0-8d41-c33616a02ed7 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:16.995308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90f129-85e7-4ba0-8d41-c33616a02ed7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:16.995744 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90f129-85e7-4ba0-8d41-c33616a02ed7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:16.997459 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90f129-85e7-4ba0-8d41-c33616a02ed7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:17.004089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 496/980] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 27 15:13:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:17.009953 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90f129-85e7-4ba0-8d41-c33616a02ed7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:17.151933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90f129-85e7-4ba0-8d41-c33616a02ed7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:17.155068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:17.168431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73624479-8816-49c0-8ba4-236d74e1ed96 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:17.213274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc3721-4a52-4faa-95e8-d803725cd122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:17.214070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc3721-4a52-4faa-95e8-d803725cd122 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:17.214470 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc3721-4a52-4faa-95e8-d803725cd122 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:17.214667 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b22bb-0b2c-424f-ae0b-bf86084a90d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:17.214931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc3721-4a52-4faa-95e8-d803725cd122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:17.215875 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc3721-4a52-4faa-95e8-d803725cd122 None admin] RBAC: Adding query filter params (role.id=340cdc0c7fc94ce1b6a527c006d0c86b, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=6f3dfc12a3ac499da540065c03bd2a82) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:17.216087 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b22bb-0b2c-424f-ae0b-bf86084a90d6 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:17.216365 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc3721-4a52-4faa-95e8-d803725cd122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:17.216795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b22bb-0b2c-424f-ae0b-bf86084a90d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:17.217384 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b22bb-0b2c-424f-ae0b-bf86084a90d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:17.218514 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc3721-4a52-4faa-95e8-d803725cd122 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:17.219066 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b22bb-0b2c-424f-ae0b-bf86084a90d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:17.222671 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b22bb-0b2c-424f-ae0b-bf86084a90d6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:17.226316 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 485/981] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:13:16 2022] GET /identity/v3/role_assignments?user.id=6f3dfc12a3ac499da540065c03bd2a82&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=340cdc0c7fc94ce1b6a527c006d0c86b => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:17.250577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 497/982] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 27 15:13:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:13:19.012264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead409ab-ccec-4581-bef0-0149c1c87fc4 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:19.012863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead409ab-ccec-4581-bef0-0149c1c87fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:19.012863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead409ab-ccec-4581-bef0-0149c1c87fc4 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:19.014577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 486/983] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:19.021175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abe1b4-ba1d-4f79-bcec-59035e8d9c0a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:19.021905 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abe1b4-ba1d-4f79-bcec-59035e8d9c0a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:19.021905 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abe1b4-ba1d-4f79-bcec-59035e8d9c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:19.040605 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a2abe1b4-ba1d-4f79-bcec-59035e8d9c0a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:19.042200 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a2abe1b4-ba1d-4f79-bcec-59035e8d9c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:19.170307 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 498/984] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:19.206246 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead409ab-ccec-4581-bef0-0149c1c87fc4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:19.306562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:19.418867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead409ab-ccec-4581-bef0-0149c1c87fc4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:19.477963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0c372-9083-4d48-9a90-405c80ffb0b7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:19.478308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0c372-9083-4d48-9a90-405c80ffb0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:19.478572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0c372-9083-4d48-9a90-405c80ffb0b7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:19.479966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 499/985] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:19.485754 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716004-cc93-4d05-a16e-d53e405b356f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:19.486147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716004-cc93-4d05-a16e-d53e405b356f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:19.486599 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716004-cc93-4d05-a16e-d53e405b356f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:19.487972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa853a07-9a5a-47a5-92cd-b031a985e345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:19.489299 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa853a07-9a5a-47a5-92cd-b031a985e345 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:19.489795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa853a07-9a5a-47a5-92cd-b031a985e345 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:19.490328 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa853a07-9a5a-47a5-92cd-b031a985e345 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:19.491540 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa853a07-9a5a-47a5-92cd-b031a985e345 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:19.495851 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa853a07-9a5a-47a5-92cd-b031a985e345 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:19.505459 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4b716004-cc93-4d05-a16e-d53e405b356f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:19.506731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4b716004-cc93-4d05-a16e-d53e405b356f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-aa853a07-9a5a-47a5-92cd-b031a985e345 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:19.521824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:19.523896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:19.523896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:19.523896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:19.523896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:19.523896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:19.523896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:19.523896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:13:19.523896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:13:19.523896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:13:19.523896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:13:19.523896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:19.523896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:19.523896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:19.523896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:19.523896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:19.523896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:19.525654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:19.525654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:19.525654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:19.525654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:19.525654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:19.525654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:19.525654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:19.525654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:19.525654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:19.525654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:19.525654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:13:19.525654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:19.525654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 15:13:19.525654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:19.525654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 487/986] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:13:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:19.530854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa853a07-9a5a-47a5-92cd-b031a985e345 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:19.625213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 500/987] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:13:19.662955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b716004-cc93-4d05-a16e-d53e405b356f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:19.688423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:19.714391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa853a07-9a5a-47a5-92cd-b031a985e345 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:19.738749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:19.774942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f41d19-6922-429b-8937-b9147c7b0953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:19.776012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f41d19-6922-429b-8937-b9147c7b0953 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:19.776460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f41d19-6922-429b-8937-b9147c7b0953 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:19.776917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f41d19-6922-429b-8937-b9147c7b0953 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:19.778140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f41d19-6922-429b-8937-b9147c7b0953 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:19.778601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f41d19-6922-429b-8937-b9147c7b0953 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:19.780895 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f41d19-6922-429b-8937-b9147c7b0953 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:19.789031 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 488/988] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 27 15:13:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:19.796712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f41d19-6922-429b-8937-b9147c7b0953 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:19.852618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b716004-cc93-4d05-a16e-d53e405b356f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:19.913658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c4ca1-4f96-4564-bc79-f8a8cd26e184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:19.914560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c4ca1-4f96-4564-bc79-f8a8cd26e184 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:19.914846 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c4ca1-4f96-4564-bc79-f8a8cd26e184 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:19.915170 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c4ca1-4f96-4564-bc79-f8a8cd26e184 None admin] PATH_INFO: `/v3/services/image` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:19.915985 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c4ca1-4f96-4564-bc79-f8a8cd26e184 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:19.918457 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c4ca1-4f96-4564-bc79-f8a8cd26e184 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7b9c4ca1-4f96-4564-bc79-f8a8cd26e184 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:19.936117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:19.938263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:19.938263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:19.938263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:19.938263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:19.938263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:19.938263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:19.938263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:13:19.938263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:13:19.938263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:13:19.938263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:13:19.938263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:19.938263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:19.938263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:19.938263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:19.938263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:19.938263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:19.940321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:19.940321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:19.940321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:19.940321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:19.940321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:19.940321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:19.940321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:19.940321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:19.940321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:19.940321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:19.940321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:13:19.940321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:19.940321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 15:13:19.940321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:19.940321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 501/989] 10.222.0.33 () {56 vars in 1105 bytes} [Mon Jun 27 15:13:19 2022] GET /identity/v3/services/image => generated 86 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:19.942068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ded21-17ca-4841-a501-4be1b8a4c487 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:19.942068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ded21-17ca-4841-a501-4be1b8a4c487 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:19.942068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ded21-17ca-4841-a501-4be1b8a4c487 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:19.942068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 502/990] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:19.946633 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ded21-17ca-4841-a501-4be1b8a4c487 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:19.973429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f41d19-6922-429b-8937-b9147c7b0953 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:20.019674 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6212cb-aefa-4b31-ba5a-ee8eacc3cb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:20.020440 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6212cb-aefa-4b31-ba5a-ee8eacc3cb52 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:20.020667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6212cb-aefa-4b31-ba5a-ee8eacc3cb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:20.020945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6212cb-aefa-4b31-ba5a-ee8eacc3cb52 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:20.021700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6212cb-aefa-4b31-ba5a-ee8eacc3cb52 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:20.022004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6212cb-aefa-4b31-ba5a-ee8eacc3cb52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:20.023469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6212cb-aefa-4b31-ba5a-ee8eacc3cb52 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:20.029696 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 489/991] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 27 15:13:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:20.031834 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f3d53-bd0a-4c6b-92a6-0d46de128fe3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:20.031834 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f3d53-bd0a-4c6b-92a6-0d46de128fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:20.032184 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f3d53-bd0a-4c6b-92a6-0d46de128fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:20.051719 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-254f3d53-bd0a-4c6b-92a6-0d46de128fe3 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:20.052931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-254f3d53-bd0a-4c6b-92a6-0d46de128fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:20.066320 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:20.100773 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ded21-17ca-4841-a501-4be1b8a4c487 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:20.104006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:20.147155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 490/992] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:20.148067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f3d53-bd0a-4c6b-92a6-0d46de128fe3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:20.162665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660b4d1-5517-47db-887c-ea6df982aedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:20.164277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660b4d1-5517-47db-887c-ea6df982aedd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:20.165028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660b4d1-5517-47db-887c-ea6df982aedd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:20.165743 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660b4d1-5517-47db-887c-ea6df982aedd None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:20.167178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660b4d1-5517-47db-887c-ea6df982aedd None admin] RBAC: Adding query filter params (name=image) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:20.167744 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660b4d1-5517-47db-887c-ea6df982aedd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:20.170401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660b4d1-5517-47db-887c-ea6df982aedd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:20.187126 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 503/993] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:20.188259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660b4d1-5517-47db-887c-ea6df982aedd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:20.284080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f3d53-bd0a-4c6b-92a6-0d46de128fe3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:20.335192 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660b4d1-5517-47db-887c-ea6df982aedd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:20.337990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874df58a-ff59-4fca-9c4c-a5e4c8f7b4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:20.339095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874df58a-ff59-4fca-9c4c-a5e4c8f7b4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:20.339545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874df58a-ff59-4fca-9c4c-a5e4c8f7b4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:20.339909 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874df58a-ff59-4fca-9c4c-a5e4c8f7b4d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:20.340819 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874df58a-ff59-4fca-9c4c-a5e4c8f7b4d9 None admin] RBAC: Adding query filter params (interface=public, service_id=ca0007aac9054110ad15bbb78d288a37, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:20.341174 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874df58a-ff59-4fca-9c4c-a5e4c8f7b4d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:20.343616 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874df58a-ff59-4fca-9c4c-a5e4c8f7b4d9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:20.350693 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 491/994] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Jun 27 15:13:20 2022] GET /identity/v3/endpoints?service_id=ca0007aac9054110ad15bbb78d288a37&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:20.352181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874df58a-ff59-4fca-9c4c-a5e4c8f7b4d9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:20.389444 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988b466-44cb-4e06-ab54-38f70d3738e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:20.390549 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988b466-44cb-4e06-ab54-38f70d3738e4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:20.390958 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988b466-44cb-4e06-ab54-38f70d3738e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:20.391357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988b466-44cb-4e06-ab54-38f70d3738e4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:20.392138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988b466-44cb-4e06-ab54-38f70d3738e4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:20.393728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988b466-44cb-4e06-ab54-38f70d3738e4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:20.400907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6988b466-44cb-4e06-ab54-38f70d3738e4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:20.409750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:20.411823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:20.411823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:20.411823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:20.411823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:20.411823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:20.411823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:20.411823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:13:20.411823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:13:20.411823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:13:20.411823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:13:20.411823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:20.411823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:20.411823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:20.411823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:20.411823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:20.411823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:20.412747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:20.412747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:20.412747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:20.412747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:20.412747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:20.412747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:20.412747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:20.412747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:20.412747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:20.412747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:20.412747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:13:20.412747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:20.412747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 15:13:20.412747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:20.412747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 504/995] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 27 15:13:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:20.413669 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988b466-44cb-4e06-ab54-38f70d3738e4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:20.426622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:20.498507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874df58a-ff59-4fca-9c4c-a5e4c8f7b4d9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:20.544665 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38ceb5-e505-4cf9-a156-7f000500165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:20.545473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38ceb5-e505-4cf9-a156-7f000500165f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:20.545991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38ceb5-e505-4cf9-a156-7f000500165f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:20.546532 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38ceb5-e505-4cf9-a156-7f000500165f None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:20.547749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38ceb5-e505-4cf9-a156-7f000500165f None admin] RBAC: Adding query filter params (type=image) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:20.548240 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38ceb5-e505-4cf9-a156-7f000500165f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:20.550661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38ceb5-e505-4cf9-a156-7f000500165f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:20.551079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988b466-44cb-4e06-ab54-38f70d3738e4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:20.570278 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 492/996] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:20.570278 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38ceb5-e505-4cf9-a156-7f000500165f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:20.621768 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8119055-ee5f-4665-874e-a8838de89511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:20.622994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8119055-ee5f-4665-874e-a8838de89511 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:20.624642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8119055-ee5f-4665-874e-a8838de89511 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:20.625256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8119055-ee5f-4665-874e-a8838de89511 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:20.626528 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8119055-ee5f-4665-874e-a8838de89511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:20.628864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8119055-ee5f-4665-874e-a8838de89511 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:20.650269 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 505/997] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 27 15:13:20 2022] GET /identity/v3/services => generated 1727 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:13:20.740165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:20.745400 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38ceb5-e505-4cf9-a156-7f000500165f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:20.808684 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda102f9-add8-4438-8fdf-315c1804331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:20.809767 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda102f9-add8-4438-8fdf-315c1804331d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:20.810268 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda102f9-add8-4438-8fdf-315c1804331d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:20.810723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda102f9-add8-4438-8fdf-315c1804331d None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:20.811976 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda102f9-add8-4438-8fdf-315c1804331d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:20.812475 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda102f9-add8-4438-8fdf-315c1804331d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:20.814866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda102f9-add8-4438-8fdf-315c1804331d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:20.824066 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 493/998] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 27 15:13:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:20.832760 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8119055-ee5f-4665-874e-a8838de89511 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:20.940104 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:21.004330 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8119055-ee5f-4665-874e-a8838de89511 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:21.067359 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c01a16-6cf2-491b-89e4-51ff5903641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:21.069710 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c01a16-6cf2-491b-89e4-51ff5903641f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:21.070563 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c01a16-6cf2-491b-89e4-51ff5903641f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:21.071377 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c01a16-6cf2-491b-89e4-51ff5903641f None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:21.072913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c01a16-6cf2-491b-89e4-51ff5903641f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:21.073780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c01a16-6cf2-491b-89e4-51ff5903641f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:21.076692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c01a16-6cf2-491b-89e4-51ff5903641f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:21.086735 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 506/999] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 27 15:13:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:21.098281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda102f9-add8-4438-8fdf-315c1804331d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:21.224104 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda102f9-add8-4438-8fdf-315c1804331d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:21.263694 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f314bc4-2262-4f97-9ea9-ccd2dce52425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:21.264557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f314bc4-2262-4f97-9ea9-ccd2dce52425 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:21.264975 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f314bc4-2262-4f97-9ea9-ccd2dce52425 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:21.265478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f314bc4-2262-4f97-9ea9-ccd2dce52425 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:21.266557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f314bc4-2262-4f97-9ea9-ccd2dce52425 None admin] RBAC: Adding query filter params (interface=admin, service_id=979c5e487e264d71906ff92784acd3c8, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:21.267014 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f314bc4-2262-4f97-9ea9-ccd2dce52425 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:21.268579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f314bc4-2262-4f97-9ea9-ccd2dce52425 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:21.279776 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 494/1000] 10.222.0.33 () {56 vars in 1249 bytes} [Mon Jun 27 15:13:21 2022] GET /identity/v3/endpoints?service_id=979c5e487e264d71906ff92784acd3c8&interface=admin®ion_id=RegionOne => generated 193 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:21.281835 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c01a16-6cf2-491b-89e4-51ff5903641f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:21.401838 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c01a16-6cf2-491b-89e4-51ff5903641f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:21.440787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b014af5-43eb-476f-a519-01fe61635246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:21.441666 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014af5-43eb-476f-a519-01fe61635246 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:21.442111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014af5-43eb-476f-a519-01fe61635246 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:21.442570 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014af5-43eb-476f-a519-01fe61635246 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:21.443432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b014af5-43eb-476f-a519-01fe61635246 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:21.444962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b014af5-43eb-476f-a519-01fe61635246 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:21.446447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:21.458471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 507/1001] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 27 15:13:21 2022] GET /identity/v3/services => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:13:22.733669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cf795-b229-47f8-bb17-67af21a41e87 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:22.734563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cf795-b229-47f8-bb17-67af21a41e87 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:22.734563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cf795-b229-47f8-bb17-67af21a41e87 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:22.736011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 495/1002] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:13:22.742089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97643662-059f-4212-9bc3-83c25f317d1e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:22.742788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97643662-059f-4212-9bc3-83c25f317d1e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:22.742788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97643662-059f-4212-9bc3-83c25f317d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:22.761117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-97643662-059f-4212-9bc3-83c25f317d1e None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:22.762338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-97643662-059f-4212-9bc3-83c25f317d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:22.842735 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 508/1003] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:22.867135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cf795-b229-47f8-bb17-67af21a41e87 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:22.929665 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:23.021929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cf795-b229-47f8-bb17-67af21a41e87 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:23.062967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584c9c-35f0-452c-bbfb-9fc32c967a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:23.063660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584c9c-35f0-452c-bbfb-9fc32c967a14 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:23.063953 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584c9c-35f0-452c-bbfb-9fc32c967a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:23.064216 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584c9c-35f0-452c-bbfb-9fc32c967a14 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:23.064974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc584c9c-35f0-452c-bbfb-9fc32c967a14 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:23.066438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc584c9c-35f0-452c-bbfb-9fc32c967a14 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:23.090273 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 496/1004] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 27 15:13:22 2022] POST /identity/v3/services => generated 242 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:13:23.581546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d72f6-f640-4922-a234-a7e49a0daa4a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:23.581826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d72f6-f640-4922-a234-a7e49a0daa4a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:23.582159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d72f6-f640-4922-a234-a7e49a0daa4a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:23.583768 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 509/1005] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:13:23.589476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f23d4-188f-4a18-94c6-5684a37b4024 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:23.589748 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f23d4-188f-4a18-94c6-5684a37b4024 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:23.590042 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f23d4-188f-4a18-94c6-5684a37b4024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:23.609498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f95f23d4-188f-4a18-94c6-5684a37b4024 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:23.610757 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f95f23d4-188f-4a18-94c6-5684a37b4024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:23.693061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 497/1006] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:23 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:23.716749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d72f6-f640-4922-a234-a7e49a0daa4a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:23.839632 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d72f6-f640-4922-a234-a7e49a0daa4a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:23.875391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:23.885874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78fc63-f9e9-42e7-b328-8747555fd439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:23.886733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78fc63-f9e9-42e7-b328-8747555fd439 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:23.887020 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78fc63-f9e9-42e7-b328-8747555fd439 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:23.887363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78fc63-f9e9-42e7-b328-8747555fd439 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:23.888294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78fc63-f9e9-42e7-b328-8747555fd439 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:23.889974 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78fc63-f9e9-42e7-b328-8747555fd439 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-df78fc63-f9e9-42e7-b328-8747555fd439 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:23.906029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:23.907381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:23.907381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:23.907381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:23.907381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:23.907381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:23.907381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:23.907381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:13:23.907381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:13:23.907381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:13:23.907381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:13:23.907381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:23.907381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:23.907381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:23.907381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:23.907381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:23.907381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:23.908316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:23.908316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:23.908316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:23.908316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:23.908316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:23.908316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:23.908316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:23.908316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:23.908316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:23.908316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:23.908316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:13:23.908316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:23.908316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 15:13:23.908316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:23.910300 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 510/1007] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 27 15:13:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:23.912385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886befe5-3e9e-4ddb-87c3-8cbbd7327440 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:23.912892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886befe5-3e9e-4ddb-87c3-8cbbd7327440 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:23.913099 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886befe5-3e9e-4ddb-87c3-8cbbd7327440 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:23.913209 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78fc63-f9e9-42e7-b328-8747555fd439 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:23.918601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 498/1008] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:23.921501 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796590e-2b09-4d97-825d-66c554a84832 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:23.921791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796590e-2b09-4d97-825d-66c554a84832 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:23.922074 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796590e-2b09-4d97-825d-66c554a84832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:23.940339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5796590e-2b09-4d97-825d-66c554a84832 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:23.941559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5796590e-2b09-4d97-825d-66c554a84832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:23.957120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:24.028270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 499/1009] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:23 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:13:24.043698 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78fc63-f9e9-42e7-b328-8747555fd439 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:24.051123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796590e-2b09-4d97-825d-66c554a84832 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:24.087336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ef7f5-8191-458a-a80f-a1a829fbbdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:24.087990 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ef7f5-8191-458a-a80f-a1a829fbbdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:24.088277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ef7f5-8191-458a-a80f-a1a829fbbdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:24.088553 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ef7f5-8191-458a-a80f-a1a829fbbdb7 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:24.089270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ef7f5-8191-458a-a80f-a1a829fbbdb7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:24.089579 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ef7f5-8191-458a-a80f-a1a829fbbdb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:24.091061 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ef7f5-8191-458a-a80f-a1a829fbbdb7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:24.099760 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 511/1010] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 27 15:13:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:24.106286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ef7f5-8191-458a-a80f-a1a829fbbdb7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:24.175110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:24.200489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796590e-2b09-4d97-825d-66c554a84832 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:24.230314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ef7f5-8191-458a-a80f-a1a829fbbdb7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:24.244344 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0a048-9170-4d3d-a7b5-1a9c8fafffc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:24.245170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0a048-9170-4d3d-a7b5-1a9c8fafffc5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:24.245454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0a048-9170-4d3d-a7b5-1a9c8fafffc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:24.245754 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0a048-9170-4d3d-a7b5-1a9c8fafffc5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:24.246461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0a048-9170-4d3d-a7b5-1a9c8fafffc5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:24.247990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0a048-9170-4d3d-a7b5-1a9c8fafffc5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a7e0a048-9170-4d3d-a7b5-1a9c8fafffc5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:24.260848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:24.262885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:24.262885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:24.262885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:24.262885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:24.262885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:24.262885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:24.262885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:13:24.262885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:13:24.262885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:13:24.262885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:13:24.262885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:24.262885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:24.262885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:24.262885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:24.262885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:24.262885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:24.264058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:24.264058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:24.264058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:24.264058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:24.264058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:24.264058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:24.264058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:24.264058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:24.264058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:24.264058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:24.264058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:13:24.264058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:24.264058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 15:13:24.264058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:24.264058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 500/1011] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:13:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:24.272030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0a048-9170-4d3d-a7b5-1a9c8fafffc5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:24.285452 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:24.287397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12806135-9ce5-4467-a96d-1a44d4777ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:24.289165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12806135-9ce5-4467-a96d-1a44d4777ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:24.289750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12806135-9ce5-4467-a96d-1a44d4777ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:24.290321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12806135-9ce5-4467-a96d-1a44d4777ce9 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:24.291628 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12806135-9ce5-4467-a96d-1a44d4777ce9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:24.292195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12806135-9ce5-4467-a96d-1a44d4777ce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:24.294557 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12806135-9ce5-4467-a96d-1a44d4777ce9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:24.305296 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 512/1012] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 27 15:13:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:24.314864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12806135-9ce5-4467-a96d-1a44d4777ce9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:24.403846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0a048-9170-4d3d-a7b5-1a9c8fafffc5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:24.445631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0eb86-9267-4a3b-b555-8fdffebc5c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:24.446603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0eb86-9267-4a3b-b555-8fdffebc5c12 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:24.446892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0eb86-9267-4a3b-b555-8fdffebc5c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:24.447171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0eb86-9267-4a3b-b555-8fdffebc5c12 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:24.447890 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0eb86-9267-4a3b-b555-8fdffebc5c12 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:24.448196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0eb86-9267-4a3b-b555-8fdffebc5c12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:24.449585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0eb86-9267-4a3b-b555-8fdffebc5c12 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:24.464325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12806135-9ce5-4467-a96d-1a44d4777ce9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:24.466405 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 501/1013] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 27 15:13:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:24.468446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0eb86-9267-4a3b-b555-8fdffebc5c12 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:24.489368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:24.509299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1098bc-6284-47a6-91af-b544d5a8ba56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:24.510137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1098bc-6284-47a6-91af-b544d5a8ba56 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:24.510547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1098bc-6284-47a6-91af-b544d5a8ba56 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:24.510918 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1098bc-6284-47a6-91af-b544d5a8ba56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:24.511874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1098bc-6284-47a6-91af-b544d5a8ba56 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:24.513775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1098bc-6284-47a6-91af-b544d5a8ba56 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:24.538452 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 513/1014] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 27 15:13:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:13:24.568944 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:24.606729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0eb86-9267-4a3b-b555-8fdffebc5c12 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:24.658520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2886ac-2e55-4018-bc71-38c83e5bac43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:24.659859 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2886ac-2e55-4018-bc71-38c83e5bac43 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:24.660275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2886ac-2e55-4018-bc71-38c83e5bac43 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:24.660676 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2886ac-2e55-4018-bc71-38c83e5bac43 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:24.661601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2886ac-2e55-4018-bc71-38c83e5bac43 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:24.663499 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2886ac-2e55-4018-bc71-38c83e5bac43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:24.664368 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2886ac-2e55-4018-bc71-38c83e5bac43 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:24.671352 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 502/1015] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 27 15:13:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:24.677625 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1098bc-6284-47a6-91af-b544d5a8ba56 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:24.807605 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1098bc-6284-47a6-91af-b544d5a8ba56 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:24.860398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec524546-df59-4525-9270-2a3e7a80a202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:24.862050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec524546-df59-4525-9270-2a3e7a80a202 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:24.862801 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec524546-df59-4525-9270-2a3e7a80a202 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:24.863548 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec524546-df59-4525-9270-2a3e7a80a202 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:24.865240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec524546-df59-4525-9270-2a3e7a80a202 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:24.868189 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec524546-df59-4525-9270-2a3e7a80a202 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:24.901437 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 514/1016] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 27 15:13:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:13:25.302356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88134887-de95-4450-a7d3-48adb6275e08 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:25.303570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88134887-de95-4450-a7d3-48adb6275e08 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:25.303570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88134887-de95-4450-a7d3-48adb6275e08 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:25.304923 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 503/1017] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:25.310663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f129a-7832-4763-98bc-a2949bf49063 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:25.311041 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f129a-7832-4763-98bc-a2949bf49063 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:25.311400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f129a-7832-4763-98bc-a2949bf49063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:25.331912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9e7f129a-7832-4763-98bc-a2949bf49063 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:25.333132 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9e7f129a-7832-4763-98bc-a2949bf49063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:25.368571 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:25.455825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 515/1018] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:25.495739 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88134887-de95-4450-a7d3-48adb6275e08 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:25.698931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88134887-de95-4450-a7d3-48adb6275e08 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:25.736854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:25.744303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de0740-ea7c-4bbd-a003-b0b9dc67d9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:25.745332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de0740-ea7c-4bbd-a003-b0b9dc67d9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:25.745821 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de0740-ea7c-4bbd-a003-b0b9dc67d9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:25.746298 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de0740-ea7c-4bbd-a003-b0b9dc67d9f5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:25.747150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de0740-ea7c-4bbd-a003-b0b9dc67d9f5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:25.748943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de0740-ea7c-4bbd-a003-b0b9dc67d9f5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-47de0740-ea7c-4bbd-a003-b0b9dc67d9f5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:25.762641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:25.771522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:25.771522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:25.771522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:25.771522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:25.771522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:25.771522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:25.771522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:13:25.771522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:13:25.771522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:13:25.771522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:13:25.771522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:25.771522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:25.771522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:25.771522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:25.771522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:25.771522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:25.772473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:25.772473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:25.772473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:25.772473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:25.772473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:25.772473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:25.772473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:25.772473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:25.772473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:25.772473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:25.772473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:13:25.772473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:25.772473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 15:13:25.772473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:25.772473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 504/1019] 10.222.0.33 () {56 vars in 1105 bytes} [Mon Jun 27 15:13:25 2022] GET /identity/v3/services/image => generated 86 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:25.776020 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f129a-7832-4763-98bc-a2949bf49063 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:25.927497 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f129a-7832-4763-98bc-a2949bf49063 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:25.969494 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093a0e8-2fa6-48ca-a83a-978e9796782e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:25.970257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093a0e8-2fa6-48ca-a83a-978e9796782e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:25.970549 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093a0e8-2fa6-48ca-a83a-978e9796782e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:25.970954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093a0e8-2fa6-48ca-a83a-978e9796782e None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:25.972350 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093a0e8-2fa6-48ca-a83a-978e9796782e None admin] RBAC: Adding query filter params (name=image) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:25.972658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093a0e8-2fa6-48ca-a83a-978e9796782e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:25.974688 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093a0e8-2fa6-48ca-a83a-978e9796782e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:25.986278 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 516/1020] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:25.989142 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de0740-ea7c-4bbd-a003-b0b9dc67d9f5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:26.146597 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de0740-ea7c-4bbd-a003-b0b9dc67d9f5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:26.190861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9d958-7cff-48ca-ae13-cb188e577b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:26.192155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9d958-7cff-48ca-ae13-cb188e577b68 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:26.192878 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9d958-7cff-48ca-ae13-cb188e577b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:26.193461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9d958-7cff-48ca-ae13-cb188e577b68 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:26.194670 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9d958-7cff-48ca-ae13-cb188e577b68 None admin] RBAC: Adding query filter params (type=image) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:26.195458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9d958-7cff-48ca-ae13-cb188e577b68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:26.197582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9d958-7cff-48ca-ae13-cb188e577b68 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:26.205403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 505/1021] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:26.217185 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093a0e8-2fa6-48ca-a83a-978e9796782e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:26.260166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:26.392602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093a0e8-2fa6-48ca-a83a-978e9796782e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:26.452706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb3247-d8b3-4ca4-9974-542d27464864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:26.453751 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb3247-d8b3-4ca4-9974-542d27464864 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:26.454176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb3247-d8b3-4ca4-9974-542d27464864 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:26.454694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb3247-d8b3-4ca4-9974-542d27464864 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:26.456250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb3247-d8b3-4ca4-9974-542d27464864 None admin] RBAC: Adding query filter params (interface=public, service_id=c3b1d17cea3c4b1fb631983fcf8b1c85, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:26.456813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb3247-d8b3-4ca4-9974-542d27464864 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:26.459512 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb3247-d8b3-4ca4-9974-542d27464864 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:26.475217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 517/1022] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Jun 27 15:13:26 2022] GET /identity/v3/endpoints?service_id=c3b1d17cea3c4b1fb631983fcf8b1c85&interface=public®ion_id=RegionOne => generated 194 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:26.477029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9d958-7cff-48ca-ae13-cb188e577b68 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:26.573840 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:26.655767 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9d958-7cff-48ca-ae13-cb188e577b68 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:26.695881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b520e-fa7c-45be-8d44-54c33cca1465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:26.696607 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b520e-fa7c-45be-8d44-54c33cca1465 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:26.696932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b520e-fa7c-45be-8d44-54c33cca1465 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:26.697247 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b520e-fa7c-45be-8d44-54c33cca1465 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:26.697976 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b520e-fa7c-45be-8d44-54c33cca1465 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:26.699422 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b520e-fa7c-45be-8d44-54c33cca1465 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:26.714357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 506/1023] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 27 15:13:26 2022] GET /identity/v3/services => generated 1957 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:13:26.738285 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee8afb-1e6c-417f-b82b-060b5df02681 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:26.738285 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee8afb-1e6c-417f-b82b-060b5df02681 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:26.738285 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee8afb-1e6c-417f-b82b-060b5df02681 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:26.738285 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 518/1024] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:26.747186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027b983-1a78-4afb-a4ab-f87798477ff3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:26.747511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027b983-1a78-4afb-a4ab-f87798477ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:26.747877 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027b983-1a78-4afb-a4ab-f87798477ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:26.775205 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7027b983-1a78-4afb-a4ab-f87798477ff3 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:26.776825 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7027b983-1a78-4afb-a4ab-f87798477ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:26.888353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 507/1025] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:13:26.912952 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee8afb-1e6c-417f-b82b-060b5df02681 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:27.024820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:27.040126 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee8afb-1e6c-417f-b82b-060b5df02681 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:27.104186 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e28929-9691-449f-ac7d-ae908f667466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:27.114574 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e28929-9691-449f-ac7d-ae908f667466 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:27.115270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e28929-9691-449f-ac7d-ae908f667466 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:27.115773 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e28929-9691-449f-ac7d-ae908f667466 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:27.118208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e28929-9691-449f-ac7d-ae908f667466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:27.120966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e28929-9691-449f-ac7d-ae908f667466 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:27.128903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 519/1026] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:27.133472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027b983-1a78-4afb-a4ab-f87798477ff3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:27.251436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:27.277547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347729e6-f4cb-4631-9166-73094b2632a4 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:27.277871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347729e6-f4cb-4631-9166-73094b2632a4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:27.278137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347729e6-f4cb-4631-9166-73094b2632a4 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:27.279585 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 520/1027] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:13:27.285844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ade16-47d6-4cf4-9f90-3ca10cd7724f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:27.286151 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ade16-47d6-4cf4-9f90-3ca10cd7724f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:27.286558 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ade16-47d6-4cf4-9f90-3ca10cd7724f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:27.307992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b28ade16-47d6-4cf4-9f90-3ca10cd7724f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:27.309243 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b28ade16-47d6-4cf4-9f90-3ca10cd7724f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:27.330728 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027b983-1a78-4afb-a4ab-f87798477ff3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:27.378858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c30916-2ec1-4646-bd38-0afed4ada1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:27.379849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30916-2ec1-4646-bd38-0afed4ada1e4 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:27.380349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30916-2ec1-4646-bd38-0afed4ada1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:27.380849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30916-2ec1-4646-bd38-0afed4ada1e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:27.381771 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c30916-2ec1-4646-bd38-0afed4ada1e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:27.383378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c30916-2ec1-4646-bd38-0afed4ada1e4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:27.404192 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 521/1028] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:13:27.417561 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 508/1029] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 27 15:13:27 2022] POST /identity/v3/projects => generated 311 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:13:27.431903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ade16-47d6-4cf4-9f90-3ca10cd7724f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:27.546035 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:27.565339 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ade16-47d6-4cf4-9f90-3ca10cd7724f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:27.611433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761559c0-0264-44e7-b82f-7503586b0c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:27.612589 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761559c0-0264-44e7-b82f-7503586b0c31 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:27.613115 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761559c0-0264-44e7-b82f-7503586b0c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:27.613523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761559c0-0264-44e7-b82f-7503586b0c31 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:27.628544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761559c0-0264-44e7-b82f-7503586b0c31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:13:27.636800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-761559c0-0264-44e7-b82f-7503586b0c31 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 15:13:27.636800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:27.636800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:27.636800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:27.636800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:27.636800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:27.636800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:27.636800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:27.636800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:27.636800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:27.636800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:27.636800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:27.636800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:13:27.636800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:13:27.636800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:13:27.636800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:13:27.638485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:13:27.638485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:13:27.638485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:13:27.638485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:13:27.638485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:27.638485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:27.638485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:27.638485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:27.638485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:27.638485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:27.638485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:27.638485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:27.638485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:27.638485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:27.638485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:27.638485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:27.640073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:27.640073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:27.640073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:27.640073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:27.640073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:13:27.640073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:13:27.640073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:13:27.640073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:13:27.640073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:13:27.640073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:13:27.640073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 15:13:27.640073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:27.640073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 522/1030] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Jun 27 15:13:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:27.647510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c30916-2ec1-4646-bd38-0afed4ada1e4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:27.776726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c30916-2ec1-4646-bd38-0afed4ada1e4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:27.785970 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:27.824039 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5a0df-84dd-40fc-99a4-3889f9c8d8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:27.824660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5a0df-84dd-40fc-99a4-3889f9c8d8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:27.824979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5a0df-84dd-40fc-99a4-3889f9c8d8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:27.825283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5a0df-84dd-40fc-99a4-3889f9c8d8c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:27.826116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5a0df-84dd-40fc-99a4-3889f9c8d8c0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:27.826477 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5a0df-84dd-40fc-99a4-3889f9c8d8c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:27.828372 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5a0df-84dd-40fc-99a4-3889f9c8d8c0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:27.845730 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 509/1031] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Jun 27 15:13:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:27.849217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761559c0-0264-44e7-b82f-7503586b0c31 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:28.006773 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761559c0-0264-44e7-b82f-7503586b0c31 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:28.061092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e747e-c6a3-42d4-8954-5b1ba5b23586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:28.063106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e747e-c6a3-42d4-8954-5b1ba5b23586 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:28.063106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e747e-c6a3-42d4-8954-5b1ba5b23586 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:28.063106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e747e-c6a3-42d4-8954-5b1ba5b23586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:28.076270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e747e-c6a3-42d4-8954-5b1ba5b23586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:28.077743 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e747e-c6a3-42d4-8954-5b1ba5b23586 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:28.089044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:28.100442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-566e747e-c6a3-42d4-8954-5b1ba5b23586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:28.100442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:28.100442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:28.100442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:28.100442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:28.100442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:28.100442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:28.100442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:28.100442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:28.100442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:28.100442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:28.100442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:28.100442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:13:28.100442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:13:28.100442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:28.102544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:28.104594 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:13:28.104594 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:13:28.104594 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:28.104594 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:28.114436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 523/1032] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:13:28.115183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5a0df-84dd-40fc-99a4-3889f9c8d8c0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:28.308882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5a0df-84dd-40fc-99a4-3889f9c8d8c0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:28.373143 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e03be-9edd-49b2-b72c-5172fc18e10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:28.375006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e03be-9edd-49b2-b72c-5172fc18e10b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:28.375855 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e03be-9edd-49b2-b72c-5172fc18e10b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:28.376652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e03be-9edd-49b2-b72c-5172fc18e10b None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:28.378475 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e03be-9edd-49b2-b72c-5172fc18e10b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:28.379437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e03be-9edd-49b2-b72c-5172fc18e10b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:28.382857 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e03be-9edd-49b2-b72c-5172fc18e10b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:28.407183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 510/1033] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:28.416257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e747e-c6a3-42d4-8954-5b1ba5b23586 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:28.604182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e747e-c6a3-42d4-8954-5b1ba5b23586 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:28.643084 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a44b4-4d40-4263-bf1d-ffd8f85a30a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:28.643810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a44b4-4d40-4263-bf1d-ffd8f85a30a3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:28.644096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a44b4-4d40-4263-bf1d-ffd8f85a30a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:28.644377 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a44b4-4d40-4263-bf1d-ffd8f85a30a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:28.653578 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a44b4-4d40-4263-bf1d-ffd8f85a30a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:28.655176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a44b4-4d40-4263-bf1d-ffd8f85a30a3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:28.671608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-100a44b4-4d40-4263-bf1d-ffd8f85a30a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:13:28.671608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:28.671608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:28.671608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:28.671608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:28.671608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:28.671608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:28.671608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:28.671608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:28.671608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:28.671608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:28.671608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:28.671608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:13:28.671608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:13:28.671608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:13:28.671608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:28.673492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:28.676089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:28.676089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:28.676089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:13:28.676089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:13:28.676089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:13:28.676089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:13:28.676089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:13:28.676089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:13:28.676089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:13:28.676089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:28.678533 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 524/1034] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 27 15:13:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:28.679626 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e03be-9edd-49b2-b72c-5172fc18e10b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:28.713067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:28.852979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e03be-9edd-49b2-b72c-5172fc18e10b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:28.917993 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d0e06-a0fb-4058-a007-49244e01053e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:28.919132 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d0e06-a0fb-4058-a007-49244e01053e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:28.919633 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d0e06-a0fb-4058-a007-49244e01053e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:28.920129 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d0e06-a0fb-4058-a007-49244e01053e None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:28.921911 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d0e06-a0fb-4058-a007-49244e01053e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:28.922481 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d0e06-a0fb-4058-a007-49244e01053e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:28.925274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d0e06-a0fb-4058-a007-49244e01053e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:28.962094 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 511/1035] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 27 15:13:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:28.972059 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a44b4-4d40-4263-bf1d-ffd8f85a30a3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:29.084809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:29.103098 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab2b38-2214-4032-8dd2-b38614fbb860 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:29.103771 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab2b38-2214-4032-8dd2-b38614fbb860 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:29.104331 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab2b38-2214-4032-8dd2-b38614fbb860 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:29.107212 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 512/1036] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:29.116269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2a6b1-3bde-4f0a-9c92-c04612c33514 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:29.116768 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2a6b1-3bde-4f0a-9c92-c04612c33514 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:29.117269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2a6b1-3bde-4f0a-9c92-c04612c33514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:29.147972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-93d2a6b1-3bde-4f0a-9c92-c04612c33514 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:29.150142 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-93d2a6b1-3bde-4f0a-9c92-c04612c33514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:29.168474 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a44b4-4d40-4263-bf1d-ffd8f85a30a3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:29.238896 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8aebba-a3ea-4f82-a5a2-160d91db999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:29.240254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8aebba-a3ea-4f82-a5a2-160d91db999e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:29.240774 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8aebba-a3ea-4f82-a5a2-160d91db999e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:29.241821 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8aebba-a3ea-4f82-a5a2-160d91db999e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:29.279964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 513/1037] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:29.304871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2a6b1-3bde-4f0a-9c92-c04612c33514 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:29.341845 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:29.359414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8aebba-a3ea-4f82-a5a2-160d91db999e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:29.360917 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8aebba-a3ea-4f82-a5a2-160d91db999e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:29.468047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2a6b1-3bde-4f0a-9c92-c04612c33514 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:29.471788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:29.512615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba08b83-79b5-47e2-b72f-7e7d11e07c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:29.513726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba08b83-79b5-47e2-b72f-7e7d11e07c71 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:29.514310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba08b83-79b5-47e2-b72f-7e7d11e07c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:29.514980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba08b83-79b5-47e2-b72f-7e7d11e07c71 None admin] PATH_INFO: `/v3/services/image` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:29.515996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba08b83-79b5-47e2-b72f-7e7d11e07c71 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:29.517648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba08b83-79b5-47e2-b72f-7e7d11e07c71 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-0ba08b83-79b5-47e2-b72f-7e7d11e07c71 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:29.531037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:29.532223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:29.532223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:29.532223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:29.532223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:29.532223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:29.532223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:29.532223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:13:29.532223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:13:29.532223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:13:29.532223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:13:29.532223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:29.532223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:29.532223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:29.532223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:29.532223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:29.532223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:29.533058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:29.533058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:29.533058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:29.533058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:29.533058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:29.533058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:29.533058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:29.533058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:29.533058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:29.533058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:29.533058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:13:29.533058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:13:29.533058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 15:13:29.533058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:29.534796 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 514/1038] 10.222.0.33 () {56 vars in 1105 bytes} [Mon Jun 27 15:13:29 2022] GET /identity/v3/services/image => generated 86 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:29.541448 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba08b83-79b5-47e2-b72f-7e7d11e07c71 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:29.554097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 525/1039] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:13:28 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:13:29.560316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8aebba-a3ea-4f82-a5a2-160d91db999e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:29.682918 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:29.710808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8aebba-a3ea-4f82-a5a2-160d91db999e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:29.721552 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba08b83-79b5-47e2-b72f-7e7d11e07c71 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:29.775413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dbd51-47ae-45c9-9918-ebe3f958984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:29.775708 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d51109-d820-418d-9a4b-bc289abe97b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:29.776437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dbd51-47ae-45c9-9918-ebe3f958984e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:29.776808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d51109-d820-418d-9a4b-bc289abe97b3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:29.776962 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dbd51-47ae-45c9-9918-ebe3f958984e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:29.777260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dbd51-47ae-45c9-9918-ebe3f958984e None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:29.777410 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d51109-d820-418d-9a4b-bc289abe97b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:29.777684 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d51109-d820-418d-9a4b-bc289abe97b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:29.778485 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dbd51-47ae-45c9-9918-ebe3f958984e None admin] RBAC: Adding query filter params (name=image) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:29.779006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dbd51-47ae-45c9-9918-ebe3f958984e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:29.782398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dbd51-47ae-45c9-9918-ebe3f958984e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:29.790703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 515/1040] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:29.798273 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dbd51-47ae-45c9-9918-ebe3f958984e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:29.799079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d51109-d820-418d-9a4b-bc289abe97b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:29.802746 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d51109-d820-418d-9a4b-bc289abe97b3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:29.841454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-13d51109-d820-418d-9a4b-bc289abe97b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:29.841454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:29.841454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:29.841454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:29.841454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:29.841454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:29.841454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:29.841454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:29.841454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:29.841454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:29.841454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:29.841454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:29.841454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:13:29.841454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:13:29.841454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:29.843357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:29.845141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:13:29.845141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:13:29.845141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:29.845141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:29.845141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 526/1041] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:13:29.852823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d51109-d820-418d-9a4b-bc289abe97b3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:29.880274 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:29.974718 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dbd51-47ae-45c9-9918-ebe3f958984e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:30.038835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169215df-e485-4dc4-bc23-ca0109adbcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:30.040071 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169215df-e485-4dc4-bc23-ca0109adbcc4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:30.040622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169215df-e485-4dc4-bc23-ca0109adbcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:30.041107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169215df-e485-4dc4-bc23-ca0109adbcc4 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:30.042462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169215df-e485-4dc4-bc23-ca0109adbcc4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:30.043007 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169215df-e485-4dc4-bc23-ca0109adbcc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:30.045661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169215df-e485-4dc4-bc23-ca0109adbcc4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:30.047091 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d51109-d820-418d-9a4b-bc289abe97b3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:30.060608 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 516/1042] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:30.062590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169215df-e485-4dc4-bc23-ca0109adbcc4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:30.080205 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:30.114254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292dc77c-87d1-46cb-9a06-ce61c01971a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:30.115439 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dc77c-87d1-46cb-9a06-ce61c01971a0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:30.115920 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dc77c-87d1-46cb-9a06-ce61c01971a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:30.116392 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dc77c-87d1-46cb-9a06-ce61c01971a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:30.117767 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292dc77c-87d1-46cb-9a06-ce61c01971a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:30.118296 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292dc77c-87d1-46cb-9a06-ce61c01971a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:30.120528 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292dc77c-87d1-46cb-9a06-ce61c01971a0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:30.141793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 527/1043] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:30.148142 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292dc77c-87d1-46cb-9a06-ce61c01971a0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:30.244542 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:30.253272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169215df-e485-4dc4-bc23-ca0109adbcc4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:30.278566 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292dc77c-87d1-46cb-9a06-ce61c01971a0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:30.294029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20e727-7d0b-4673-9e89-ea12f6076ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:30.295122 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20e727-7d0b-4673-9e89-ea12f6076ecb None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:30.295592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20e727-7d0b-4673-9e89-ea12f6076ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:30.296005 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20e727-7d0b-4673-9e89-ea12f6076ecb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:30.296991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20e727-7d0b-4673-9e89-ea12f6076ecb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:30.298615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20e727-7d0b-4673-9e89-ea12f6076ecb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:30.319461 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11dc793-f403-43e0-925d-273ad026befb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:30.320287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11dc793-f403-43e0-925d-273ad026befb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:30.320581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11dc793-f403-43e0-925d-273ad026befb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:30.320858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11dc793-f403-43e0-925d-273ad026befb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:30.327524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 517/1044] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 27 15:13:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:13:30.329633 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ede94-d93e-4a07-85dd-9e9cc7af7b24 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:30.330144 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ede94-d93e-4a07-85dd-9e9cc7af7b24 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:30.330683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ede94-d93e-4a07-85dd-9e9cc7af7b24 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:30.332420 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11dc793-f403-43e0-925d-273ad026befb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:30.334279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 518/1045] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:30.334484 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11dc793-f403-43e0-925d-273ad026befb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:30.340220 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43946af0-78bc-462a-991c-817214abd2cd None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:30.341058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43946af0-78bc-462a-991c-817214abd2cd None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:30.341512 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43946af0-78bc-462a-991c-817214abd2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:30.360107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d11dc793-f403-43e0-925d-273ad026befb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:13:30.360107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:30.360107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:30.360107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:30.360107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:30.360107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:30.360107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:30.360107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:30.360107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:30.360107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:30.360107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:30.360107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:30.360107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:13:30.360107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:13:30.360107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:30.361872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:30.363622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:13:30.363622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:13:30.363622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:13:30.363622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:13:30.363622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:13:30.363622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:13:30.363622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:13:30.363622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:30.363622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 528/1046] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:13:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:13:30.369620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11dc793-f403-43e0-925d-273ad026befb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:30.373116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-43946af0-78bc-462a-991c-817214abd2cd None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:30.375614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-43946af0-78bc-462a-991c-817214abd2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:30.480555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:30.506572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 519/1047] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:30.547977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43946af0-78bc-462a-991c-817214abd2cd None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:30.567946 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11dc793-f403-43e0-925d-273ad026befb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:30.612691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:30.619333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518c898-1718-481d-af30-4bbcd59d3a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:30.620402 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518c898-1718-481d-af30-4bbcd59d3a4c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:30.620691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518c898-1718-481d-af30-4bbcd59d3a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:30.620978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518c898-1718-481d-af30-4bbcd59d3a4c None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:30.621803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518c898-1718-481d-af30-4bbcd59d3a4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:30.622114 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518c898-1718-481d-af30-4bbcd59d3a4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:30.624823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518c898-1718-481d-af30-4bbcd59d3a4c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:30.642274 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 529/1048] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:13:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:30.649608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518c898-1718-481d-af30-4bbcd59d3a4c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:30.714128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43946af0-78bc-462a-991c-817214abd2cd None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:30.777968 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518c898-1718-481d-af30-4bbcd59d3a4c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:30.778157 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a0721-10e2-47e0-8211-a65e003d7c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:30.779556 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a0721-10e2-47e0-8211-a65e003d7c6c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:30.780062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a0721-10e2-47e0-8211-a65e003d7c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:30.780556 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a0721-10e2-47e0-8211-a65e003d7c6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:30.782921 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a0721-10e2-47e0-8211-a65e003d7c6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:30.785834 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a0721-10e2-47e0-8211-a65e003d7c6c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:30.793983 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 520/1049] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:30.795931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a0721-10e2-47e0-8211-a65e003d7c6c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:30.819383 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa718a38-b9af-4eb4-b4d1-aa415f9118be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:30.820229 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa718a38-b9af-4eb4-b4d1-aa415f9118be None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:30.820517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa718a38-b9af-4eb4-b4d1-aa415f9118be None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:30.820795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa718a38-b9af-4eb4-b4d1-aa415f9118be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:30.822076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa718a38-b9af-4eb4-b4d1-aa415f9118be None admin] RBAC: Adding query filter params (role.id=340cdc0c7fc94ce1b6a527c006d0c86b, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=37a36c30e9dc472d97d762d236dd865a) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:30.822423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa718a38-b9af-4eb4-b4d1-aa415f9118be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:30.823882 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa718a38-b9af-4eb4-b4d1-aa415f9118be None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:30.830664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 530/1050] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:13:30 2022] GET /identity/v3/role_assignments?user.id=37a36c30e9dc472d97d762d236dd865a&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=340cdc0c7fc94ce1b6a527c006d0c86b => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:30.901449 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:30.960001 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a0721-10e2-47e0-8211-a65e003d7c6c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:31.003810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75937c81-4a54-446c-80b8-d52c6a2a0863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:31.004538 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75937c81-4a54-446c-80b8-d52c6a2a0863 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:31.004827 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75937c81-4a54-446c-80b8-d52c6a2a0863 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:31.005112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75937c81-4a54-446c-80b8-d52c6a2a0863 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:31.005882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75937c81-4a54-446c-80b8-d52c6a2a0863 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:31.007518 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75937c81-4a54-446c-80b8-d52c6a2a0863 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:31.043016 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 521/1051] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:13:30 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:13:32.513783 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc359b7-a1e7-4517-bd16-e1c4158604c0 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:32.514521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc359b7-a1e7-4517-bd16-e1c4158604c0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:32.515416 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc359b7-a1e7-4517-bd16-e1c4158604c0 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:32.516559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 531/1052] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:32.522372 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a4a23-5afb-4cc4-87d1-e48fc02883d4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:32.523165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a4a23-5afb-4cc4-87d1-e48fc02883d4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:32.523336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a4a23-5afb-4cc4-87d1-e48fc02883d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:32.543158 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6d0a4a23-5afb-4cc4-87d1-e48fc02883d4 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:32.544629 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6d0a4a23-5afb-4cc4-87d1-e48fc02883d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:32.634765 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 522/1053] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:32.658042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc359b7-a1e7-4517-bd16-e1c4158604c0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:32.743448 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:32.803936 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc359b7-a1e7-4517-bd16-e1c4158604c0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:32.843747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e6729-b676-4abf-be35-26ebc00a2bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:32.844810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e6729-b676-4abf-be35-26ebc00a2bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:32.845098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e6729-b676-4abf-be35-26ebc00a2bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:32.845545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e6729-b676-4abf-be35-26ebc00a2bf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:32.923475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e6729-b676-4abf-be35-26ebc00a2bf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:32.924975 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e6729-b676-4abf-be35-26ebc00a2bf3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:32.987889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:33.039355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 532/1054] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:13:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:13:33.045333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a4a23-5afb-4cc4-87d1-e48fc02883d4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:33.100659 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:33.162056 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d9774-c669-41ee-8d9e-04ee043238ff None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:33.162588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d9774-c669-41ee-8d9e-04ee043238ff None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:33.162736 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d9774-c669-41ee-8d9e-04ee043238ff None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:33.164236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 533/1055] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:13:33.169428 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b9e64-22a0-496e-b19e-71e9d9c5b8ca None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:33.169828 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b9e64-22a0-496e-b19e-71e9d9c5b8ca None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:33.170133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b9e64-22a0-496e-b19e-71e9d9c5b8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:33.189111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fc0b9e64-22a0-496e-b19e-71e9d9c5b8ca None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:33.190701 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fc0b9e64-22a0-496e-b19e-71e9d9c5b8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:33.198978 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a4a23-5afb-4cc4-87d1-e48fc02883d4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:33.238160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6e328-4fc0-433b-a38b-9287e364e52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:33.239184 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6e328-4fc0-433b-a38b-9287e364e52a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:33.239661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6e328-4fc0-433b-a38b-9287e364e52a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:33.239949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6e328-4fc0-433b-a38b-9287e364e52a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:33.255213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6e328-4fc0-433b-a38b-9287e364e52a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:33.257009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6e328-4fc0-433b-a38b-9287e364e52a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:33.278261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 534/1056] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:13:33.279732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a2f6e328-4fc0-433b-a38b-9287e364e52a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:33.279732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:33.279732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:33.279732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:33.279732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:33.279732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:33.279732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:33.279732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:33.279732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:33.279732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:33.279732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:33.279732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:33.279732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:13:33.279732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:13:33.279732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:33.281334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:33.282404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:13:33.282404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:13:33.282404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:33.282404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:33.286666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 523/1057] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:33.288112 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b9e64-22a0-496e-b19e-71e9d9c5b8ca None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:33.311307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6e328-4fc0-433b-a38b-9287e364e52a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:33.416593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:33.442502 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b9e64-22a0-496e-b19e-71e9d9c5b8ca None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:33.451144 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:33.457955 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6e328-4fc0-433b-a38b-9287e364e52a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:33.482756 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc3694-5db5-45d2-801c-e7774e04bd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:33.483453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc3694-5db5-45d2-801c-e7774e04bd74 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:33.483767 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc3694-5db5-45d2-801c-e7774e04bd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:33.484039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc3694-5db5-45d2-801c-e7774e04bd74 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:33.484747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc3694-5db5-45d2-801c-e7774e04bd74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:33.485056 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc3694-5db5-45d2-801c-e7774e04bd74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:33.486646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc3694-5db5-45d2-801c-e7774e04bd74 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:33.498805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 535/1058] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:33.500458 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db104b-8107-475f-9b93-293a93887a2c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:33.500752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db104b-8107-475f-9b93-293a93887a2c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:33.501045 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db104b-8107-475f-9b93-293a93887a2c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:33.501332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c07ca-3033-4969-9ae4-79c96522c22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:33.501332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c07ca-3033-4969-9ae4-79c96522c22b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:33.501332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c07ca-3033-4969-9ae4-79c96522c22b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:33.503342 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 536/1059] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:33.503436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c07ca-3033-4969-9ae4-79c96522c22b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:33.508791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65918-78a7-41aa-8bdf-3cf2d658423b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:33.509073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65918-78a7-41aa-8bdf-3cf2d658423b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:33.509369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65918-78a7-41aa-8bdf-3cf2d658423b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:33.522655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c07ca-3033-4969-9ae4-79c96522c22b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:13:33.531810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-cc9c07ca-3033-4969-9ae4-79c96522c22b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 15:13:33.531810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:33.531810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:33.531810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:33.531810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:33.531810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:33.531810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:33.531810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:33.531810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:33.531810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:33.531810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:33.531810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:33.531810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:13:33.531810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:13:33.531810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:13:33.531810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:13:33.533274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:13:33.533274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:13:33.533274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:13:33.533274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:13:33.533274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:33.533274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:33.533274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:33.533274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:33.533274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:33.533274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:33.533274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:33.533274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:33.533274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:33.533274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:33.533274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:33.533274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:33.534181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:33.534181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:33.534181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:33.534181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:33.534181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:13:33.534181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:13:33.534181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:13:33.534181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:13:33.534181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:13:33.534181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:13:33.534181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 15:13:33.534181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:33.534181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 524/1060] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Jun 27 15:13:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:13:33.535215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-32d65918-78a7-41aa-8bdf-3cf2d658423b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:33.535623 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-32d65918-78a7-41aa-8bdf-3cf2d658423b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:33.539554 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c07ca-3033-4969-9ae4-79c96522c22b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:33.649072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 537/1061] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:13:33.672433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65918-78a7-41aa-8bdf-3cf2d658423b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:33.699816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c07ca-3033-4969-9ae4-79c96522c22b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:33.746389 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3d619-b7d4-4bd4-ac8d-17733c8a71ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:33.747095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3d619-b7d4-4bd4-ac8d-17733c8a71ab None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:33.747379 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3d619-b7d4-4bd4-ac8d-17733c8a71ab None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:33.747651 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3d619-b7d4-4bd4-ac8d-17733c8a71ab None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:33.748585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3d619-b7d4-4bd4-ac8d-17733c8a71ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:33.749387 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3d619-b7d4-4bd4-ac8d-17733c8a71ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:33.750422 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3d619-b7d4-4bd4-ac8d-17733c8a71ab None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:33.761744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 525/1062] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Jun 27 15:13:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:33.767321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3d619-b7d4-4bd4-ac8d-17733c8a71ab None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:33.791357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:33.794745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:33.838298 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65918-78a7-41aa-8bdf-3cf2d658423b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:33.882803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d39936-f60a-45ca-a6f6-786b74b512a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:33.884014 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d39936-f60a-45ca-a6f6-786b74b512a6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:33.884441 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d39936-f60a-45ca-a6f6-786b74b512a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:33.884860 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d39936-f60a-45ca-a6f6-786b74b512a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:33.897904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d39936-f60a-45ca-a6f6-786b74b512a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:13:33.908631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-23d39936-f60a-45ca-a6f6-786b74b512a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:13:33.908631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:33.908631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:33.908631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:33.908631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:33.908631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:33.908631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:33.908631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:33.908631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:33.908631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:33.908631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:33.908631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:33.908631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:13:33.908631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:13:33.908631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:13:33.908631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:13:33.909775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:13:33.909775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:13:33.909775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:13:33.909775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:13:33.909775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:33.909775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:33.909775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:33.909775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:33.909775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:33.909775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:33.909775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:33.909775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:33.909775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:33.909775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:33.909775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:33.909775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:33.910674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:33.910674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:33.910674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:33.910674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:33.910674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:13:33.910674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:13:33.910674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:13:33.910674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:13:33.910674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:13:33.910674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:13:33.910674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:13:33.910674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:33.910674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 538/1063] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:13:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:33.911383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3d619-b7d4-4bd4-ac8d-17733c8a71ab None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:33.916961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d39936-f60a-45ca-a6f6-786b74b512a6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:33.961266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91952b52-c068-4eaa-8e13-5e40ad007d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:33.962086 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91952b52-c068-4eaa-8e13-5e40ad007d77 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:33.962415 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91952b52-c068-4eaa-8e13-5e40ad007d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:33.962698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91952b52-c068-4eaa-8e13-5e40ad007d77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:33.974637 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91952b52-c068-4eaa-8e13-5e40ad007d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:33.976119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91952b52-c068-4eaa-8e13-5e40ad007d77 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:33.995791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-91952b52-c068-4eaa-8e13-5e40ad007d77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:33.995791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:33.995791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:33.995791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:33.995791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:33.995791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:33.995791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:33.995791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:33.995791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:33.995791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:33.995791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:33.995791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:33.995791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:13:33.995791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:13:33.995791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:33.996876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:33.997787 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:13:33.997787 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:13:33.997787 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:33.997787 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:34.002595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 526/1064] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:13:34.012987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91952b52-c068-4eaa-8e13-5e40ad007d77 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:34.037957 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d39936-f60a-45ca-a6f6-786b74b512a6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:34.078817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c059ef-6e57-41bc-873e-075f2e25339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:34.079741 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c059ef-6e57-41bc-873e-075f2e25339a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:34.080029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c059ef-6e57-41bc-873e-075f2e25339a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:34.080443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c059ef-6e57-41bc-873e-075f2e25339a None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:34.081737 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c059ef-6e57-41bc-873e-075f2e25339a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:34.082120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c059ef-6e57-41bc-873e-075f2e25339a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:34.083582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c059ef-6e57-41bc-873e-075f2e25339a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:34.086777 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:34.092280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:34.096992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 539/1065] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:13:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:34.103695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c059ef-6e57-41bc-873e-075f2e25339a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:34.125976 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91952b52-c068-4eaa-8e13-5e40ad007d77 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:34.168997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bfaef-1964-4c35-ada8-8bb432cd6e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:34.169678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bfaef-1964-4c35-ada8-8bb432cd6e77 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:34.169963 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bfaef-1964-4c35-ada8-8bb432cd6e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:34.170709 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bfaef-1964-4c35-ada8-8bb432cd6e77 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:34.171461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bfaef-1964-4c35-ada8-8bb432cd6e77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:34.171773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bfaef-1964-4c35-ada8-8bb432cd6e77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:34.173175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bfaef-1964-4c35-ada8-8bb432cd6e77 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:34.187021 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 527/1066] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:34.193796 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bfaef-1964-4c35-ada8-8bb432cd6e77 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:34.231990 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c059ef-6e57-41bc-873e-075f2e25339a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:34.275732 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4776304-56b1-4fd4-afa4-4f4baeeaa231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:34.276635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4776304-56b1-4fd4-afa4-4f4baeeaa231 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:34.276919 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4776304-56b1-4fd4-afa4-4f4baeeaa231 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:34.277248 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4776304-56b1-4fd4-afa4-4f4baeeaa231 None admin] PATH_INFO: `/v3/users/909bbbc18c014fc3a232b7e16f8e0fb5` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:34.294002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4776304-56b1-4fd4-afa4-4f4baeeaa231 None admin] RBAC: Authorizing `identity:get_user(user_id=909bbbc18c014fc3a232b7e16f8e0fb5)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:34.296230 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4776304-56b1-4fd4-afa4-4f4baeeaa231 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:34.298668 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 540/1067] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:13:34 2022] GET /identity/v3/users/909bbbc18c014fc3a232b7e16f8e0fb5 => generated 285 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:34.305754 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4776304-56b1-4fd4-afa4-4f4baeeaa231 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:34.324754 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bfaef-1964-4c35-ada8-8bb432cd6e77 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:34.356482 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:34.364347 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfc900-c6a8-4d30-b270-37cbde478cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:34.365165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfc900-c6a8-4d30-b270-37cbde478cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:34.365453 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfc900-c6a8-4d30-b270-37cbde478cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:34.365735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfc900-c6a8-4d30-b270-37cbde478cc0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:34.374269 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:34.374530 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfc900-c6a8-4d30-b270-37cbde478cc0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:34.377303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfc900-c6a8-4d30-b270-37cbde478cc0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:34.404900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4dbfc900-c6a8-4d30-b270-37cbde478cc0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:13:34.404900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:34.404900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:34.404900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:34.404900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:34.404900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:34.404900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:34.404900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:34.404900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:34.404900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:34.404900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:34.404900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:34.404900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:13:34.404900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:13:34.404900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:13:34.404900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:34.406968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:34.408032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:34.408032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:34.408032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:13:34.408032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:13:34.408032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:13:34.408032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:13:34.408032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:13:34.408032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:13:34.408032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:13:34.408032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:34.408032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 528/1068] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 27 15:13:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:34.413737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfc900-c6a8-4d30-b270-37cbde478cc0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:34.425960 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4776304-56b1-4fd4-afa4-4f4baeeaa231 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:34.463803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3848e-b1a1-4f6b-ac39-2ff1c9f46298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:34.464483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3848e-b1a1-4f6b-ac39-2ff1c9f46298 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:34.464775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3848e-b1a1-4f6b-ac39-2ff1c9f46298 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:34.465051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3848e-b1a1-4f6b-ac39-2ff1c9f46298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:34.531588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfc900-c6a8-4d30-b270-37cbde478cc0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:34.547276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3848e-b1a1-4f6b-ac39-2ff1c9f46298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:34.553980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3848e-b1a1-4f6b-ac39-2ff1c9f46298 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:34.585038 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bf4b1-0c07-47bf-b2ff-93b223b85d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:34.585933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bf4b1-0c07-47bf-b2ff-93b223b85d40 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:34.586359 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bf4b1-0c07-47bf-b2ff-93b223b85d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:34.586738 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bf4b1-0c07-47bf-b2ff-93b223b85d40 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:34.587994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bf4b1-0c07-47bf-b2ff-93b223b85d40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:34.588429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bf4b1-0c07-47bf-b2ff-93b223b85d40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:34.590305 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bf4b1-0c07-47bf-b2ff-93b223b85d40 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:34.610518 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 529/1069] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 27 15:13:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:34.616113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bf4b1-0c07-47bf-b2ff-93b223b85d40 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:34.632415 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:34.667391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:34.682193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 541/1070] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:13:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 27 15:13:34.688393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3848e-b1a1-4f6b-ac39-2ff1c9f46298 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:34.729873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bf4b1-0c07-47bf-b2ff-93b223b85d40 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:34.768206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308f83a-2c0f-4cb0-8524-581c46213e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:34.769039 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308f83a-2c0f-4cb0-8524-581c46213e8f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:34.769323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308f83a-2c0f-4cb0-8524-581c46213e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:34.769594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308f83a-2c0f-4cb0-8524-581c46213e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:34.780576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308f83a-2c0f-4cb0-8524-581c46213e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:34.782117 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308f83a-2c0f-4cb0-8524-581c46213e8f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:34.792795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3848e-b1a1-4f6b-ac39-2ff1c9f46298 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:34.800818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-0308f83a-2c0f-4cb0-8524-581c46213e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:34.800818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:34.800818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:34.800818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:34.800818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:34.800818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:34.800818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:34.800818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:34.800818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:34.800818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:34.800818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:34.800818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:34.800818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:13:34.800818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:13:34.800818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:34.801813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:34.803190 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:13:34.803190 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:13:34.803190 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:34.803190 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:34.803190 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 530/1071] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:13:34.808623 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308f83a-2c0f-4cb0-8524-581c46213e8f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:34.847581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034eeb83-dc24-47a2-81d7-df5ccb8c9c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:34.848573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034eeb83-dc24-47a2-81d7-df5ccb8c9c89 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:34.848966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034eeb83-dc24-47a2-81d7-df5ccb8c9c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:34.849347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034eeb83-dc24-47a2-81d7-df5ccb8c9c89 None admin] PATH_INFO: `/v3/projects/2a45c85d2adf40af9a9c00c4a6ca3696` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:34.850806 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034eeb83-dc24-47a2-81d7-df5ccb8c9c89 None admin] RBAC: Authorizing `identity:get_project(project_id=2a45c85d2adf40af9a9c00c4a6ca3696)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:34.852416 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034eeb83-dc24-47a2-81d7-df5ccb8c9c89 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:34.854275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 542/1072] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:13:34 2022] GET /identity/v3/projects/2a45c85d2adf40af9a9c00c4a6ca3696 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:34.861132 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034eeb83-dc24-47a2-81d7-df5ccb8c9c89 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:34.892347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:34.927093 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:34.931917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308f83a-2c0f-4cb0-8524-581c46213e8f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:34.971296 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba5cbf-b01d-4a26-9151-4c1440a6606c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:34.971981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba5cbf-b01d-4a26-9151-4c1440a6606c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:34.972271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba5cbf-b01d-4a26-9151-4c1440a6606c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:34.972546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba5cbf-b01d-4a26-9151-4c1440a6606c None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:34.973288 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba5cbf-b01d-4a26-9151-4c1440a6606c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:34.973596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba5cbf-b01d-4a26-9151-4c1440a6606c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:34.973724 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034eeb83-dc24-47a2-81d7-df5ccb8c9c89 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:34.975062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba5cbf-b01d-4a26-9151-4c1440a6606c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:34.989008 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 531/1073] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:34.994909 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba5cbf-b01d-4a26-9151-4c1440a6606c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:35.012042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb97d71-6ea7-426e-95d2-d2f4a3beab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:35.012729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb97d71-6ea7-426e-95d2-d2f4a3beab7a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:35.013016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb97d71-6ea7-426e-95d2-d2f4a3beab7a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:35.013292 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb97d71-6ea7-426e-95d2-d2f4a3beab7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:35.014185 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb97d71-6ea7-426e-95d2-d2f4a3beab7a None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=2a45c85d2adf40af9a9c00c4a6ca3696, user.id=909bbbc18c014fc3a232b7e16f8e0fb5) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:35.014535 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb97d71-6ea7-426e-95d2-d2f4a3beab7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:35.016002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb97d71-6ea7-426e-95d2-d2f4a3beab7a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:35.021800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 543/1074] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:13:34 2022] GET /identity/v3/role_assignments?user.id=909bbbc18c014fc3a232b7e16f8e0fb5&scope.project.id=2a45c85d2adf40af9a9c00c4a6ca3696&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:35.132550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba5cbf-b01d-4a26-9151-4c1440a6606c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:35.176398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c0244-6dfc-403a-9567-9df6e8af26f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:35.177246 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c0244-6dfc-403a-9567-9df6e8af26f6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:35.177535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c0244-6dfc-403a-9567-9df6e8af26f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:35.178162 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c0244-6dfc-403a-9567-9df6e8af26f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:35.188295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c0244-6dfc-403a-9567-9df6e8af26f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:35.189780 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c0244-6dfc-403a-9567-9df6e8af26f6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:35.205755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2b6c0244-6dfc-403a-9567-9df6e8af26f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:13:35.205755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:35.205755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:35.205755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:35.205755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:35.205755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:35.205755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:35.205755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:35.205755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:35.205755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:35.205755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:35.205755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:35.205755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:13:35.205755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:13:35.205755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:35.207403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:35.208631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:13:35.208631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:13:35.208631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:13:35.208631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:13:35.208631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:13:35.208631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:13:35.208631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:13:35.208631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:35.210451 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 532/1075] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:13:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:35.212970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb97d71-6ea7-426e-95d2-d2f4a3beab7a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:35.312205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:35.334529 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb97d71-6ea7-426e-95d2-d2f4a3beab7a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:35.383145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7b234-1bf4-4cf0-9898-29ddba552cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:35.383733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7b234-1bf4-4cf0-9898-29ddba552cbb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:35.384012 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7b234-1bf4-4cf0-9898-29ddba552cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:35.384284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7b234-1bf4-4cf0-9898-29ddba552cbb None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:35.385162 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7b234-1bf4-4cf0-9898-29ddba552cbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:35.385471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7b234-1bf4-4cf0-9898-29ddba552cbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:35.386995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7b234-1bf4-4cf0-9898-29ddba552cbb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:35.401386 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 544/1076] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:13:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:35.407598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c0244-6dfc-403a-9567-9df6e8af26f6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:35.432942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:35.543380 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c0244-6dfc-403a-9567-9df6e8af26f6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:35.592527 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379b0a4-2f96-4cd5-bf8b-382fe015989d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:35.593999 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379b0a4-2f96-4cd5-bf8b-382fe015989d None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:35.594296 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379b0a4-2f96-4cd5-bf8b-382fe015989d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:35.594584 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379b0a4-2f96-4cd5-bf8b-382fe015989d None admin] PATH_INFO: `/v3/projects/3f8ec287061141028659ab504e7707de/users/37a36c30e9dc472d97d762d236dd865a/roles/340cdc0c7fc94ce1b6a527c006d0c86b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:35.597298 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379b0a4-2f96-4cd5-bf8b-382fe015989d None admin] RBAC: Authorizing `identity:create_grant(project_id=3f8ec287061141028659ab504e7707de, user_id=37a36c30e9dc472d97d762d236dd865a, role_id=340cdc0c7fc94ce1b6a527c006d0c86b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:35.598927 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379b0a4-2f96-4cd5-bf8b-382fe015989d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:35.620568 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 533/1077] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:13:35 2022] PUT /identity/v3/projects/3f8ec287061141028659ab504e7707de/users/37a36c30e9dc472d97d762d236dd865a/roles/340cdc0c7fc94ce1b6a527c006d0c86b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:13:37.132354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5424e6-bb73-4f5e-8072-127efb1063da None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:37.133145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5424e6-bb73-4f5e-8072-127efb1063da None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:37.133298 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5424e6-bb73-4f5e-8072-127efb1063da None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:37.134805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 545/1078] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:37.140728 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16764485-56f2-403d-9a88-a50103c4e8d4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:37.141276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16764485-56f2-403d-9a88-a50103c4e8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:37.141276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16764485-56f2-403d-9a88-a50103c4e8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:37.165917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-16764485-56f2-403d-9a88-a50103c4e8d4 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:37.168078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-16764485-56f2-403d-9a88-a50103c4e8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:37.294575 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 534/1079] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:37.334275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5424e6-bb73-4f5e-8072-127efb1063da None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:37.477377 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5424e6-bb73-4f5e-8072-127efb1063da None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:37.525341 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ca805-b294-4760-8a06-155de077c643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:37.526166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ca805-b294-4760-8a06-155de077c643 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:37.526481 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ca805-b294-4760-8a06-155de077c643 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:37.526750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ca805-b294-4760-8a06-155de077c643 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:37.540115 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ca805-b294-4760-8a06-155de077c643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:13:37.548532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9b0ca805-b294-4760-8a06-155de077c643 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:13:37.548532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:37.548532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:37.548532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:37.548532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:37.548532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:37.548532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:37.548532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:37.548532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:37.548532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:37.548532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:37.548532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:37.548532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:13:37.548532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:13:37.548532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:13:37.548532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:13:37.550414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:13:37.550414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:13:37.550414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:13:37.550414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:13:37.550414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:37.550414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:37.550414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:37.550414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:37.550414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:37.550414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:37.550414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:37.550414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:37.550414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:37.550414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:37.550414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:37.550414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:37.552055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:37.552055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:37.552055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:37.552055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:37.552055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:13:37.552055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:13:37.552055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:13:37.552055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:13:37.552055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:13:37.552055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:13:37.552055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:13:37.552055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:37.552055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 546/1080] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:13:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:37.558426 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16764485-56f2-403d-9a88-a50103c4e8d4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:37.571964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:37.673103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16764485-56f2-403d-9a88-a50103c4e8d4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:37.714635 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f240b5-329d-49bf-a86e-4903ba804b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:37.715811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f240b5-329d-49bf-a86e-4903ba804b94 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:37.716280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f240b5-329d-49bf-a86e-4903ba804b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:37.716762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f240b5-329d-49bf-a86e-4903ba804b94 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:37.718187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f240b5-329d-49bf-a86e-4903ba804b94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:37.718754 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f240b5-329d-49bf-a86e-4903ba804b94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:37.721294 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f240b5-329d-49bf-a86e-4903ba804b94 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:37.737605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 535/1081] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:13:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:37.743621 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ca805-b294-4760-8a06-155de077c643 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:37.756047 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:37.900565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ca805-b294-4760-8a06-155de077c643 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:37.962786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db85f3-c4fd-42aa-8b6c-2d5120bbe5d0 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:37.963039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1370f-7c47-47e1-9e28-8547024e0d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:37.963159 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db85f3-c4fd-42aa-8b6c-2d5120bbe5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:37.963330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db85f3-c4fd-42aa-8b6c-2d5120bbe5d0 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:37.964586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1370f-7c47-47e1-9e28-8547024e0d93 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:37.964739 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 536/1082] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:37.965075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1370f-7c47-47e1-9e28-8547024e0d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:37.965578 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1370f-7c47-47e1-9e28-8547024e0d93 None admin] PATH_INFO: `/v3/users/909bbbc18c014fc3a232b7e16f8e0fb5` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:37.967801 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1370f-7c47-47e1-9e28-8547024e0d93 None admin] RBAC: Authorizing `identity:get_user(user_id=909bbbc18c014fc3a232b7e16f8e0fb5)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:37.970567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1370f-7c47-47e1-9e28-8547024e0d93 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:37.970972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f300d5e-9334-4e12-8ad7-4b30894de66c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:37.971261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f300d5e-9334-4e12-8ad7-4b30894de66c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:37.971536 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f300d5e-9334-4e12-8ad7-4b30894de66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:37.973658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 547/1083] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:13:37 2022] GET /identity/v3/users/909bbbc18c014fc3a232b7e16f8e0fb5 => generated 285 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:37.979786 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1370f-7c47-47e1-9e28-8547024e0d93 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:37.991567 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4f300d5e-9334-4e12-8ad7-4b30894de66c None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:37.993099 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4f300d5e-9334-4e12-8ad7-4b30894de66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:38.066200 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:38.073374 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 537/1084] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:38.090925 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1370f-7c47-47e1-9e28-8547024e0d93 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:38.097513 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f300d5e-9334-4e12-8ad7-4b30894de66c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:38.099931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:38.142205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68b977-3c51-4aa7-a4ca-0b17db8e3d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:38.143367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68b977-3c51-4aa7-a4ca-0b17db8e3d16 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:38.143739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68b977-3c51-4aa7-a4ca-0b17db8e3d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:38.144403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68b977-3c51-4aa7-a4ca-0b17db8e3d16 None admin] PATH_INFO: `/v3/projects/2a45c85d2adf40af9a9c00c4a6ca3696` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:38.146484 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68b977-3c51-4aa7-a4ca-0b17db8e3d16 None admin] RBAC: Authorizing `identity:get_project(project_id=2a45c85d2adf40af9a9c00c4a6ca3696)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:38.148829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68b977-3c51-4aa7-a4ca-0b17db8e3d16 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:38.157002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 548/1085] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:13:37 2022] GET /identity/v3/projects/2a45c85d2adf40af9a9c00c4a6ca3696 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:38.158475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68b977-3c51-4aa7-a4ca-0b17db8e3d16 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:38.268020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f300d5e-9334-4e12-8ad7-4b30894de66c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:38.275764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68b977-3c51-4aa7-a4ca-0b17db8e3d16 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:38.313186 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf98ebd-c119-4a9a-a394-1838b2476552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:38.314109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf98ebd-c119-4a9a-a394-1838b2476552 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:38.314427 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf98ebd-c119-4a9a-a394-1838b2476552 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:38.314705 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf98ebd-c119-4a9a-a394-1838b2476552 None admin] PATH_INFO: `/v3/projects/2a45c85d2adf40af9a9c00c4a6ca3696/users/909bbbc18c014fc3a232b7e16f8e0fb5/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:38.316810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf98ebd-c119-4a9a-a394-1838b2476552 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a45c85d2adf40af9a9c00c4a6ca3696, user_id=909bbbc18c014fc3a232b7e16f8e0fb5, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:38.318376 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf98ebd-c119-4a9a-a394-1838b2476552 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:38.328814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3bd02-23f6-45da-bdf6-6ddc8a106395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:38.330238 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3bd02-23f6-45da-bdf6-6ddc8a106395 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:38.330730 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3bd02-23f6-45da-bdf6-6ddc8a106395 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:38.331213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3bd02-23f6-45da-bdf6-6ddc8a106395 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:38.333944 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 549/1086] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:13:38 2022] PUT /identity/v3/projects/2a45c85d2adf40af9a9c00c4a6ca3696/users/909bbbc18c014fc3a232b7e16f8e0fb5/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:13:38.350127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3bd02-23f6-45da-bdf6-6ddc8a106395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:13:38.359056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-edf3bd02-23f6-45da-bdf6-6ddc8a106395 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 15:13:38.359056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:38.359056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:38.359056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:38.359056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:38.359056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:38.359056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:38.359056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:38.359056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:38.359056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:38.359056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:38.359056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:38.359056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:13:38.359056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:13:38.359056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:13:38.359056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:13:38.360972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:13:38.360972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:13:38.360972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:13:38.360972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:13:38.360972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:38.360972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:38.360972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:38.360972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:38.360972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:38.360972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:38.360972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:38.360972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:38.360972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:38.360972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:38.360972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:38.360972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:38.363062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:38.363062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:38.363062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:38.363062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:38.363062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:13:38.363062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:13:38.363062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:13:38.363062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:13:38.363062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:13:38.363062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:13:38.363062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 15:13:38.363062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:38.363062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 538/1087] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Jun 27 15:13:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:38.369082 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf98ebd-c119-4a9a-a394-1838b2476552 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:38.373856 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:38.499582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf98ebd-c119-4a9a-a394-1838b2476552 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:38.546450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82e785-126e-4c2c-a079-672b6ecde6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:38.547043 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82e785-126e-4c2c-a079-672b6ecde6ad None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:38.547328 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82e785-126e-4c2c-a079-672b6ecde6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:38.547607 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82e785-126e-4c2c-a079-672b6ecde6ad None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:38.548382 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82e785-126e-4c2c-a079-672b6ecde6ad None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:38.548692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82e785-126e-4c2c-a079-672b6ecde6ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:38.550113 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82e785-126e-4c2c-a079-672b6ecde6ad None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:38.560815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 550/1088] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Jun 27 15:13:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:38.570891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3bd02-23f6-45da-bdf6-6ddc8a106395 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:38.693480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:38.767655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3bd02-23f6-45da-bdf6-6ddc8a106395 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:38.830269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b59e89-83ef-4952-abe0-e47af8ac7638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:38.831530 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b59e89-83ef-4952-abe0-e47af8ac7638 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:38.832034 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b59e89-83ef-4952-abe0-e47af8ac7638 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:38.832537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b59e89-83ef-4952-abe0-e47af8ac7638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:38.853677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b59e89-83ef-4952-abe0-e47af8ac7638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:38.856396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b59e89-83ef-4952-abe0-e47af8ac7638 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:38.890979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-71b59e89-83ef-4952-abe0-e47af8ac7638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:38.890979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:38.890979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:38.890979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:38.890979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:38.890979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:38.890979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:38.890979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:38.890979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:38.890979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:38.890979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:38.890979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:38.890979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:13:38.890979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:13:38.890979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:38.892053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:38.892966 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:13:38.892966 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:13:38.892966 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:38.892966 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:38.894480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 539/1089] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:38.902907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82e785-126e-4c2c-a079-672b6ecde6ad None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:39.023257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:39.067532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82e785-126e-4c2c-a079-672b6ecde6ad None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:39.106109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4d51b-6039-458f-aae2-67c1c3d1e58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:39.106878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4d51b-6039-458f-aae2-67c1c3d1e58a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:39.107266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4d51b-6039-458f-aae2-67c1c3d1e58a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:39.107709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4d51b-6039-458f-aae2-67c1c3d1e58a None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:39.108559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4d51b-6039-458f-aae2-67c1c3d1e58a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:39.109094 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4d51b-6039-458f-aae2-67c1c3d1e58a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:39.110729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4d51b-6039-458f-aae2-67c1c3d1e58a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:39.128251 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 551/1090] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:39.134596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b59e89-83ef-4952-abe0-e47af8ac7638 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:39.249619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b59e89-83ef-4952-abe0-e47af8ac7638 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:39.265485 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:39.289392 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526231a-6718-4300-a0e5-eabaf7b18197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:39.290631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526231a-6718-4300-a0e5-eabaf7b18197 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:39.291009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526231a-6718-4300-a0e5-eabaf7b18197 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:39.291376 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526231a-6718-4300-a0e5-eabaf7b18197 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:39.300913 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526231a-6718-4300-a0e5-eabaf7b18197 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:39.303015 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526231a-6718-4300-a0e5-eabaf7b18197 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:39.327092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f526231a-6718-4300-a0e5-eabaf7b18197 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:13:39.327092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:39.327092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:39.327092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:39.327092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:39.327092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:39.327092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:39.327092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:39.327092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:39.327092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:39.327092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:39.327092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:39.327092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:13:39.327092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:13:39.327092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:13:39.327092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:39.329043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:39.336020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:39.336020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:39.336020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:13:39.336020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:13:39.336020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:13:39.336020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:13:39.336020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:13:39.336020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:13:39.336020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 15:13:39.336020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:13:39.336020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 540/1091] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 27 15:13:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:13:39.337134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4d51b-6039-458f-aae2-67c1c3d1e58a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:39.459366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4d51b-6039-458f-aae2-67c1c3d1e58a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:39.488874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:39.500397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c4694-a2de-4e1c-b4fe-2231b35274e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:39.501216 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4694-a2de-4e1c-b4fe-2231b35274e6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:39.501593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4694-a2de-4e1c-b4fe-2231b35274e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:39.501963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4694-a2de-4e1c-b4fe-2231b35274e6 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:39.502995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c4694-a2de-4e1c-b4fe-2231b35274e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:39.503401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c4694-a2de-4e1c-b4fe-2231b35274e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:39.505023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c4694-a2de-4e1c-b4fe-2231b35274e6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:39.525134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 552/1092] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 27 15:13:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:39.531484 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526231a-6718-4300-a0e5-eabaf7b18197 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:39.646284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526231a-6718-4300-a0e5-eabaf7b18197 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:39.690341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bbf62-6bbc-469b-9db6-1cf7b5137856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:39.691019 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bbf62-6bbc-469b-9db6-1cf7b5137856 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:39.691303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bbf62-6bbc-469b-9db6-1cf7b5137856 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:39.691581 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bbf62-6bbc-469b-9db6-1cf7b5137856 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:39.740350 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:39.769332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bbf62-6bbc-469b-9db6-1cf7b5137856 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:39.770861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bbf62-6bbc-469b-9db6-1cf7b5137856 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:39.886777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 541/1093] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:13:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 27 15:13:39.893347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c4694-a2de-4e1c-b4fe-2231b35274e6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:40.006350 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c4694-a2de-4e1c-b4fe-2231b35274e6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:40.043900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d4345-222b-4e07-8651-f0345fd17b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:40.044720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d4345-222b-4e07-8651-f0345fd17b78 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:40.045082 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d4345-222b-4e07-8651-f0345fd17b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:40.045363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d4345-222b-4e07-8651-f0345fd17b78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:40.057053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d4345-222b-4e07-8651-f0345fd17b78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:40.058582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d4345-222b-4e07-8651-f0345fd17b78 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:40.078523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2c2d4345-222b-4e07-8651-f0345fd17b78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:40.078523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:40.078523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:40.078523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:40.078523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:40.078523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:40.078523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:40.078523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:40.078523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:40.078523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:40.078523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:40.078523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:40.078523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:13:40.078523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:13:40.078523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:40.080489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:40.082547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:13:40.082547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:13:40.082547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:13:40.082547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:40.084725 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 553/1094] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:40.085727 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bbf62-6bbc-469b-9db6-1cf7b5137856 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:40.199227 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:40.228388 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bbf62-6bbc-469b-9db6-1cf7b5137856 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:40.273629 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a14728-9600-4119-bbe0-a3cd59eb099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:40.274258 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a14728-9600-4119-bbe0-a3cd59eb099d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:40.274544 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a14728-9600-4119-bbe0-a3cd59eb099d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:40.274829 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a14728-9600-4119-bbe0-a3cd59eb099d None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:40.275578 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a14728-9600-4119-bbe0-a3cd59eb099d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:40.275885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a14728-9600-4119-bbe0-a3cd59eb099d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:40.277311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a14728-9600-4119-bbe0-a3cd59eb099d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:40.290490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 542/1095] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:40.296181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d4345-222b-4e07-8651-f0345fd17b78 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:40.349019 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:40.418355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d4345-222b-4e07-8651-f0345fd17b78 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:40.456586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a528c48-7aa8-43c8-9c55-d8c27801380d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:40.457408 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a528c48-7aa8-43c8-9c55-d8c27801380d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:40.457691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a528c48-7aa8-43c8-9c55-d8c27801380d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:40.457943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a528c48-7aa8-43c8-9c55-d8c27801380d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:40.465852 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a528c48-7aa8-43c8-9c55-d8c27801380d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:40.467445 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a528c48-7aa8-43c8-9c55-d8c27801380d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:40.482540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5a528c48-7aa8-43c8-9c55-d8c27801380d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:13:40.482540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:40.482540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:40.482540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:40.482540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:40.482540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:40.482540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:40.482540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:40.482540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:40.482540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:40.482540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:40.482540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:40.482540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:13:40.482540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:13:40.482540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:40.484349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:40.486166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:13:40.486166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:13:40.486166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:13:40.486166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:13:40.486166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:13:40.486166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:13:40.486166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:13:40.486166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:40.486166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 554/1096] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:13:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:40.490846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a14728-9600-4119-bbe0-a3cd59eb099d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:40.627018 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153abf4-282a-4c43-8906-cfdcd5e65fba None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:40.627338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153abf4-282a-4c43-8906-cfdcd5e65fba None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:40.627620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153abf4-282a-4c43-8906-cfdcd5e65fba None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:40.629026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 555/1097] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:13:40.634795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a8b45-4c61-48e9-af89-9319e5f2c595 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:40.635282 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a8b45-4c61-48e9-af89-9319e5f2c595 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:40.635760 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a8b45-4c61-48e9-af89-9319e5f2c595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:40.647535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a14728-9600-4119-bbe0-a3cd59eb099d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:40.661914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-700a8b45-4c61-48e9-af89-9319e5f2c595 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:40.663160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-700a8b45-4c61-48e9-af89-9319e5f2c595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:40.683507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa992e0-9330-42ec-8f35-82d8fb508f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:40.684180 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa992e0-9330-42ec-8f35-82d8fb508f73 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:40.684469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa992e0-9330-42ec-8f35-82d8fb508f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:40.684739 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa992e0-9330-42ec-8f35-82d8fb508f73 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:40.685659 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa992e0-9330-42ec-8f35-82d8fb508f73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:40.685903 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa992e0-9330-42ec-8f35-82d8fb508f73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:40.688067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa992e0-9330-42ec-8f35-82d8fb508f73 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:40.690022 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:40.708408 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 543/1098] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:13:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:40.709621 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa992e0-9330-42ec-8f35-82d8fb508f73 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:40.778126 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 556/1099] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:13:40.822953 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a8b45-4c61-48e9-af89-9319e5f2c595 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:40.827843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa992e0-9330-42ec-8f35-82d8fb508f73 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:40.864930 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7cd4f-e36e-4717-9e57-08b6b678a0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:40.865633 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7cd4f-e36e-4717-9e57-08b6b678a0ac None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:40.865918 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7cd4f-e36e-4717-9e57-08b6b678a0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:40.866190 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7cd4f-e36e-4717-9e57-08b6b678a0ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:40.867088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7cd4f-e36e-4717-9e57-08b6b678a0ac None admin] RBAC: Adding query filter params (role.id=340cdc0c7fc94ce1b6a527c006d0c86b, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=37a36c30e9dc472d97d762d236dd865a) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:40.867394 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7cd4f-e36e-4717-9e57-08b6b678a0ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:40.868323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:40.869222 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7cd4f-e36e-4717-9e57-08b6b678a0ac None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:40.882406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 544/1100] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:13:40 2022] GET /identity/v3/role_assignments?user.id=37a36c30e9dc472d97d762d236dd865a&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=340cdc0c7fc94ce1b6a527c006d0c86b => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:40.982899 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a8b45-4c61-48e9-af89-9319e5f2c595 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:41.034721 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d505abf-375e-41a3-9244-576e95228ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:41.035560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d505abf-375e-41a3-9244-576e95228ebe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:41.035848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d505abf-375e-41a3-9244-576e95228ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:41.036116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d505abf-375e-41a3-9244-576e95228ebe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:41.048559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d505abf-375e-41a3-9244-576e95228ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:13:41.056567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6d505abf-375e-41a3-9244-576e95228ebe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:13:41.056567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:13:41.056567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:13:41.056567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:13:41.056567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:13:41.056567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:13:41.056567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:13:41.056567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:13:41.056567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:13:41.056567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:13:41.056567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:13:41.056567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:13:41.056567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:13:41.056567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:13:41.056567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:13:41.056567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:13:41.058167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:13:41.058167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:13:41.058167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:13:41.058167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:13:41.058167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:13:41.058167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:13:41.058167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:13:41.058167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:13:41.058167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:13:41.058167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:13:41.058167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:13:41.058167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:13:41.058167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:13:41.058167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:13:41.058167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:13:41.058167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:13:41.059577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:13:41.059577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:13:41.059577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:13:41.059577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:13:41.059577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:13:41.059577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:13:41.059577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:13:41.059577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:13:41.059577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:13:41.059577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:13:41.059577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:13:41.059577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:13:41.062339 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 557/1101] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:13:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:13:41.065437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7cd4f-e36e-4717-9e57-08b6b678a0ac None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:41.146531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:41.198155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7cd4f-e36e-4717-9e57-08b6b678a0ac None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:41.236444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025f16a-bd2c-43f2-944a-2918d86e9baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:41.237967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025f16a-bd2c-43f2-944a-2918d86e9baa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:41.237967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025f16a-bd2c-43f2-944a-2918d86e9baa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:41.237967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025f16a-bd2c-43f2-944a-2918d86e9baa None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:41.238490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025f16a-bd2c-43f2-944a-2918d86e9baa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:41.238803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025f16a-bd2c-43f2-944a-2918d86e9baa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:41.240248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025f16a-bd2c-43f2-944a-2918d86e9baa None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:41.249705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 545/1102] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:13:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:41.255882 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d505abf-375e-41a3-9244-576e95228ebe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:41.365524 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:41.393220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d505abf-375e-41a3-9244-576e95228ebe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:41.431054 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747f5af-00aa-4f65-9f13-62b6df90bcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:41.431882 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747f5af-00aa-4f65-9f13-62b6df90bcaa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:41.432167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747f5af-00aa-4f65-9f13-62b6df90bcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:41.432447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747f5af-00aa-4f65-9f13-62b6df90bcaa None admin] PATH_INFO: `/v3/users/909bbbc18c014fc3a232b7e16f8e0fb5` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:41.433708 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747f5af-00aa-4f65-9f13-62b6df90bcaa None admin] RBAC: Authorizing `identity:get_user(user_id=909bbbc18c014fc3a232b7e16f8e0fb5)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:41.435189 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747f5af-00aa-4f65-9f13-62b6df90bcaa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:41.436974 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 558/1103] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:13:41 2022] GET /identity/v3/users/909bbbc18c014fc3a232b7e16f8e0fb5 => generated 285 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:41.443330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025f16a-bd2c-43f2-944a-2918d86e9baa None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:41.566330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025f16a-bd2c-43f2-944a-2918d86e9baa None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:41.588479 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:41.612099 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03276d0d-0f59-459e-82c9-b77db2844b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:41.613231 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03276d0d-0f59-459e-82c9-b77db2844b9f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:41.613729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03276d0d-0f59-459e-82c9-b77db2844b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:41.614235 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03276d0d-0f59-459e-82c9-b77db2844b9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:41.708098 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03276d0d-0f59-459e-82c9-b77db2844b9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:41.709594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03276d0d-0f59-459e-82c9-b77db2844b9f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:41.827948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 546/1104] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:13:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:13:41.834722 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747f5af-00aa-4f65-9f13-62b6df90bcaa None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:41.967890 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747f5af-00aa-4f65-9f13-62b6df90bcaa None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:42.004757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e84d2-59a1-4801-acb4-3ed49c738153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:42.005651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e84d2-59a1-4801-acb4-3ed49c738153 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:42.005936 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e84d2-59a1-4801-acb4-3ed49c738153 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:42.006212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e84d2-59a1-4801-acb4-3ed49c738153 None admin] PATH_INFO: `/v3/projects/2a45c85d2adf40af9a9c00c4a6ca3696` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:42.007489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e84d2-59a1-4801-acb4-3ed49c738153 None admin] RBAC: Authorizing `identity:get_project(project_id=2a45c85d2adf40af9a9c00c4a6ca3696)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:42.008940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e84d2-59a1-4801-acb4-3ed49c738153 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:42.010716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 559/1105] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:13:41 2022] GET /identity/v3/projects/2a45c85d2adf40af9a9c00c4a6ca3696 => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:42.017570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03276d0d-0f59-459e-82c9-b77db2844b9f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:42.040246 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:42.123012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03276d0d-0f59-459e-82c9-b77db2844b9f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:42.159266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c3356-7370-450d-9495-f65269b059fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:42.159935 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c3356-7370-450d-9495-f65269b059fa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:42.160219 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c3356-7370-450d-9495-f65269b059fa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:42.160520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c3356-7370-450d-9495-f65269b059fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:42.161371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c3356-7370-450d-9495-f65269b059fa None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=2a45c85d2adf40af9a9c00c4a6ca3696, user.id=909bbbc18c014fc3a232b7e16f8e0fb5) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:42.161681 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c3356-7370-450d-9495-f65269b059fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:42.163161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c3356-7370-450d-9495-f65269b059fa None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:42.169764 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 547/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:13:42 2022] GET /identity/v3/role_assignments?user.id=909bbbc18c014fc3a232b7e16f8e0fb5&scope.project.id=2a45c85d2adf40af9a9c00c4a6ca3696&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:44.277487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4883db8-10d4-435a-9a0b-bd8042fe10d7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:44.278064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4883db8-10d4-435a-9a0b-bd8042fe10d7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:44.278064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4883db8-10d4-435a-9a0b-bd8042fe10d7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:44.280373 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 560/1107] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:44.286936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bd40d-1de5-4567-b9be-c49c1a1a30be None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:44.287515 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bd40d-1de5-4567-b9be-c49c1a1a30be None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:44.287515 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bd40d-1de5-4567-b9be-c49c1a1a30be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:44.306838 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-733bd40d-1de5-4567-b9be-c49c1a1a30be None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:44.308067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-733bd40d-1de5-4567-b9be-c49c1a1a30be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:44.383587 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 548/1108] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:44.409068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4883db8-10d4-435a-9a0b-bd8042fe10d7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:44.436910 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:44.524933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4883db8-10d4-435a-9a0b-bd8042fe10d7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:44.562816 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b39c32-0688-4bbe-b3ab-4c156c994d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:44.563651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b39c32-0688-4bbe-b3ab-4c156c994d62 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:44.563938 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b39c32-0688-4bbe-b3ab-4c156c994d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:44.564217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b39c32-0688-4bbe-b3ab-4c156c994d62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:44.565510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b39c32-0688-4bbe-b3ab-4c156c994d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:44.566995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b39c32-0688-4bbe-b3ab-4c156c994d62 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:44.568619 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 561/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:44.575017 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bd40d-1de5-4567-b9be-c49c1a1a30be None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:44.592420 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:44.690033 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bd40d-1de5-4567-b9be-c49c1a1a30be None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:44.729381 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa9414-570c-4fa5-8318-32d7537a9404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:44.730078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa9414-570c-4fa5-8318-32d7537a9404 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:44.730396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa9414-570c-4fa5-8318-32d7537a9404 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:44.730678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa9414-570c-4fa5-8318-32d7537a9404 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:44.731410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa9414-570c-4fa5-8318-32d7537a9404 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:44.732949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa9414-570c-4fa5-8318-32d7537a9404 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:44.755912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 549/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:13:44 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:13:46.929862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f145786-0cd3-4070-958e-5c7d1833ea71 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:46.930509 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f145786-0cd3-4070-958e-5c7d1833ea71 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:46.930509 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f145786-0cd3-4070-958e-5c7d1833ea71 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:46.931785 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 562/1111] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:46.940776 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81d158-b8f6-41e0-9fac-49272630937c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:46.941344 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81d158-b8f6-41e0-9fac-49272630937c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:46.941344 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81d158-b8f6-41e0-9fac-49272630937c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:46.959669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ca81d158-b8f6-41e0-9fac-49272630937c None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:46.960875 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ca81d158-b8f6-41e0-9fac-49272630937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:47.035168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:47.041186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 550/1112] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:47.067647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f145786-0cd3-4070-958e-5c7d1833ea71 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:47.177753 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:47.191780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f145786-0cd3-4070-958e-5c7d1833ea71 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:47.229475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e225bc8-b4cf-4043-8637-5fa42f3f7639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:47.230451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e225bc8-b4cf-4043-8637-5fa42f3f7639 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:47.230781 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e225bc8-b4cf-4043-8637-5fa42f3f7639 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:47.231098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e225bc8-b4cf-4043-8637-5fa42f3f7639 None admin] PATH_INFO: `/v3/roles/0763e374972f4ce29ab449e27fd89355` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:47.232928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e225bc8-b4cf-4043-8637-5fa42f3f7639 None admin] RBAC: Authorizing `identity:get_role(role_id=0763e374972f4ce29ab449e27fd89355)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:47.234596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e225bc8-b4cf-4043-8637-5fa42f3f7639 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:47.235986 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 563/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:13:47 2022] GET /identity/v3/roles/0763e374972f4ce29ab449e27fd89355 => generated 223 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:47.245281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81d158-b8f6-41e0-9fac-49272630937c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:47.359166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81d158-b8f6-41e0-9fac-49272630937c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:47.398372 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cc843-9df3-4507-8807-24d6b5ed54a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:47.399335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cc843-9df3-4507-8807-24d6b5ed54a0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:47.399655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cc843-9df3-4507-8807-24d6b5ed54a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:47.399973 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cc843-9df3-4507-8807-24d6b5ed54a0 None admin] PATH_INFO: `/v3/users/9f6433c4192345a7b42febf60d8de497` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:47.415174 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cc843-9df3-4507-8807-24d6b5ed54a0 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6433c4192345a7b42febf60d8de497)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:47.416657 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cc843-9df3-4507-8807-24d6b5ed54a0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:47.418465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 551/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:13:47 2022] GET /identity/v3/users/9f6433c4192345a7b42febf60d8de497 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:47.428484 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e225bc8-b4cf-4043-8637-5fa42f3f7639 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:47.539495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e225bc8-b4cf-4043-8637-5fa42f3f7639 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:47.580261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30af5ba-8d4c-45cd-a42c-1ce70881fff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:47.580931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30af5ba-8d4c-45cd-a42c-1ce70881fff9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:47.581220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30af5ba-8d4c-45cd-a42c-1ce70881fff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:47.581479 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30af5ba-8d4c-45cd-a42c-1ce70881fff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:47.615318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:47.687123 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30af5ba-8d4c-45cd-a42c-1ce70881fff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:47.689835 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30af5ba-8d4c-45cd-a42c-1ce70881fff9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:47.874865 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 564/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:13:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:13:47.881260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cc843-9df3-4507-8807-24d6b5ed54a0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:47.948123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:47.993261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cc843-9df3-4507-8807-24d6b5ed54a0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:48.031548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50fac6-24b1-4322-98fa-ce856dd979c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:48.032425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50fac6-24b1-4322-98fa-ce856dd979c3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:48.032706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50fac6-24b1-4322-98fa-ce856dd979c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:48.032980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50fac6-24b1-4322-98fa-ce856dd979c3 None admin] PATH_INFO: `/v3/projects/2a45c85d2adf40af9a9c00c4a6ca3696` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:48.034254 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50fac6-24b1-4322-98fa-ce856dd979c3 None admin] RBAC: Authorizing `identity:get_project(project_id=2a45c85d2adf40af9a9c00c4a6ca3696)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:48.035700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50fac6-24b1-4322-98fa-ce856dd979c3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:48.037439 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 552/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:13:47 2022] GET /identity/v3/projects/2a45c85d2adf40af9a9c00c4a6ca3696 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:48.043939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30af5ba-8d4c-45cd-a42c-1ce70881fff9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:48.109843 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:48.162354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30af5ba-8d4c-45cd-a42c-1ce70881fff9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:48.204341 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6d720-c4a3-49c5-b252-9aba8a3088dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:48.205036 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6d720-c4a3-49c5-b252-9aba8a3088dd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:48.205322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6d720-c4a3-49c5-b252-9aba8a3088dd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:48.205593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6d720-c4a3-49c5-b252-9aba8a3088dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:48.206511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6d720-c4a3-49c5-b252-9aba8a3088dd None admin] RBAC: Adding query filter params (role.id=0763e374972f4ce29ab449e27fd89355, scope.project.id=2a45c85d2adf40af9a9c00c4a6ca3696, user.id=9f6433c4192345a7b42febf60d8de497) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:48.206830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6d720-c4a3-49c5-b252-9aba8a3088dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:48.208371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6d720-c4a3-49c5-b252-9aba8a3088dd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:48.215028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 565/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:13:48 2022] GET /identity/v3/role_assignments?user.id=9f6433c4192345a7b42febf60d8de497&scope.project.id=2a45c85d2adf40af9a9c00c4a6ca3696&role.id=0763e374972f4ce29ab449e27fd89355 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:50.369960 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22c1e7-e912-414a-8b98-f92c83a81684 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:50.370601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22c1e7-e912-414a-8b98-f92c83a81684 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:50.370601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22c1e7-e912-414a-8b98-f92c83a81684 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:50.372193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 553/1118] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:50.379325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e91f6-96bd-4538-9dc5-da4d35f274a6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:50.379855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e91f6-96bd-4538-9dc5-da4d35f274a6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:50.379855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e91f6-96bd-4538-9dc5-da4d35f274a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:50.398934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c91e91f6-96bd-4538-9dc5-da4d35f274a6 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:50.400218 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c91e91f6-96bd-4538-9dc5-da4d35f274a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:50.478061 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 566/1119] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:50.508321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22c1e7-e912-414a-8b98-f92c83a81684 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:50.618438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22c1e7-e912-414a-8b98-f92c83a81684 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:50.648566 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:50.663218 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4abf5-ffac-4f08-828d-6f9c7dad27ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:50.664710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4abf5-ffac-4f08-828d-6f9c7dad27ce None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:50.665175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4abf5-ffac-4f08-828d-6f9c7dad27ce None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:50.665647 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4abf5-ffac-4f08-828d-6f9c7dad27ce None admin] PATH_INFO: `/v3/roles/0763e374972f4ce29ab449e27fd89355` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:50.668232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4abf5-ffac-4f08-828d-6f9c7dad27ce None admin] RBAC: Authorizing `identity:get_role(role_id=0763e374972f4ce29ab449e27fd89355)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:50.671276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4abf5-ffac-4f08-828d-6f9c7dad27ce None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:50.673829 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 554/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:13:50 2022] GET /identity/v3/roles/0763e374972f4ce29ab449e27fd89355 => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:50.680572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e91f6-96bd-4538-9dc5-da4d35f274a6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:50.737915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:50.814117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e91f6-96bd-4538-9dc5-da4d35f274a6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:50.874489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e34b69-9019-479d-80ae-b4f2d811cd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:50.875977 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e34b69-9019-479d-80ae-b4f2d811cd31 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:50.876448 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e34b69-9019-479d-80ae-b4f2d811cd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:50.876914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e34b69-9019-479d-80ae-b4f2d811cd31 None admin] PATH_INFO: `/v3/users/9f6433c4192345a7b42febf60d8de497` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:50.879059 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e34b69-9019-479d-80ae-b4f2d811cd31 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6433c4192345a7b42febf60d8de497)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:50.881693 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e34b69-9019-479d-80ae-b4f2d811cd31 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:50.884723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 567/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:13:50 2022] GET /identity/v3/users/9f6433c4192345a7b42febf60d8de497 => generated 286 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:50.891604 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4abf5-ffac-4f08-828d-6f9c7dad27ce None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:51.003321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4abf5-ffac-4f08-828d-6f9c7dad27ce None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:51.041851 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e15e4-3775-4682-8642-22c5a6964009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:51.042773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e15e4-3775-4682-8642-22c5a6964009 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:51.043062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e15e4-3775-4682-8642-22c5a6964009 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:51.043341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e15e4-3775-4682-8642-22c5a6964009 None admin] PATH_INFO: `/v3/projects/2a45c85d2adf40af9a9c00c4a6ca3696` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:51.044647 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e15e4-3775-4682-8642-22c5a6964009 None admin] RBAC: Authorizing `identity:get_project(project_id=2a45c85d2adf40af9a9c00c4a6ca3696)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:51.046338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e15e4-3775-4682-8642-22c5a6964009 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:51.048127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 555/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:13:50 2022] GET /identity/v3/projects/2a45c85d2adf40af9a9c00c4a6ca3696 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:51.054893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e34b69-9019-479d-80ae-b4f2d811cd31 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:51.176757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e34b69-9019-479d-80ae-b4f2d811cd31 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:51.204009 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:51.221652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd2444-d5cc-4635-a0a7-40433492811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:51.222612 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd2444-d5cc-4635-a0a7-40433492811a None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:51.222899 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd2444-d5cc-4635-a0a7-40433492811a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:51.223181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd2444-d5cc-4635-a0a7-40433492811a None admin] PATH_INFO: `/v3/projects/2a45c85d2adf40af9a9c00c4a6ca3696/users/9f6433c4192345a7b42febf60d8de497/roles/0763e374972f4ce29ab449e27fd89355` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:51.225616 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd2444-d5cc-4635-a0a7-40433492811a None admin] RBAC: Authorizing `identity:create_grant(project_id=2a45c85d2adf40af9a9c00c4a6ca3696, user_id=9f6433c4192345a7b42febf60d8de497, role_id=0763e374972f4ce29ab449e27fd89355)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:51.227087 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd2444-d5cc-4635-a0a7-40433492811a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:51.243028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 568/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:13:51 2022] PUT /identity/v3/projects/2a45c85d2adf40af9a9c00c4a6ca3696/users/9f6433c4192345a7b42febf60d8de497/roles/0763e374972f4ce29ab449e27fd89355 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:13:53.422652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d674f00-6525-4f11-b655-35c3b390e188 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:53.423422 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d674f00-6525-4f11-b655-35c3b390e188 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:53.423422 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d674f00-6525-4f11-b655-35c3b390e188 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:53.424667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 556/1124] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:53.431495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f6acc-6f50-42a3-a201-54a23cdfa77e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:53.432098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f6acc-6f50-42a3-a201-54a23cdfa77e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:53.432098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f6acc-6f50-42a3-a201-54a23cdfa77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:53.450310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-453f6acc-6f50-42a3-a201-54a23cdfa77e None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:53.451573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-453f6acc-6f50-42a3-a201-54a23cdfa77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:53.563399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 569/1125] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:13:53.589576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d674f00-6525-4f11-b655-35c3b390e188 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:53.667126 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:53.713011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d674f00-6525-4f11-b655-35c3b390e188 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:53.751245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9e5a0-4f4c-4249-9afd-a550b256376a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:53.752146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9e5a0-4f4c-4249-9afd-a550b256376a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:53.752421 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9e5a0-4f4c-4249-9afd-a550b256376a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:53.752695 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9e5a0-4f4c-4249-9afd-a550b256376a None admin] PATH_INFO: `/v3/roles/0763e374972f4ce29ab449e27fd89355` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:53.754277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9e5a0-4f4c-4249-9afd-a550b256376a None admin] RBAC: Authorizing `identity:get_role(role_id=0763e374972f4ce29ab449e27fd89355)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:53.755640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9e5a0-4f4c-4249-9afd-a550b256376a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:53.757031 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 557/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:13:53 2022] GET /identity/v3/roles/0763e374972f4ce29ab449e27fd89355 => generated 223 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:53.763734 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f6acc-6f50-42a3-a201-54a23cdfa77e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:53.873681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f6acc-6f50-42a3-a201-54a23cdfa77e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:53.885517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:53.913610 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32a83d-f602-4bbe-842b-afaa454a8b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:53.914649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32a83d-f602-4bbe-842b-afaa454a8b18 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:53.914980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32a83d-f602-4bbe-842b-afaa454a8b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:53.915304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32a83d-f602-4bbe-842b-afaa454a8b18 None admin] PATH_INFO: `/v3/users/9f6433c4192345a7b42febf60d8de497` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:53.916664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32a83d-f602-4bbe-842b-afaa454a8b18 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6433c4192345a7b42febf60d8de497)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:53.918179 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32a83d-f602-4bbe-842b-afaa454a8b18 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:53.920389 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 570/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:13:53 2022] GET /identity/v3/users/9f6433c4192345a7b42febf60d8de497 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:53.929581 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9e5a0-4f4c-4249-9afd-a550b256376a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:54.051313 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9e5a0-4f4c-4249-9afd-a550b256376a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:54.082607 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:54.088964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11441ca-923e-46fe-a61f-99a0eda4c654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:54.089634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11441ca-923e-46fe-a61f-99a0eda4c654 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:54.089917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11441ca-923e-46fe-a61f-99a0eda4c654 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:54.090192 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11441ca-923e-46fe-a61f-99a0eda4c654 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:54.167075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11441ca-923e-46fe-a61f-99a0eda4c654 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:54.168533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11441ca-923e-46fe-a61f-99a0eda4c654 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:54.280448 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 558/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:13:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:13:54.286842 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32a83d-f602-4bbe-842b-afaa454a8b18 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:54.421081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32a83d-f602-4bbe-842b-afaa454a8b18 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:54.463549 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaad2d-dfe6-41d1-a541-38c416d2e21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:54.464512 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaad2d-dfe6-41d1-a541-38c416d2e21e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:54.464803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaad2d-dfe6-41d1-a541-38c416d2e21e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:54.465079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaad2d-dfe6-41d1-a541-38c416d2e21e None admin] PATH_INFO: `/v3/projects/2a45c85d2adf40af9a9c00c4a6ca3696` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:54.466729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abaad2d-dfe6-41d1-a541-38c416d2e21e None admin] RBAC: Authorizing `identity:get_project(project_id=2a45c85d2adf40af9a9c00c4a6ca3696)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:54.468258 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abaad2d-dfe6-41d1-a541-38c416d2e21e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:54.470191 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 571/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:13:54 2022] GET /identity/v3/projects/2a45c85d2adf40af9a9c00c4a6ca3696 => generated 311 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:54.480464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11441ca-923e-46fe-a61f-99a0eda4c654 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:54.532848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:54.626265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11441ca-923e-46fe-a61f-99a0eda4c654 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:54.665134 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc89865-d98e-4363-9c42-b6135e91ee5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:54.665801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc89865-d98e-4363-9c42-b6135e91ee5a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:54.666079 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc89865-d98e-4363-9c42-b6135e91ee5a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:54.666390 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc89865-d98e-4363-9c42-b6135e91ee5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:54.667251 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc89865-d98e-4363-9c42-b6135e91ee5a None admin] RBAC: Adding query filter params (role.id=0763e374972f4ce29ab449e27fd89355, scope.project.id=2a45c85d2adf40af9a9c00c4a6ca3696, user.id=9f6433c4192345a7b42febf60d8de497) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:13:54.667559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc89865-d98e-4363-9c42-b6135e91ee5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:54.669013 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc89865-d98e-4363-9c42-b6135e91ee5a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:54.676733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 559/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:13:54 2022] GET /identity/v3/role_assignments?user.id=9f6433c4192345a7b42febf60d8de497&scope.project.id=2a45c85d2adf40af9a9c00c4a6ca3696&role.id=0763e374972f4ce29ab449e27fd89355 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:56.870548 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28041cc4-be95-45e0-b6c3-b76c03b0f2d7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:56.871179 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28041cc4-be95-45e0-b6c3-b76c03b0f2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:56.871179 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28041cc4-be95-45e0-b6c3-b76c03b0f2d7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:56.872622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 572/1131] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:56.879361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9616c14-4e58-47b8-922a-161b3c3082ea None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:56.879958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9616c14-4e58-47b8-922a-161b3c3082ea None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:56.879958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9616c14-4e58-47b8-922a-161b3c3082ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:56.899103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d9616c14-4e58-47b8-922a-161b3c3082ea None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:56.900353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d9616c14-4e58-47b8-922a-161b3c3082ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:56.974683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 560/1132] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:56.999595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28041cc4-be95-45e0-b6c3-b76c03b0f2d7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:57.053150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:57.113170 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28041cc4-be95-45e0-b6c3-b76c03b0f2d7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:57.156207 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41decb7f-59dd-4b3a-be4c-aac101d6d6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:57.157098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41decb7f-59dd-4b3a-be4c-aac101d6d6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:57.157434 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41decb7f-59dd-4b3a-be4c-aac101d6d6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:57.157762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41decb7f-59dd-4b3a-be4c-aac101d6d6b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:57.159207 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41decb7f-59dd-4b3a-be4c-aac101d6d6b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:57.160772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41decb7f-59dd-4b3a-be4c-aac101d6d6b4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:57.162610 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 573/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:13:57.169392 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9616c14-4e58-47b8-922a-161b3c3082ea None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:57.199111 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:57.283870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9616c14-4e58-47b8-922a-161b3c3082ea None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:57.324435 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd66c43-504a-454f-826a-ea3ba97cd258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:57.325153 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd66c43-504a-454f-826a-ea3ba97cd258 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:57.325863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd66c43-504a-454f-826a-ea3ba97cd258 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:57.325863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd66c43-504a-454f-826a-ea3ba97cd258 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:57.326942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd66c43-504a-454f-826a-ea3ba97cd258 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:57.328468 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd66c43-504a-454f-826a-ea3ba97cd258 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:57.357060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 561/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 27 15:13:57 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:13:59.521141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66372d9d-d8fe-4c5d-b8c2-59a7c5a1daee None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:59.521141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66372d9d-d8fe-4c5d-b8c2-59a7c5a1daee None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:59.521141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66372d9d-d8fe-4c5d-b8c2-59a7c5a1daee None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:59.522277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 574/1135] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:13:59.527804 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7abda-ae18-43f0-b2bd-cec0d985c01c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:59.528329 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7abda-ae18-43f0-b2bd-cec0d985c01c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:59.528452 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7abda-ae18-43f0-b2bd-cec0d985c01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:59.547451 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c4f7abda-ae18-43f0-b2bd-cec0d985c01c None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:59.548719 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c4f7abda-ae18-43f0-b2bd-cec0d985c01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:59.625035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 562/1136] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:13:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:13:59.651502 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66372d9d-d8fe-4c5d-b8c2-59a7c5a1daee None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:59.769516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66372d9d-d8fe-4c5d-b8c2-59a7c5a1daee None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:59.789060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:59.817321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfd06e-92a3-414d-aa24-34e77bb3340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:59.818162 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfd06e-92a3-414d-aa24-34e77bb3340e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:59.818486 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfd06e-92a3-414d-aa24-34e77bb3340e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:59.818764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfd06e-92a3-414d-aa24-34e77bb3340e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:59.820199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfd06e-92a3-414d-aa24-34e77bb3340e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:59.821706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfd06e-92a3-414d-aa24-34e77bb3340e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:59.823540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 575/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:13:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:13:59.830317 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7abda-ae18-43f0-b2bd-cec0d985c01c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:59.839784 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:59.952789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7abda-ae18-43f0-b2bd-cec0d985c01c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:59.991819 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826933f-0168-4877-ba5a-d43f94047067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:59.992561 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826933f-0168-4877-ba5a-d43f94047067 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:59.992898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826933f-0168-4877-ba5a-d43f94047067 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:59.993220 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826933f-0168-4877-ba5a-d43f94047067 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:59.994002 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826933f-0168-4877-ba5a-d43f94047067 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:59.995559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826933f-0168-4877-ba5a-d43f94047067 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:00.018855 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 563/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:13:59 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:14:02.258427 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfd0fc-5887-4e58-b8a7-275b21908e32 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:02.259270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfd0fc-5887-4e58-b8a7-275b21908e32 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:02.259445 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfd0fc-5887-4e58-b8a7-275b21908e32 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:02.260854 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 576/1139] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:14:02.266918 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79b62b-1ce4-4395-8184-1efc46c9c48e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:02.267446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79b62b-1ce4-4395-8184-1efc46c9c48e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:02.267576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79b62b-1ce4-4395-8184-1efc46c9c48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:02.285984 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3d79b62b-1ce4-4395-8184-1efc46c9c48e None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:14:02.287281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3d79b62b-1ce4-4395-8184-1efc46c9c48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:02.352270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:02.364574 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 564/1140] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:14:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:14:02.389707 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfd0fc-5887-4e58-b8a7-275b21908e32 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:02.502350 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfd0fc-5887-4e58-b8a7-275b21908e32 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:02.538817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efe924-2d13-4269-9e97-e98a1b025a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:02.539628 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efe924-2d13-4269-9e97-e98a1b025a27 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:02.539911 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efe924-2d13-4269-9e97-e98a1b025a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:02.540188 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efe924-2d13-4269-9e97-e98a1b025a27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:02.551204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efe924-2d13-4269-9e97-e98a1b025a27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:14:02.559371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-79efe924-2d13-4269-9e97-e98a1b025a27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:14:02.559371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:14:02.559371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:14:02.559371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:14:02.559371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:14:02.559371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:14:02.559371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:14:02.559371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:14:02.559371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:14:02.559371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:14:02.559371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:14:02.559371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:14:02.559371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:14:02.559371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:14:02.559371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:14:02.559371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:14:02.561259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:14:02.561259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:14:02.561259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:14:02.561259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:14:02.561259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:14:02.561259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:14:02.561259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:14:02.561259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:14:02.561259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:14:02.561259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:14:02.561259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:14:02.561259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:14:02.561259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:14:02.561259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:14:02.561259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:14:02.561259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:14:02.563050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:14:02.563050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:14:02.563050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:14:02.563050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:14:02.563050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:14:02.563050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:14:02.563050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:14:02.563050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:14:02.563050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:14:02.563050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:14:02.563050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:14:02.563050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:14:02.563050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 577/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:14:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:14:02.568665 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79b62b-1ce4-4395-8184-1efc46c9c48e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:02.681884 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79b62b-1ce4-4395-8184-1efc46c9c48e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:02.720209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c16298-2912-4273-a3f4-1dbba5e1c1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:02.720960 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c16298-2912-4273-a3f4-1dbba5e1c1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:02.721292 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c16298-2912-4273-a3f4-1dbba5e1c1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:02.721615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c16298-2912-4273-a3f4-1dbba5e1c1e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:02.722464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c16298-2912-4273-a3f4-1dbba5e1c1e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:14:02.722825 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c16298-2912-4273-a3f4-1dbba5e1c1e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:02.724266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c16298-2912-4273-a3f4-1dbba5e1c1e4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:02.734127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 565/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:14:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:02.740548 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efe924-2d13-4269-9e97-e98a1b025a27 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:02.790139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:02.891590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efe924-2d13-4269-9e97-e98a1b025a27 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:02.950878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b4e08-1cbe-4655-b309-38438eea6896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:02.952430 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b4e08-1cbe-4655-b309-38438eea6896 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:02.952906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b4e08-1cbe-4655-b309-38438eea6896 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:02.953357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b4e08-1cbe-4655-b309-38438eea6896 None admin] PATH_INFO: `/v3/users/a0f11f1d22a447dbab607d1c21875ae0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:02.978497 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b4e08-1cbe-4655-b309-38438eea6896 None admin] RBAC: Authorizing `identity:get_user(user_id=a0f11f1d22a447dbab607d1c21875ae0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:02.981286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b4e08-1cbe-4655-b309-38438eea6896 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:02.985074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 578/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:14:02 2022] GET /identity/v3/users/a0f11f1d22a447dbab607d1c21875ae0 => generated 286 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:02.992036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c16298-2912-4273-a3f4-1dbba5e1c1e4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:03.092388 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:03.150095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c16298-2912-4273-a3f4-1dbba5e1c1e4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:03.190234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee72727-883c-4f98-be13-a91d5f19678d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:03.191016 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee72727-883c-4f98-be13-a91d5f19678d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:03.191353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee72727-883c-4f98-be13-a91d5f19678d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:03.191681 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee72727-883c-4f98-be13-a91d5f19678d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:03.272576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee72727-883c-4f98-be13-a91d5f19678d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:03.273979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee72727-883c-4f98-be13-a91d5f19678d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:03.337630 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:03.390002 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 566/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:14:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:14:03.396475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b4e08-1cbe-4655-b309-38438eea6896 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:03.505689 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:03.509239 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b4e08-1cbe-4655-b309-38438eea6896 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:03.548773 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b4627-d0b1-4ea9-a527-0d0910ab4d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:03.549571 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b4627-d0b1-4ea9-a527-0d0910ab4d93 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:03.549860 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b4627-d0b1-4ea9-a527-0d0910ab4d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:03.550140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b4627-d0b1-4ea9-a527-0d0910ab4d93 None admin] PATH_INFO: `/v3/projects/63e39f996a004cebaeaa8f031eb81222` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:03.551397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b4627-d0b1-4ea9-a527-0d0910ab4d93 None admin] RBAC: Authorizing `identity:get_project(project_id=63e39f996a004cebaeaa8f031eb81222)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:03.553824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b4627-d0b1-4ea9-a527-0d0910ab4d93 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:03.555726 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 579/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:14:03 2022] GET /identity/v3/projects/63e39f996a004cebaeaa8f031eb81222 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:14:03.563085 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee72727-883c-4f98-be13-a91d5f19678d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:03.684141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee72727-883c-4f98-be13-a91d5f19678d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:03.721571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb57a1a-4df9-4888-95bc-cd160ca15c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:03.722343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb57a1a-4df9-4888-95bc-cd160ca15c41 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:03.722681 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb57a1a-4df9-4888-95bc-cd160ca15c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:03.723009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb57a1a-4df9-4888-95bc-cd160ca15c41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:03.723916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb57a1a-4df9-4888-95bc-cd160ca15c41 None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=63e39f996a004cebaeaa8f031eb81222, user.id=a0f11f1d22a447dbab607d1c21875ae0) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:14:03.724283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb57a1a-4df9-4888-95bc-cd160ca15c41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:03.725794 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb57a1a-4df9-4888-95bc-cd160ca15c41 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:03.732272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 567/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:14:03 2022] GET /identity/v3/role_assignments?user.id=a0f11f1d22a447dbab607d1c21875ae0&scope.project.id=63e39f996a004cebaeaa8f031eb81222&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:05.807085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17968dd-4fde-4499-89f8-32d162b97d4f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:05.807916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17968dd-4fde-4499-89f8-32d162b97d4f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:05.807916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17968dd-4fde-4499-89f8-32d162b97d4f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:05.809154 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 580/1147] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:14:05.815253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95195dc-ae3e-4e76-80bc-f5799a60d808 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:05.815847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95195dc-ae3e-4e76-80bc-f5799a60d808 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:05.815847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95195dc-ae3e-4e76-80bc-f5799a60d808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:05.833839 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d95195dc-ae3e-4e76-80bc-f5799a60d808 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:14:05.835113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d95195dc-ae3e-4e76-80bc-f5799a60d808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:05.850748 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:05.909203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 568/1148] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:14:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:14:05.933261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17968dd-4fde-4499-89f8-32d162b97d4f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:06.045558 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17968dd-4fde-4499-89f8-32d162b97d4f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:06.085282 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50a4c2-2265-4cbf-9ad2-4bc54a0f9322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:06.086095 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50a4c2-2265-4cbf-9ad2-4bc54a0f9322 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:06.086472 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50a4c2-2265-4cbf-9ad2-4bc54a0f9322 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:06.086806 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50a4c2-2265-4cbf-9ad2-4bc54a0f9322 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:06.099885 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50a4c2-2265-4cbf-9ad2-4bc54a0f9322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:14:06.108093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-bb50a4c2-2265-4cbf-9ad2-4bc54a0f9322 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:14:06.108093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:14:06.108093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:14:06.108093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:14:06.108093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:14:06.108093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:14:06.108093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:14:06.108093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:14:06.108093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:14:06.108093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:14:06.108093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:14:06.108093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:14:06.108093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:14:06.108093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:14:06.108093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:14:06.108093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:14:06.109811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:14:06.109811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:14:06.109811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:14:06.109811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:14:06.109811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:14:06.109811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:14:06.109811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:14:06.109811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:14:06.109811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:14:06.109811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:14:06.109811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:14:06.109811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:14:06.109811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:14:06.109811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:14:06.109811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:14:06.109811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:14:06.111064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:14:06.111064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:14:06.111064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:14:06.111064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:14:06.111064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:14:06.111064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:14:06.111064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:14:06.111064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:14:06.111064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:14:06.111064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:14:06.111064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:14:06.111064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:14:06.111064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 581/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:14:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:14:06.118952 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95195dc-ae3e-4e76-80bc-f5799a60d808 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:06.239961 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95195dc-ae3e-4e76-80bc-f5799a60d808 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:06.276420 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ba1bf-061f-4fc6-8744-dcd5d672a418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:06.277101 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ba1bf-061f-4fc6-8744-dcd5d672a418 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:06.277386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ba1bf-061f-4fc6-8744-dcd5d672a418 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:06.277667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ba1bf-061f-4fc6-8744-dcd5d672a418 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:06.278613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ba1bf-061f-4fc6-8744-dcd5d672a418 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:14:06.279102 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ba1bf-061f-4fc6-8744-dcd5d672a418 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:06.280533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ba1bf-061f-4fc6-8744-dcd5d672a418 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:06.289702 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 569/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:14:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:06.296046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50a4c2-2265-4cbf-9ad2-4bc54a0f9322 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:06.328067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:06.408669 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50a4c2-2265-4cbf-9ad2-4bc54a0f9322 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:06.444648 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f0625-1316-48d2-89b5-ff62b1085f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:06.445538 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f0625-1316-48d2-89b5-ff62b1085f6e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:06.445795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f0625-1316-48d2-89b5-ff62b1085f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:06.446105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f0625-1316-48d2-89b5-ff62b1085f6e None admin] PATH_INFO: `/v3/users/a0f11f1d22a447dbab607d1c21875ae0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:06.447389 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f0625-1316-48d2-89b5-ff62b1085f6e None admin] RBAC: Authorizing `identity:get_user(user_id=a0f11f1d22a447dbab607d1c21875ae0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:06.448839 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f0625-1316-48d2-89b5-ff62b1085f6e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:06.450666 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 582/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:14:06 2022] GET /identity/v3/users/a0f11f1d22a447dbab607d1c21875ae0 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:06.456772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ba1bf-061f-4fc6-8744-dcd5d672a418 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:06.471083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:06.567113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ba1bf-061f-4fc6-8744-dcd5d672a418 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:06.603492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554094ae-307c-486a-a814-40e76f5198e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:06.604359 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554094ae-307c-486a-a814-40e76f5198e8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:06.604644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554094ae-307c-486a-a814-40e76f5198e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:06.605093 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554094ae-307c-486a-a814-40e76f5198e8 None admin] PATH_INFO: `/v3/projects/63e39f996a004cebaeaa8f031eb81222` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:06.606365 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554094ae-307c-486a-a814-40e76f5198e8 None admin] RBAC: Authorizing `identity:get_project(project_id=63e39f996a004cebaeaa8f031eb81222)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:06.607887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554094ae-307c-486a-a814-40e76f5198e8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:06.609631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 570/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:14:06 2022] GET /identity/v3/projects/63e39f996a004cebaeaa8f031eb81222 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:06.615837 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f0625-1316-48d2-89b5-ff62b1085f6e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:06.719722 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:06.726259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f0625-1316-48d2-89b5-ff62b1085f6e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:06.763997 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc3fe9-c157-48d7-84d3-28cd28ad29b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:06.764925 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc3fe9-c157-48d7-84d3-28cd28ad29b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:06.765209 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc3fe9-c157-48d7-84d3-28cd28ad29b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:06.765488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc3fe9-c157-48d7-84d3-28cd28ad29b8 None admin] PATH_INFO: `/v3/projects/63e39f996a004cebaeaa8f031eb81222/users/a0f11f1d22a447dbab607d1c21875ae0/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:06.767879 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc3fe9-c157-48d7-84d3-28cd28ad29b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=63e39f996a004cebaeaa8f031eb81222, user_id=a0f11f1d22a447dbab607d1c21875ae0, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:06.769354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc3fe9-c157-48d7-84d3-28cd28ad29b8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:06.785426 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 583/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:14:06 2022] PUT /identity/v3/projects/63e39f996a004cebaeaa8f031eb81222/users/a0f11f1d22a447dbab607d1c21875ae0/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:14:08.968162 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3357eb-cd60-4fa2-a707-de68bf22babc None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:08.968733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3357eb-cd60-4fa2-a707-de68bf22babc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:08.968733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3357eb-cd60-4fa2-a707-de68bf22babc None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:08.970088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 571/1154] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:14:08.976004 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ceeaa9-5281-4439-8903-b517b8addafd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:08.976474 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ceeaa9-5281-4439-8903-b517b8addafd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:08.976641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ceeaa9-5281-4439-8903-b517b8addafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:08.995354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-09ceeaa9-5281-4439-8903-b517b8addafd None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:14:08.996595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-09ceeaa9-5281-4439-8903-b517b8addafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:09.084845 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 584/1155] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:14:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:14:09.109025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3357eb-cd60-4fa2-a707-de68bf22babc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:09.241633 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:09.281416 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3357eb-cd60-4fa2-a707-de68bf22babc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:09.341174 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dded4-73b3-4aa9-a0dd-ea86dcfdbdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:09.342609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dded4-73b3-4aa9-a0dd-ea86dcfdbdff None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:09.343112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dded4-73b3-4aa9-a0dd-ea86dcfdbdff None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:09.343609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dded4-73b3-4aa9-a0dd-ea86dcfdbdff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:09.359734 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dded4-73b3-4aa9-a0dd-ea86dcfdbdff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:14:09.367432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e31dded4-73b3-4aa9-a0dd-ea86dcfdbdff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:14:09.367432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:14:09.367432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:14:09.367432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:14:09.367432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:14:09.367432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:14:09.367432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:14:09.367432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:14:09.367432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:14:09.367432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:14:09.367432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:14:09.367432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:14:09.367432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:14:09.367432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:14:09.367432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:14:09.367432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:14:09.369234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:14:09.369234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:14:09.369234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:14:09.369234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:14:09.369234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:14:09.369234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:14:09.369234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:14:09.369234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:14:09.369234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:14:09.369234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:14:09.369234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:14:09.369234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:14:09.369234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:14:09.369234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:14:09.369234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:14:09.369234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:14:09.371163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:14:09.371163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:14:09.371163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:14:09.371163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:14:09.371163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:14:09.371163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:14:09.371163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:14:09.371163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:14:09.371163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:14:09.371163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:14:09.371163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:14:09.371163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:14:09.371163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 572/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:14:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:14:09.376859 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ceeaa9-5281-4439-8903-b517b8addafd None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:09.511506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:09.538766 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ceeaa9-5281-4439-8903-b517b8addafd None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:09.599469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75c25a-6006-4864-a0fd-a88a2936c722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:09.602186 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75c25a-6006-4864-a0fd-a88a2936c722 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:09.602716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75c25a-6006-4864-a0fd-a88a2936c722 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:09.603214 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75c25a-6006-4864-a0fd-a88a2936c722 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:09.604605 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75c25a-6006-4864-a0fd-a88a2936c722 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:14:09.605152 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75c25a-6006-4864-a0fd-a88a2936c722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:09.607940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75c25a-6006-4864-a0fd-a88a2936c722 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:09.623496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 585/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:14:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:09.629731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dded4-73b3-4aa9-a0dd-ea86dcfdbdff None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:09.739642 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dded4-73b3-4aa9-a0dd-ea86dcfdbdff None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:09.776452 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdfe6c-bfc2-4933-b2a0-0ba17d9478f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:09.777258 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdfe6c-bfc2-4933-b2a0-0ba17d9478f3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:09.777544 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdfe6c-bfc2-4933-b2a0-0ba17d9478f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:09.777824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdfe6c-bfc2-4933-b2a0-0ba17d9478f3 None admin] PATH_INFO: `/v3/users/a0f11f1d22a447dbab607d1c21875ae0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:09.779153 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdfe6c-bfc2-4933-b2a0-0ba17d9478f3 None admin] RBAC: Authorizing `identity:get_user(user_id=a0f11f1d22a447dbab607d1c21875ae0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:09.780611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdfe6c-bfc2-4933-b2a0-0ba17d9478f3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:09.782333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 573/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:14:09 2022] GET /identity/v3/users/a0f11f1d22a447dbab607d1c21875ae0 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:09.788506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75c25a-6006-4864-a0fd-a88a2936c722 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:09.916804 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75c25a-6006-4864-a0fd-a88a2936c722 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:09.980753 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57caf1-2947-4a04-b13c-9ceb8e47fe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:09.981945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57caf1-2947-4a04-b13c-9ceb8e47fe29 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:09.982503 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57caf1-2947-4a04-b13c-9ceb8e47fe29 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:09.983004 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57caf1-2947-4a04-b13c-9ceb8e47fe29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:10.015174 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:10.102576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57caf1-2947-4a04-b13c-9ceb8e47fe29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:10.105171 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57caf1-2947-4a04-b13c-9ceb8e47fe29 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:10.213552 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 586/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:14:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 27 15:14:10.220250 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdfe6c-bfc2-4933-b2a0-0ba17d9478f3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:10.230751 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:10.348935 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdfe6c-bfc2-4933-b2a0-0ba17d9478f3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:10.414592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4ef0d-3e2b-41bb-8cf0-31e871887675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:10.416010 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4ef0d-3e2b-41bb-8cf0-31e871887675 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:10.416446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4ef0d-3e2b-41bb-8cf0-31e871887675 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:10.416736 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4ef0d-3e2b-41bb-8cf0-31e871887675 None admin] PATH_INFO: `/v3/projects/63e39f996a004cebaeaa8f031eb81222` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:10.418128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4ef0d-3e2b-41bb-8cf0-31e871887675 None admin] RBAC: Authorizing `identity:get_project(project_id=63e39f996a004cebaeaa8f031eb81222)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:10.420089 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4ef0d-3e2b-41bb-8cf0-31e871887675 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:10.421900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 574/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:14:10 2022] GET /identity/v3/projects/63e39f996a004cebaeaa8f031eb81222 => generated 311 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:10.428769 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57caf1-2947-4a04-b13c-9ceb8e47fe29 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:10.483384 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:10.538482 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57caf1-2947-4a04-b13c-9ceb8e47fe29 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:10.576890 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252f22d-0efd-4243-a889-294cfc0118c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:10.577563 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252f22d-0efd-4243-a889-294cfc0118c9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:10.577849 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252f22d-0efd-4243-a889-294cfc0118c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:10.578128 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252f22d-0efd-4243-a889-294cfc0118c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:10.579016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252f22d-0efd-4243-a889-294cfc0118c9 None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=63e39f996a004cebaeaa8f031eb81222, user.id=a0f11f1d22a447dbab607d1c21875ae0) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:14:10.579333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252f22d-0efd-4243-a889-294cfc0118c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:10.580794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252f22d-0efd-4243-a889-294cfc0118c9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:10.587699 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 587/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:14:10 2022] GET /identity/v3/role_assignments?user.id=a0f11f1d22a447dbab607d1c21875ae0&scope.project.id=63e39f996a004cebaeaa8f031eb81222&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:12.720602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca31cb-7bb0-411f-a29c-2038659620df None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:12.721145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca31cb-7bb0-411f-a29c-2038659620df None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:12.721239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca31cb-7bb0-411f-a29c-2038659620df None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:12.722741 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 575/1162] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:14:12.728621 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fe7ca-b409-4821-a1e3-91887aa727ca None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:12.729110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fe7ca-b409-4821-a1e3-91887aa727ca None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:12.729209 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fe7ca-b409-4821-a1e3-91887aa727ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:12.748456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f84fe7ca-b409-4821-a1e3-91887aa727ca None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:14:12.749695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f84fe7ca-b409-4821-a1e3-91887aa727ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:12.825562 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 588/1163] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:14:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:14:12.849101 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca31cb-7bb0-411f-a29c-2038659620df None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:12.932574 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:12.961678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca31cb-7bb0-411f-a29c-2038659620df None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:12.999357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3309e-5409-4f58-9e04-06fd68e25947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:12.999941 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3309e-5409-4f58-9e04-06fd68e25947 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:13.000222 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3309e-5409-4f58-9e04-06fd68e25947 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:13.000499 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3309e-5409-4f58-9e04-06fd68e25947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:13.075437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3309e-5409-4f58-9e04-06fd68e25947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:13.076932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3309e-5409-4f58-9e04-06fd68e25947 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:13.161413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:13.191771 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 576/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:14:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:14:13.198217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fe7ca-b409-4821-a1e3-91887aa727ca None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:13.247994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:13.319834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fe7ca-b409-4821-a1e3-91887aa727ca None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:13.357716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291cd85-60b5-4dcb-811d-8984ebb58c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:13.358646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291cd85-60b5-4dcb-811d-8984ebb58c47 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:13.358980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291cd85-60b5-4dcb-811d-8984ebb58c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:13.359305 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291cd85-60b5-4dcb-811d-8984ebb58c47 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:13.366885 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291cd85-60b5-4dcb-811d-8984ebb58c47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:13.368348 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291cd85-60b5-4dcb-811d-8984ebb58c47 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8291cd85-60b5-4dcb-811d-8984ebb58c47 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:14:13.383423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:14:13.385449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:14:13.385449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:14:13.385449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:14:13.385449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:14:13.385449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:14:13.385449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:14:13.385449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:14:13.385449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:14:13.385449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:14:13.385449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:14:13.385449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:14:13.385449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:14:13.385449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:14:13.385449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:14:13.385449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:14:13.385449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:14:13.387193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:14:13.387193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:14:13.387193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:14:13.387193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:14:13.387193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:14:13.387193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:14:13.387193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:14:13.387193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:14:13.387193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:14:13.387193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:14:13.387193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 27 15:14:13.387193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:14:13.387193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 27 15:14:13.387193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:14:13.387193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 589/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 27 15:14:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:14:13.392959 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3309e-5409-4f58-9e04-06fd68e25947 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:13.499907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3309e-5409-4f58-9e04-06fd68e25947 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:13.536224 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc7d4d-0abe-4fc2-98e8-bbb33be338c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:13.536897 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc7d4d-0abe-4fc2-98e8-bbb33be338c4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:13.537174 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc7d4d-0abe-4fc2-98e8-bbb33be338c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:13.537450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc7d4d-0abe-4fc2-98e8-bbb33be338c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:13.538185 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc7d4d-0abe-4fc2-98e8-bbb33be338c4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:14:13.538522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc7d4d-0abe-4fc2-98e8-bbb33be338c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:13.539897 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc7d4d-0abe-4fc2-98e8-bbb33be338c4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:13.548433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 577/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Jun 27 15:14:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:14:15.623009 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b96c68-48c7-4a79-8ea7-1a04ffbe59df None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:15.623608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b96c68-48c7-4a79-8ea7-1a04ffbe59df None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:15.623608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b96c68-48c7-4a79-8ea7-1a04ffbe59df None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:15.624918 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 590/1167] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:14:15.634407 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39f1f0-b515-4696-847c-0f2b03909c1d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:15.634922 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39f1f0-b515-4696-847c-0f2b03909c1d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:15.635404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39f1f0-b515-4696-847c-0f2b03909c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:15.672317 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bd39f1f0-b515-4696-847c-0f2b03909c1d None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:14:15.674424 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bd39f1f0-b515-4696-847c-0f2b03909c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:15.729370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:15.801747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 578/1168] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:14:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:14:15.825932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b96c68-48c7-4a79-8ea7-1a04ffbe59df None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:15.947649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b96c68-48c7-4a79-8ea7-1a04ffbe59df None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:15.949486 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:15.992951 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5e3a7-52d7-40db-aedf-bfc781f06aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:15.993627 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5e3a7-52d7-40db-aedf-bfc781f06aff None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:15.993914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5e3a7-52d7-40db-aedf-bfc781f06aff None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:15.994197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5e3a7-52d7-40db-aedf-bfc781f06aff None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:15.994995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5e3a7-52d7-40db-aedf-bfc781f06aff None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:15.996384 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5e3a7-52d7-40db-aedf-bfc781f06aff None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:16.017986 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 591/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Mon Jun 27 15:14:15 2022] POST /identity/v3/domains => generated 267 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:14:18.126902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46eaae-74b7-4cb3-9717-846be3606d7f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:18.127729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46eaae-74b7-4cb3-9717-846be3606d7f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:18.127729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46eaae-74b7-4cb3-9717-846be3606d7f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:18.128921 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 579/1170] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:14:18.134586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bfe81-ef57-4aff-a00c-1f92016f16ca None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:18.135026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bfe81-ef57-4aff-a00c-1f92016f16ca None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:18.135137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bfe81-ef57-4aff-a00c-1f92016f16ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:18.153944 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fb2bfe81-ef57-4aff-a00c-1f92016f16ca None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:14:18.155003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fb2bfe81-ef57-4aff-a00c-1f92016f16ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:18.225892 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 592/1171] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:14:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:14:18.251025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46eaae-74b7-4cb3-9717-846be3606d7f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:18.361112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46eaae-74b7-4cb3-9717-846be3606d7f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:18.398528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4d53b-eeff-462e-b876-3be2f9339a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:18.399321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4d53b-eeff-462e-b876-3be2f9339a62 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:18.399603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4d53b-eeff-462e-b876-3be2f9339a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:18.399881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4d53b-eeff-462e-b876-3be2f9339a62 None admin] PATH_INFO: `/v3/domains/152d6c62176d49b988d64ee955feb6a3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:18.412360 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4d53b-eeff-462e-b876-3be2f9339a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=152d6c62176d49b988d64ee955feb6a3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:18.414260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4d53b-eeff-462e-b876-3be2f9339a62 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:18.416040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 580/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Mon Jun 27 15:14:18 2022] GET /identity/v3/domains/152d6c62176d49b988d64ee955feb6a3 => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:18.422555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bfe81-ef57-4aff-a00c-1f92016f16ca None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:18.520046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:18.531108 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bfe81-ef57-4aff-a00c-1f92016f16ca None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:18.569472 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90260d2-f8b8-42aa-8faf-40a15c485b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:18.570177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90260d2-f8b8-42aa-8faf-40a15c485b77 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:18.570502 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90260d2-f8b8-42aa-8faf-40a15c485b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:18.570783 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90260d2-f8b8-42aa-8faf-40a15c485b77 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:18.571555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90260d2-f8b8-42aa-8faf-40a15c485b77 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:18.573088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90260d2-f8b8-42aa-8faf-40a15c485b77 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:18.602318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 593/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 27 15:14:18 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:14:20.775752 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3c532-da08-4313-b54c-475ddcbabbdc None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:20.776362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3c532-da08-4313-b54c-475ddcbabbdc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:20.776596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3c532-da08-4313-b54c-475ddcbabbdc None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:20.778881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 581/1174] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:14:20.784747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b57480-c898-448a-ba53-d06d170477ac None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:20.785272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b57480-c898-448a-ba53-d06d170477ac None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:20.785272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b57480-c898-448a-ba53-d06d170477ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:20.804080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-91b57480-c898-448a-ba53-d06d170477ac None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:14:20.805252 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-91b57480-c898-448a-ba53-d06d170477ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:20.882026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 594/1175] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:14:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:14:20.908031 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3c532-da08-4313-b54c-475ddcbabbdc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:20.940788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:21.019792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3c532-da08-4313-b54c-475ddcbabbdc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:21.058669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c10c07-7a9c-45e3-acb6-8675bae5b33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:21.059742 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c10c07-7a9c-45e3-acb6-8675bae5b33b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:21.060053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c10c07-7a9c-45e3-acb6-8675bae5b33b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:21.060268 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c10c07-7a9c-45e3-acb6-8675bae5b33b None admin] PATH_INFO: `/v3/domains/152d6c62176d49b988d64ee955feb6a3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:21.061536 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c10c07-7a9c-45e3-acb6-8675bae5b33b None admin] RBAC: Authorizing `identity:get_domain(domain_id=152d6c62176d49b988d64ee955feb6a3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:21.063000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c10c07-7a9c-45e3-acb6-8675bae5b33b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:21.064678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 582/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Mon Jun 27 15:14:20 2022] GET /identity/v3/domains/152d6c62176d49b988d64ee955feb6a3 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:21.070772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b57480-c898-448a-ba53-d06d170477ac None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:21.150829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:21.178318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b57480-c898-448a-ba53-d06d170477ac None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:21.214817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf45738-28b3-4867-a91f-1d19ae4414cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:21.215525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf45738-28b3-4867-a91f-1d19ae4414cc None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:21.215813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf45738-28b3-4867-a91f-1d19ae4414cc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:21.216092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf45738-28b3-4867-a91f-1d19ae4414cc None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:21.216819 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf45738-28b3-4867-a91f-1d19ae4414cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:21.218271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf45738-28b3-4867-a91f-1d19ae4414cc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:21.240889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 595/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:14:21 2022] POST /identity/v3/users => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:14:23.369316 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0fc97-d3e8-429f-9e22-63ad01b15373 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:23.369955 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0fc97-d3e8-429f-9e22-63ad01b15373 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:23.369955 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0fc97-d3e8-429f-9e22-63ad01b15373 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:23.371270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 583/1178] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:14:23.377225 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5c287-05b7-4880-9b08-db0178f0d72b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:23.378012 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5c287-05b7-4880-9b08-db0178f0d72b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:23.378012 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5c287-05b7-4880-9b08-db0178f0d72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:23.396107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-85b5c287-05b7-4880-9b08-db0178f0d72b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:14:23.397326 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-85b5c287-05b7-4880-9b08-db0178f0d72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:23.470430 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 596/1179] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:14:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:14:23.494793 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0fc97-d3e8-429f-9e22-63ad01b15373 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:23.610080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:23.618253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0fc97-d3e8-429f-9e22-63ad01b15373 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:23.657900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c00de2-6e91-4063-8cb2-428563d2e153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:23.658666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c00de2-6e91-4063-8cb2-428563d2e153 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:23.658956 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c00de2-6e91-4063-8cb2-428563d2e153 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:23.659237 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c00de2-6e91-4063-8cb2-428563d2e153 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:23.670725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c00de2-6e91-4063-8cb2-428563d2e153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:14:23.678729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-71c00de2-6e91-4063-8cb2-428563d2e153 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:14:23.678729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:14:23.678729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:14:23.678729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:14:23.678729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:14:23.678729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:14:23.678729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:14:23.678729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:14:23.678729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:14:23.678729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:14:23.678729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:14:23.678729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:14:23.678729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:14:23.678729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:14:23.678729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:14:23.678729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:14:23.680455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:14:23.680455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:14:23.680455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:14:23.680455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:14:23.680455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:14:23.680455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:14:23.680455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:14:23.680455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:14:23.680455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:14:23.680455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:14:23.680455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:14:23.680455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:14:23.680455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:14:23.680455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:14:23.680455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:14:23.680455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:14:23.681701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:14:23.681701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:14:23.681701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:14:23.681701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:14:23.681701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:14:23.681701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:14:23.681701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:14:23.681701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:14:23.681701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:14:23.681701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:14:23.681701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:14:23.681701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:14:23.681701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 584/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:14:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:14:23.686336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5c287-05b7-4880-9b08-db0178f0d72b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:23.749781 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:23.821853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5c287-05b7-4880-9b08-db0178f0d72b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:23.860413 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864e3c2-c17f-453a-908c-78e965937dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:23.861097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864e3c2-c17f-453a-908c-78e965937dcd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:23.861375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864e3c2-c17f-453a-908c-78e965937dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:23.861647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864e3c2-c17f-453a-908c-78e965937dcd None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:23.862431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864e3c2-c17f-453a-908c-78e965937dcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:14:23.862741 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864e3c2-c17f-453a-908c-78e965937dcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:23.864106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864e3c2-c17f-453a-908c-78e965937dcd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:23.872958 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 597/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:14:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:23.879169 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c00de2-6e91-4063-8cb2-428563d2e153 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:23.989072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c00de2-6e91-4063-8cb2-428563d2e153 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:24.024797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee06901-a8bc-45e8-870c-58c664ec1afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:24.025691 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee06901-a8bc-45e8-870c-58c664ec1afb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:24.025976 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee06901-a8bc-45e8-870c-58c664ec1afb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:24.026259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee06901-a8bc-45e8-870c-58c664ec1afb None admin] PATH_INFO: `/v3/users/a7e87f86dac1449c8a99b222ee9d4911` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:24.040706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee06901-a8bc-45e8-870c-58c664ec1afb None admin] RBAC: Authorizing `identity:get_user(user_id=a7e87f86dac1449c8a99b222ee9d4911)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:24.042192 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee06901-a8bc-45e8-870c-58c664ec1afb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:24.044273 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 585/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:14:23 2022] GET /identity/v3/users/a7e87f86dac1449c8a99b222ee9d4911 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:24.050659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864e3c2-c17f-453a-908c-78e965937dcd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:24.170701 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864e3c2-c17f-453a-908c-78e965937dcd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:24.196808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:24.211599 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611975c-b53f-4345-8542-126dc1a4b14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:24.212273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611975c-b53f-4345-8542-126dc1a4b14d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:24.212557 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611975c-b53f-4345-8542-126dc1a4b14d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:24.212830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611975c-b53f-4345-8542-126dc1a4b14d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:24.286662 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611975c-b53f-4345-8542-126dc1a4b14d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:24.288058 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611975c-b53f-4345-8542-126dc1a4b14d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:24.390250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 598/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:14:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:14:24.396575 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee06901-a8bc-45e8-870c-58c664ec1afb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:24.413348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:24.501693 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee06901-a8bc-45e8-870c-58c664ec1afb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:24.536876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d230995-42c1-424b-acb3-10fd6865206a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:24.537653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d230995-42c1-424b-acb3-10fd6865206a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:24.537934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d230995-42c1-424b-acb3-10fd6865206a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:24.538209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d230995-42c1-424b-acb3-10fd6865206a None admin] PATH_INFO: `/v3/projects/72ff565e49b942389482cd97e70f9e45` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:24.539480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d230995-42c1-424b-acb3-10fd6865206a None admin] RBAC: Authorizing `identity:get_project(project_id=72ff565e49b942389482cd97e70f9e45)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:24.540932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d230995-42c1-424b-acb3-10fd6865206a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:24.542695 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 586/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:14:24 2022] GET /identity/v3/projects/72ff565e49b942389482cd97e70f9e45 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:24.549535 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611975c-b53f-4345-8542-126dc1a4b14d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:24.577507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:24.665188 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611975c-b53f-4345-8542-126dc1a4b14d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:24.706800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f08fb7-a5b3-47d1-b315-54cb36b3991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:24.707472 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f08fb7-a5b3-47d1-b315-54cb36b3991e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:24.707757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f08fb7-a5b3-47d1-b315-54cb36b3991e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:24.708035 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f08fb7-a5b3-47d1-b315-54cb36b3991e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:24.708872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f08fb7-a5b3-47d1-b315-54cb36b3991e None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=72ff565e49b942389482cd97e70f9e45, user.id=a7e87f86dac1449c8a99b222ee9d4911) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:14:24.709188 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f08fb7-a5b3-47d1-b315-54cb36b3991e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:24.710653 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f08fb7-a5b3-47d1-b315-54cb36b3991e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:24.716709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 599/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:14:24 2022] GET /identity/v3/role_assignments?user.id=a7e87f86dac1449c8a99b222ee9d4911&scope.project.id=72ff565e49b942389482cd97e70f9e45&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:26.891790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a2b6f-2a59-4529-aebb-b6af7a983a1d None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:26.892417 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a2b6f-2a59-4529-aebb-b6af7a983a1d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:26.892417 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a2b6f-2a59-4529-aebb-b6af7a983a1d None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:26.893736 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 587/1186] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:14:26.899622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc72cc7-06e6-485d-91dc-ab8b41406729 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:26.900133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc72cc7-06e6-485d-91dc-ab8b41406729 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:26.900270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc72cc7-06e6-485d-91dc-ab8b41406729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:26.919766 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ddc72cc7-06e6-485d-91dc-ab8b41406729 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:14:26.921064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ddc72cc7-06e6-485d-91dc-ab8b41406729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:27.000244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 600/1187] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:14:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:14:27.023591 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a2b6f-2a59-4529-aebb-b6af7a983a1d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:27.128506 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:27.155116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a2b6f-2a59-4529-aebb-b6af7a983a1d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:27.201089 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ae409-48bb-4ef5-a0f5-84ec397eeaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:27.201918 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae409-48bb-4ef5-a0f5-84ec397eeaac None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:27.202205 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae409-48bb-4ef5-a0f5-84ec397eeaac None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:27.202519 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae409-48bb-4ef5-a0f5-84ec397eeaac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:27.219124 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ae409-48bb-4ef5-a0f5-84ec397eeaac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:14:27.227902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-890ae409-48bb-4ef5-a0f5-84ec397eeaac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:14:27.227902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:14:27.227902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:14:27.227902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:14:27.227902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:14:27.227902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:14:27.227902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:14:27.227902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:14:27.227902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:14:27.227902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:14:27.227902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:14:27.227902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:14:27.227902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:14:27.227902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:14:27.227902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:14:27.227902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:14:27.229030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:14:27.229030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:14:27.229030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:14:27.229030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:14:27.229030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:14:27.229030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:14:27.229030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:14:27.229030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:14:27.229030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:14:27.229030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:14:27.229030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:14:27.229030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:14:27.229030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:14:27.229030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:14:27.229030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:14:27.229030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:14:27.229933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:14:27.229933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:14:27.229933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:14:27.229933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:14:27.229933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:14:27.229933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:14:27.229933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:14:27.229933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:14:27.229933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:14:27.229933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:14:27.229933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:14:27.229933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:14:27.229933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 588/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:14:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:14:27.237860 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc72cc7-06e6-485d-91dc-ab8b41406729 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:27.260582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:27.378240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc72cc7-06e6-485d-91dc-ab8b41406729 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:27.416237 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97ce9b-d9d3-4d73-9b93-bf653fc21443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:27.416835 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97ce9b-d9d3-4d73-9b93-bf653fc21443 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:27.417122 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97ce9b-d9d3-4d73-9b93-bf653fc21443 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:27.417404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97ce9b-d9d3-4d73-9b93-bf653fc21443 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:27.418275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97ce9b-d9d3-4d73-9b93-bf653fc21443 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:14:27.418601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97ce9b-d9d3-4d73-9b93-bf653fc21443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:27.420020 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97ce9b-d9d3-4d73-9b93-bf653fc21443 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:27.430071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 601/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:14:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:27.437584 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ae409-48bb-4ef5-a0f5-84ec397eeaac None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:27.566398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ae409-48bb-4ef5-a0f5-84ec397eeaac None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:27.627034 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e1a6d-24c4-4512-9e56-084d1e25a891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:27.628282 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e1a6d-24c4-4512-9e56-084d1e25a891 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:27.628787 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e1a6d-24c4-4512-9e56-084d1e25a891 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:27.629284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e1a6d-24c4-4512-9e56-084d1e25a891 None admin] PATH_INFO: `/v3/users/a7e87f86dac1449c8a99b222ee9d4911` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:27.631391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e1a6d-24c4-4512-9e56-084d1e25a891 None admin] RBAC: Authorizing `identity:get_user(user_id=a7e87f86dac1449c8a99b222ee9d4911)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:27.634007 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e1a6d-24c4-4512-9e56-084d1e25a891 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:27.637571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 589/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:14:27 2022] GET /identity/v3/users/a7e87f86dac1449c8a99b222ee9d4911 => generated 311 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:27.644121 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97ce9b-d9d3-4d73-9b93-bf653fc21443 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:27.746904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:27.774103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97ce9b-d9d3-4d73-9b93-bf653fc21443 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:27.813866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4f2b9-d512-4501-b74e-3b5cde8757e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:27.814861 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4f2b9-d512-4501-b74e-3b5cde8757e8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:27.815152 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4f2b9-d512-4501-b74e-3b5cde8757e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:27.815433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4f2b9-d512-4501-b74e-3b5cde8757e8 None admin] PATH_INFO: `/v3/projects/72ff565e49b942389482cd97e70f9e45` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:27.816765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4f2b9-d512-4501-b74e-3b5cde8757e8 None admin] RBAC: Authorizing `identity:get_project(project_id=72ff565e49b942389482cd97e70f9e45)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:27.818305 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4f2b9-d512-4501-b74e-3b5cde8757e8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:27.820085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 602/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:14:27 2022] GET /identity/v3/projects/72ff565e49b942389482cd97e70f9e45 => generated 361 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:27.827858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e1a6d-24c4-4512-9e56-084d1e25a891 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:27.848354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:27.956968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e1a6d-24c4-4512-9e56-084d1e25a891 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:27.994178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4ff4d-5219-424c-a0d6-d448223c000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:27.995158 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4ff4d-5219-424c-a0d6-d448223c000d None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:27.995432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4ff4d-5219-424c-a0d6-d448223c000d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:27.995697 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4ff4d-5219-424c-a0d6-d448223c000d None admin] PATH_INFO: `/v3/projects/72ff565e49b942389482cd97e70f9e45/users/a7e87f86dac1449c8a99b222ee9d4911/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:27.998010 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4ff4d-5219-424c-a0d6-d448223c000d None admin] RBAC: Authorizing `identity:create_grant(project_id=72ff565e49b942389482cd97e70f9e45, user_id=a7e87f86dac1449c8a99b222ee9d4911, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:27.999493 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4ff4d-5219-424c-a0d6-d448223c000d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:28.022984 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 590/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:14:27 2022] PUT /identity/v3/projects/72ff565e49b942389482cd97e70f9e45/users/a7e87f86dac1449c8a99b222ee9d4911/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:14:30.123516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2211ae9-5962-49b5-b049-1d3baf32414b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:30.124062 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2211ae9-5962-49b5-b049-1d3baf32414b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:30.124062 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2211ae9-5962-49b5-b049-1d3baf32414b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:30.125680 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 603/1193] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:14:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:14:30.131799 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2811b-dcb0-4230-b7f5-326f392c9e71 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:30.132335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2811b-dcb0-4230-b7f5-326f392c9e71 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:30.132335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2811b-dcb0-4230-b7f5-326f392c9e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:30.150411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a2b2811b-dcb0-4230-b7f5-326f392c9e71 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:14:30.151645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a2b2811b-dcb0-4230-b7f5-326f392c9e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:30.220107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:30.225919 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 591/1194] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:14:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:14:30.250430 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2211ae9-5962-49b5-b049-1d3baf32414b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:30.376342 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2211ae9-5962-49b5-b049-1d3baf32414b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:30.420210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd1c86-b86f-4d77-a485-5065859645ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:30.421040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd1c86-b86f-4d77-a485-5065859645ef None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:30.421319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd1c86-b86f-4d77-a485-5065859645ef None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:30.421591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd1c86-b86f-4d77-a485-5065859645ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:30.436457 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd1c86-b86f-4d77-a485-5065859645ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:14:30.444257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-61fd1c86-b86f-4d77-a485-5065859645ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:14:30.444257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:14:30.444257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:14:30.444257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:14:30.444257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:14:30.444257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:14:30.444257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:14:30.444257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:14:30.444257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:14:30.444257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:14:30.444257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:14:30.444257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:14:30.444257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:14:30.444257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:14:30.444257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:14:30.444257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:14:30.445567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:14:30.445567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:14:30.445567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:14:30.445567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:14:30.445567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:14:30.445567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:14:30.445567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:14:30.445567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:14:30.445567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:14:30.445567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:14:30.445567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:14:30.445567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:14:30.445567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:14:30.445567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:14:30.445567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:14:30.445567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:14:30.446652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:14:30.446652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:14:30.446652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:14:30.446652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:14:30.446652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:14:30.446652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:14:30.446652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:14:30.446652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:14:30.446652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:14:30.446652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:14:30.446652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:14:30.446652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:14:30.446652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 604/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:14:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:14:30.452486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2811b-dcb0-4230-b7f5-326f392c9e71 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:30.590938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2811b-dcb0-4230-b7f5-326f392c9e71 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:30.631731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec9b59-aae0-4c03-b565-62de44baaf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:30.632322 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec9b59-aae0-4c03-b565-62de44baaf7d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:30.632663 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec9b59-aae0-4c03-b565-62de44baaf7d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:30.632944 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec9b59-aae0-4c03-b565-62de44baaf7d None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:30.633737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec9b59-aae0-4c03-b565-62de44baaf7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:14:30.634049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec9b59-aae0-4c03-b565-62de44baaf7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:30.635530 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec9b59-aae0-4c03-b565-62de44baaf7d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:30.645515 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 592/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:14:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:30.651841 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd1c86-b86f-4d77-a485-5065859645ef None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:30.661975 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:30.766194 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd1c86-b86f-4d77-a485-5065859645ef None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:30.803621 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4581f14-c5b8-4d0d-90f2-a9da4180fbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:30.804515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4581f14-c5b8-4d0d-90f2-a9da4180fbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:30.804776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4581f14-c5b8-4d0d-90f2-a9da4180fbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:30.805108 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4581f14-c5b8-4d0d-90f2-a9da4180fbc9 None admin] PATH_INFO: `/v3/users/a7e87f86dac1449c8a99b222ee9d4911` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:30.806575 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4581f14-c5b8-4d0d-90f2-a9da4180fbc9 None admin] RBAC: Authorizing `identity:get_user(user_id=a7e87f86dac1449c8a99b222ee9d4911)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:30.808292 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4581f14-c5b8-4d0d-90f2-a9da4180fbc9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:30.810341 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 605/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 27 15:14:30 2022] GET /identity/v3/users/a7e87f86dac1449c8a99b222ee9d4911 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:30.816598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec9b59-aae0-4c03-b565-62de44baaf7d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:30.882927 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:30.928508 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec9b59-aae0-4c03-b565-62de44baaf7d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:30.963330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc2edb-20ca-4902-9eb7-4a451b7e9063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:30.963990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc2edb-20ca-4902-9eb7-4a451b7e9063 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:30.964277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc2edb-20ca-4902-9eb7-4a451b7e9063 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:30.964559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc2edb-20ca-4902-9eb7-4a451b7e9063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:31.039243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc2edb-20ca-4902-9eb7-4a451b7e9063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:31.040729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc2edb-20ca-4902-9eb7-4a451b7e9063 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:31.103491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:31.146836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 593/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:14:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:14:31.153393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4581f14-c5b8-4d0d-90f2-a9da4180fbc9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:31.237634 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:31.269078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4581f14-c5b8-4d0d-90f2-a9da4180fbc9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:31.308344 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8436b7-22a3-4f9b-822f-0a781dfbc989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:31.309866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8436b7-22a3-4f9b-822f-0a781dfbc989 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:31.310271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8436b7-22a3-4f9b-822f-0a781dfbc989 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:31.310542 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8436b7-22a3-4f9b-822f-0a781dfbc989 None admin] PATH_INFO: `/v3/projects/72ff565e49b942389482cd97e70f9e45` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:31.311891 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8436b7-22a3-4f9b-822f-0a781dfbc989 None admin] RBAC: Authorizing `identity:get_project(project_id=72ff565e49b942389482cd97e70f9e45)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:31.313373 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8436b7-22a3-4f9b-822f-0a781dfbc989 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:31.315238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 606/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 27 15:14:31 2022] GET /identity/v3/projects/72ff565e49b942389482cd97e70f9e45 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:31.321668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc2edb-20ca-4902-9eb7-4a451b7e9063 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:31.428143 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc2edb-20ca-4902-9eb7-4a451b7e9063 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:31.464155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df1666-efdc-4bee-8ff0-c57310e66eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:31.464856 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df1666-efdc-4bee-8ff0-c57310e66eee None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:31.465235 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df1666-efdc-4bee-8ff0-c57310e66eee None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:31.465912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df1666-efdc-4bee-8ff0-c57310e66eee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:31.466698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df1666-efdc-4bee-8ff0-c57310e66eee None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=72ff565e49b942389482cd97e70f9e45, user.id=a7e87f86dac1449c8a99b222ee9d4911) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:14:31.467023 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df1666-efdc-4bee-8ff0-c57310e66eee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:31.468538 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df1666-efdc-4bee-8ff0-c57310e66eee None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:31.476101 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 594/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:14:31 2022] GET /identity/v3/role_assignments?user.id=a7e87f86dac1449c8a99b222ee9d4911&scope.project.id=72ff565e49b942389482cd97e70f9e45&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:14:41.303078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=29 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:41.472866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=87 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:28.080107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0b9a8-8130-4bc6-b1fd-cbc3e6c857a0 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:28.080724 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0b9a8-8130-4bc6-b1fd-cbc3e6c857a0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:28.080724 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0b9a8-8130-4bc6-b1fd-cbc3e6c857a0 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:28.082039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 607/1201] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:15:28.090981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b2323-b12b-40d2-9df2-08d61ec0d6a2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:28.091726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b2323-b12b-40d2-9df2-08d61ec0d6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:28.091726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b2323-b12b-40d2-9df2-08d61ec0d6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:28.117505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-aa0b2323-b12b-40d2-9df2-08d61ec0d6a2 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:28.118741 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-aa0b2323-b12b-40d2-9df2-08d61ec0d6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:28.248925 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 595/1202] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:15:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:15:28.291374 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0b9a8-8130-4bc6-b1fd-cbc3e6c857a0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:28.457789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0b9a8-8130-4bc6-b1fd-cbc3e6c857a0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:28.524965 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8766f1e-f2fd-4d44-a35c-610b0d36d12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:28.530431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8766f1e-f2fd-4d44-a35c-610b0d36d12a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:28.530431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8766f1e-f2fd-4d44-a35c-610b0d36d12a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:28.530431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8766f1e-f2fd-4d44-a35c-610b0d36d12a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:28.558002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8766f1e-f2fd-4d44-a35c-610b0d36d12a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:28.560087 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8766f1e-f2fd-4d44-a35c-610b0d36d12a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:28.581647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e8766f1e-f2fd-4d44-a35c-610b0d36d12a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:28.581647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:28.581647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:28.581647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:28.581647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:28.581647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:28.581647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:28.581647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:28.581647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:28.581647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:28.581647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:28.581647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:28.581647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:15:28.581647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:15:28.581647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:28.583099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:28.586712 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:15:28.586712 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:15:28.586712 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:28.586712 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:15:28.586712 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 608/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:28.592894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b2323-b12b-40d2-9df2-08d61ec0d6a2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:28.752311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b2323-b12b-40d2-9df2-08d61ec0d6a2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:28.810170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:28.821921 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff837b0-9bd0-489d-8d3a-8bc25ee7dfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:28.822797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff837b0-9bd0-489d-8d3a-8bc25ee7dfb3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:28.823291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff837b0-9bd0-489d-8d3a-8bc25ee7dfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:28.823628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff837b0-9bd0-489d-8d3a-8bc25ee7dfb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:28.826582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff837b0-9bd0-489d-8d3a-8bc25ee7dfb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:28.827079 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff837b0-9bd0-489d-8d3a-8bc25ee7dfb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:28.828794 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff837b0-9bd0-489d-8d3a-8bc25ee7dfb3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:28.845121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 596/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:28.854555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8766f1e-f2fd-4d44-a35c-610b0d36d12a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:28.941422 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:29.019156 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8766f1e-f2fd-4d44-a35c-610b0d36d12a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:29.084591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180a893-ec19-4837-a81f-e1293d69b8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:29.085531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180a893-ec19-4837-a81f-e1293d69b8bf None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:29.085680 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180a893-ec19-4837-a81f-e1293d69b8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:29.087381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180a893-ec19-4837-a81f-e1293d69b8bf None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:29.087381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180a893-ec19-4837-a81f-e1293d69b8bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:29.088874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180a893-ec19-4837-a81f-e1293d69b8bf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:29.138320 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 609/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 27 15:15:28 2022] POST /identity/v3/users => generated 251 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:31.471924 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acb27a-1131-4c19-96b5-bd6d2ad79c0c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:31.472528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acb27a-1131-4c19-96b5-bd6d2ad79c0c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:31.472528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acb27a-1131-4c19-96b5-bd6d2ad79c0c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:31.474251 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 597/1206] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:15:31.479887 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306dc0a-e468-4830-9865-73837e947ec9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:31.480431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306dc0a-e468-4830-9865-73837e947ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:31.480431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306dc0a-e468-4830-9865-73837e947ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:31.498298 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9306dc0a-e468-4830-9865-73837e947ec9 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:31.499517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9306dc0a-e468-4830-9865-73837e947ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:31.574915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 610/1207] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:15:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:15:31.598320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acb27a-1131-4c19-96b5-bd6d2ad79c0c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:31.741023 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acb27a-1131-4c19-96b5-bd6d2ad79c0c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:31.784557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536124b-5aca-41d6-93bd-aba05221ebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:31.785428 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536124b-5aca-41d6-93bd-aba05221ebcf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:31.785705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536124b-5aca-41d6-93bd-aba05221ebcf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:31.787606 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536124b-5aca-41d6-93bd-aba05221ebcf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:31.800886 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536124b-5aca-41d6-93bd-aba05221ebcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:15:31.809257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d536124b-5aca-41d6-93bd-aba05221ebcf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:15:31.809257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:31.809257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:31.809257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:31.809257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:31.809257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:31.809257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:31.809257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:31.809257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:31.809257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:31.809257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:31.809257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:31.809257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:15:31.809257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:15:31.809257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:15:31.809257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:15:31.810401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:15:31.810401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:15:31.810401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:15:31.810401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:15:31.810401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:31.810401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:31.810401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:31.810401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:31.810401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:31.810401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:31.810401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:31.810401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:31.810401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:31.810401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:31.810401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:31.810401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:31.811260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:31.811260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:31.811260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:31.811260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:31.811260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:15:31.811260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:15:31.811260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:15:31.811260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:15:31.811260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:15:31.811260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:15:31.811260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:15:31.811260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:31.817028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306dc0a-e468-4830-9865-73837e947ec9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:31.818467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 598/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:15:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:31.869548 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:31.938063 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306dc0a-e468-4830-9865-73837e947ec9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:31.975819 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a1213-85f2-478f-a000-8f14684cd0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:31.976508 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a1213-85f2-478f-a000-8f14684cd0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:31.976793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a1213-85f2-478f-a000-8f14684cd0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:31.977064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a1213-85f2-478f-a000-8f14684cd0b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:31.977826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a1213-85f2-478f-a000-8f14684cd0b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:31.978137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a1213-85f2-478f-a000-8f14684cd0b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:31.979663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a1213-85f2-478f-a000-8f14684cd0b4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:31.989798 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 611/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:15:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:31.996261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536124b-5aca-41d6-93bd-aba05221ebcf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:32.057083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:32.130109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536124b-5aca-41d6-93bd-aba05221ebcf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:32.174150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5e248-c913-473e-b6b2-f0dae7046798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:32.175001 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5e248-c913-473e-b6b2-f0dae7046798 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:32.175372 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5e248-c913-473e-b6b2-f0dae7046798 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:32.175579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5e248-c913-473e-b6b2-f0dae7046798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:32.188610 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5e248-c913-473e-b6b2-f0dae7046798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:32.190358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5e248-c913-473e-b6b2-f0dae7046798 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:32.211438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ffd5e248-c913-473e-b6b2-f0dae7046798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:32.211438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:32.211438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:32.211438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:32.211438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:32.211438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:32.211438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:32.211438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:32.211438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:32.211438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:32.211438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:32.211438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:32.211438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:15:32.211438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:15:32.211438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:32.212434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:32.215121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:15:32.215121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:15:32.215121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:32.215121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:32.215121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 599/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:15:32.218580 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a1213-85f2-478f-a000-8f14684cd0b4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:32.334244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:32.337185 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a1213-85f2-478f-a000-8f14684cd0b4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:32.376541 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c28cd8-fe50-4593-8c5c-d6eef6517feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:32.377291 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c28cd8-fe50-4593-8c5c-d6eef6517feb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:32.377646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c28cd8-fe50-4593-8c5c-d6eef6517feb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:32.377923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c28cd8-fe50-4593-8c5c-d6eef6517feb None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:32.378688 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c28cd8-fe50-4593-8c5c-d6eef6517feb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:32.379002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c28cd8-fe50-4593-8c5c-d6eef6517feb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:32.380379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c28cd8-fe50-4593-8c5c-d6eef6517feb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:32.397605 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 612/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:32.399809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5e248-c913-473e-b6b2-f0dae7046798 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:32.512061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5e248-c913-473e-b6b2-f0dae7046798 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:32.514168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:32.554867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf530432-a0bd-4102-9c30-8296a328afec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:32.555697 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf530432-a0bd-4102-9c30-8296a328afec None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:32.555975 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf530432-a0bd-4102-9c30-8296a328afec None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:32.556258 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf530432-a0bd-4102-9c30-8296a328afec None admin] PATH_INFO: `/v3/users/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:32.564953 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf530432-a0bd-4102-9c30-8296a328afec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:32.566497 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf530432-a0bd-4102-9c30-8296a328afec None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:32.582006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-cf530432-a0bd-4102-9c30-8296a328afec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 15:15:32.582006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:32.582006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:32.582006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:32.582006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:32.582006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:32.582006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:32.582006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:32.582006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:32.582006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:32.582006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:32.582006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:32.582006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:15:32.582006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:15:32.582006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:15:32.582006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:32.583398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:32.584579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:32.584579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:32.584579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:15:32.584579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:15:32.584579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:15:32.584579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:15:32.584579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:15:32.584579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:15:32.584579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 15:15:32.584579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:32.590106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 600/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:32.590309 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c28cd8-fe50-4593-8c5c-d6eef6517feb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:32.718837 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c28cd8-fe50-4593-8c5c-d6eef6517feb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:32.757883 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42726ada-fb1b-4c5e-83ca-be767cd19aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:32.759274 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42726ada-fb1b-4c5e-83ca-be767cd19aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:32.759598 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42726ada-fb1b-4c5e-83ca-be767cd19aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:32.760087 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42726ada-fb1b-4c5e-83ca-be767cd19aa6 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:32.761238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42726ada-fb1b-4c5e-83ca-be767cd19aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:32.761642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42726ada-fb1b-4c5e-83ca-be767cd19aa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:32.763319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42726ada-fb1b-4c5e-83ca-be767cd19aa6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:32.784877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 613/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Jun 27 15:15:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:15:32.791296 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf530432-a0bd-4102-9c30-8296a328afec None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:32.928415 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf530432-a0bd-4102-9c30-8296a328afec None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:32.974473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2d39b-cf65-4763-afb1-e48ac887e594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:32.975326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2d39b-cf65-4763-afb1-e48ac887e594 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:32.975664 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2d39b-cf65-4763-afb1-e48ac887e594 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:32.976011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2d39b-cf65-4763-afb1-e48ac887e594 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:33.018022 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:33.076146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2d39b-cf65-4763-afb1-e48ac887e594 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:33.077798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2d39b-cf65-4763-afb1-e48ac887e594 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:33.224504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 601/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:15:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:15:33.230803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42726ada-fb1b-4c5e-83ca-be767cd19aa6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:33.254371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:33.363191 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42726ada-fb1b-4c5e-83ca-be767cd19aa6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:33.403121 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6fdeb-06f2-4a6e-9883-2d929720deb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:33.403954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6fdeb-06f2-4a6e-9883-2d929720deb8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:33.405522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6fdeb-06f2-4a6e-9883-2d929720deb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:33.405522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6fdeb-06f2-4a6e-9883-2d929720deb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:33.416995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6fdeb-06f2-4a6e-9883-2d929720deb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:33.418190 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6fdeb-06f2-4a6e-9883-2d929720deb8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:33.437347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-58a6fdeb-06f2-4a6e-9883-2d929720deb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:33.437347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:33.437347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:33.437347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:33.437347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:33.437347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:33.437347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:33.437347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:33.437347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:33.437347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:33.437347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:33.437347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:33.437347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:15:33.437347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:15:33.437347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:33.438716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:33.440018 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:15:33.440018 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:15:33.440018 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:33.440018 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:15:33.446428 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 614/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:33.448688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2d39b-cf65-4763-afb1-e48ac887e594 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:33.540117 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:33.602168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2d39b-cf65-4763-afb1-e48ac887e594 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:33.646849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb3f7a-57f1-48d2-9bfc-6548063f455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:33.647724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb3f7a-57f1-48d2-9bfc-6548063f455a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:33.648068 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb3f7a-57f1-48d2-9bfc-6548063f455a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:33.648355 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb3f7a-57f1-48d2-9bfc-6548063f455a None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:33.649159 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb3f7a-57f1-48d2-9bfc-6548063f455a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:33.649755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb3f7a-57f1-48d2-9bfc-6548063f455a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:33.652263 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb3f7a-57f1-48d2-9bfc-6548063f455a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:33.673907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 602/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:33.683302 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6fdeb-06f2-4a6e-9883-2d929720deb8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:33.785964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:33.843853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6fdeb-06f2-4a6e-9883-2d929720deb8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:33.895740 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b012d-a4a7-4cfa-9e51-c91c2e5ef881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:33.896646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b012d-a4a7-4cfa-9e51-c91c2e5ef881 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:33.896995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b012d-a4a7-4cfa-9e51-c91c2e5ef881 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:33.897325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b012d-a4a7-4cfa-9e51-c91c2e5ef881 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:33.906300 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b012d-a4a7-4cfa-9e51-c91c2e5ef881 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:33.908210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b012d-a4a7-4cfa-9e51-c91c2e5ef881 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:33.928988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2f9b012d-a4a7-4cfa-9e51-c91c2e5ef881 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:15:33.928988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:33.928988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:33.928988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:33.928988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:33.928988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:33.928988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:33.928988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:33.928988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:33.928988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:33.928988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:33.928988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:33.928988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:15:33.928988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:15:33.928988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:33.931286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:33.933086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:15:33.933086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:15:33.933086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:15:33.933086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:15:33.933086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:15:33.933086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:15:33.933086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:15:33.933086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:15:33.936399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 615/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:15:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:33.939220 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb3f7a-57f1-48d2-9bfc-6548063f455a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:34.115462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb3f7a-57f1-48d2-9bfc-6548063f455a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:34.154805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:34.169041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02b92a-4164-431d-ade4-9df4ee3bab00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:34.169756 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02b92a-4164-431d-ade4-9df4ee3bab00 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:34.170460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02b92a-4164-431d-ade4-9df4ee3bab00 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:34.171044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02b92a-4164-431d-ade4-9df4ee3bab00 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:34.172550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02b92a-4164-431d-ade4-9df4ee3bab00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:34.173133 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02b92a-4164-431d-ade4-9df4ee3bab00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:34.176791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02b92a-4164-431d-ade4-9df4ee3bab00 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:34.211109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 603/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:15:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:15:34.214994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b012d-a4a7-4cfa-9e51-c91c2e5ef881 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:34.400820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b012d-a4a7-4cfa-9e51-c91c2e5ef881 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:34.453439 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:34.461072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509fed6-4e8f-4371-9a5f-a38fb09944af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:34.461866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509fed6-4e8f-4371-9a5f-a38fb09944af None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:34.462169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509fed6-4e8f-4371-9a5f-a38fb09944af None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:34.462480 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509fed6-4e8f-4371-9a5f-a38fb09944af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:34.464131 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509fed6-4e8f-4371-9a5f-a38fb09944af None admin] RBAC: Adding query filter params (role.id=c5b95b7a83d94e99a828c836efe01929, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=b471b5b4ede845c7a9dfbf2a90544591) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:34.464470 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509fed6-4e8f-4371-9a5f-a38fb09944af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:34.466034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509fed6-4e8f-4371-9a5f-a38fb09944af None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:34.472733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 616/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:15:34 2022] GET /identity/v3/role_assignments?user.id=b471b5b4ede845c7a9dfbf2a90544591&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=c5b95b7a83d94e99a828c836efe01929 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:36.589382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ff592-eb8c-4d05-8106-80183d2ca9af None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:36.589925 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ff592-eb8c-4d05-8106-80183d2ca9af None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:36.589925 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ff592-eb8c-4d05-8106-80183d2ca9af None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:36.591386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 604/1220] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:15:36.596890 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caa711-c202-49eb-9be0-3221828b44ba None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:36.597318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caa711-c202-49eb-9be0-3221828b44ba None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:36.597569 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caa711-c202-49eb-9be0-3221828b44ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:36.615035 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f8caa711-c202-49eb-9be0-3221828b44ba None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:36.616226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f8caa711-c202-49eb-9be0-3221828b44ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:36.692553 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 617/1221] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:15:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:15:36.719709 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ff592-eb8c-4d05-8106-80183d2ca9af None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:36.843049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ff592-eb8c-4d05-8106-80183d2ca9af None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:36.883023 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27b9a4-af57-447d-8c70-0fe1be92f7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:36.883868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27b9a4-af57-447d-8c70-0fe1be92f7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:36.884191 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27b9a4-af57-447d-8c70-0fe1be92f7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:36.884811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27b9a4-af57-447d-8c70-0fe1be92f7c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:36.897206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27b9a4-af57-447d-8c70-0fe1be92f7c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:15:36.906745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-0c27b9a4-af57-447d-8c70-0fe1be92f7c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:15:36.906745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:36.906745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:36.906745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:36.906745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:36.906745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:36.906745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:36.906745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:36.906745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:36.906745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:36.906745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:36.906745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:36.906745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:15:36.906745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:15:36.906745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:15:36.906745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:15:36.908699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:15:36.908699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:15:36.908699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:15:36.908699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:15:36.908699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:36.908699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:36.908699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:36.908699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:36.908699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:36.908699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:36.908699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:36.908699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:36.908699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:36.908699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:36.908699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:36.908699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:36.910603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:36.910603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:36.910603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:36.910603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:36.910603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:15:36.910603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:15:36.910603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:15:36.910603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:15:36.910603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:15:36.910603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:15:36.910603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:15:36.910603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:36.913775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 605/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:15:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:36.916166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8caa711-c202-49eb-9be0-3221828b44ba None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:37.038707 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8caa711-c202-49eb-9be0-3221828b44ba None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:37.065888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:37.078699 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb5068-7596-4962-be4c-fc85d8672316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:37.079394 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb5068-7596-4962-be4c-fc85d8672316 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:37.079680 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb5068-7596-4962-be4c-fc85d8672316 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:37.079980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb5068-7596-4962-be4c-fc85d8672316 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:37.080713 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb5068-7596-4962-be4c-fc85d8672316 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:37.081023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb5068-7596-4962-be4c-fc85d8672316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:37.082434 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb5068-7596-4962-be4c-fc85d8672316 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:37.092001 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 618/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:15:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:37.098482 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27b9a4-af57-447d-8c70-0fe1be92f7c7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:37.149750 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:37.212349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27b9a4-af57-447d-8c70-0fe1be92f7c7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:37.252098 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227c5b2-827d-4651-bcb4-bff14bc24d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:37.253178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227c5b2-827d-4651-bcb4-bff14bc24d4a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:37.253468 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227c5b2-827d-4651-bcb4-bff14bc24d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:37.253749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227c5b2-827d-4651-bcb4-bff14bc24d4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:37.267696 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227c5b2-827d-4651-bcb4-bff14bc24d4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:37.269300 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227c5b2-827d-4651-bcb4-bff14bc24d4a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:37.288507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a227c5b2-827d-4651-bcb4-bff14bc24d4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:37.288507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:37.288507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:37.288507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:37.288507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:37.288507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:37.288507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:37.288507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:37.288507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:37.288507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:37.288507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:37.288507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:37.288507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:15:37.288507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:15:37.288507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:37.289533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:37.290490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:15:37.290490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:15:37.290490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:37.290490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:37.290490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 606/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:37.296107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb5068-7596-4962-be4c-fc85d8672316 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:37.407908 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb5068-7596-4962-be4c-fc85d8672316 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:37.448857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e3b27-42a9-43b0-8fc3-dc486babdd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:37.449563 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e3b27-42a9-43b0-8fc3-dc486babdd6f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:37.449930 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e3b27-42a9-43b0-8fc3-dc486babdd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:37.450241 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e3b27-42a9-43b0-8fc3-dc486babdd6f None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:37.451006 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e3b27-42a9-43b0-8fc3-dc486babdd6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:37.451363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e3b27-42a9-43b0-8fc3-dc486babdd6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:37.453034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e3b27-42a9-43b0-8fc3-dc486babdd6f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:37.466692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 619/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:37.473396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227c5b2-827d-4651-bcb4-bff14bc24d4a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:37.578103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:37.585422 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227c5b2-827d-4651-bcb4-bff14bc24d4a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:37.625739 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786815b-1d53-44bd-871d-d6f745928ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:37.626562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786815b-1d53-44bd-871d-d6f745928ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:37.626850 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786815b-1d53-44bd-871d-d6f745928ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:37.627129 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786815b-1d53-44bd-871d-d6f745928ed5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:37.635192 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786815b-1d53-44bd-871d-d6f745928ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:37.636745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786815b-1d53-44bd-871d-d6f745928ed5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:37.655090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a786815b-1d53-44bd-871d-d6f745928ed5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 15:15:37.655090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:37.655090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:37.655090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:37.655090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:37.655090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:37.655090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:37.655090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:37.655090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:37.655090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:37.655090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:37.655090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:37.655090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:15:37.655090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:15:37.655090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:15:37.655090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:37.656710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:37.658060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:37.658060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:37.658060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:15:37.658060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:15:37.658060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:15:37.658060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:15:37.658060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:15:37.658060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:15:37.658060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 15:15:37.658060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:37.658774 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 607/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:37.663526 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e3b27-42a9-43b0-8fc3-dc486babdd6f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:37.721533 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:37.789663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e3b27-42a9-43b0-8fc3-dc486babdd6f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:37.833596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31df75-5e91-4903-b36f-a4a3a7f34974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:37.834814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31df75-5e91-4903-b36f-a4a3a7f34974 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:37.835453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31df75-5e91-4903-b36f-a4a3a7f34974 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:37.836008 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31df75-5e91-4903-b36f-a4a3a7f34974 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:37.837632 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31df75-5e91-4903-b36f-a4a3a7f34974 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:37.838362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31df75-5e91-4903-b36f-a4a3a7f34974 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:37.840539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31df75-5e91-4903-b36f-a4a3a7f34974 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:37.867103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 620/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Jun 27 15:15:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:37.873574 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786815b-1d53-44bd-871d-d6f745928ed5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:37.983301 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786815b-1d53-44bd-871d-d6f745928ed5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:38.020107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa46e8e-b714-49bd-88c5-05c4f4e8301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:38.021317 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa46e8e-b714-49bd-88c5-05c4f4e8301c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:38.021825 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa46e8e-b714-49bd-88c5-05c4f4e8301c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:38.022113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa46e8e-b714-49bd-88c5-05c4f4e8301c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:38.035334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa46e8e-b714-49bd-88c5-05c4f4e8301c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:38.036805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa46e8e-b714-49bd-88c5-05c4f4e8301c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:38.056003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-9fa46e8e-b714-49bd-88c5-05c4f4e8301c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:38.056003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:38.056003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:38.056003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:38.056003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:38.056003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:38.056003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:38.056003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:38.056003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:38.056003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:38.056003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:38.056003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:38.056003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:15:38.056003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:15:38.056003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:38.057115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:38.058187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:15:38.058187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:15:38.058187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:38.058187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:38.058187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 608/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:38.063915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31df75-5e91-4903-b36f-a4a3a7f34974 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:38.179353 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31df75-5e91-4903-b36f-a4a3a7f34974 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:38.182552 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:38.224758 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2be3a-6df1-4d89-a8cb-3ef3e179faf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:38.225528 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2be3a-6df1-4d89-a8cb-3ef3e179faf6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:38.225832 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2be3a-6df1-4d89-a8cb-3ef3e179faf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:38.226113 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2be3a-6df1-4d89-a8cb-3ef3e179faf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:38.226903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2be3a-6df1-4d89-a8cb-3ef3e179faf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:38.227191 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2be3a-6df1-4d89-a8cb-3ef3e179faf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:38.228732 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2be3a-6df1-4d89-a8cb-3ef3e179faf6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:38.250624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 621/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:38.252044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa46e8e-b714-49bd-88c5-05c4f4e8301c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:38.263815 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:38.375011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa46e8e-b714-49bd-88c5-05c4f4e8301c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:38.414440 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7fd2f-2ea4-4e2f-a59e-fab54a36b012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:38.415393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7fd2f-2ea4-4e2f-a59e-fab54a36b012 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:38.415897 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7fd2f-2ea4-4e2f-a59e-fab54a36b012 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:38.416885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7fd2f-2ea4-4e2f-a59e-fab54a36b012 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:38.426384 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7fd2f-2ea4-4e2f-a59e-fab54a36b012 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:38.428084 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7fd2f-2ea4-4e2f-a59e-fab54a36b012 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:38.445571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a6d7fd2f-2ea4-4e2f-a59e-fab54a36b012 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:15:38.445571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:38.445571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:38.445571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:38.445571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:38.445571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:38.445571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:38.445571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:38.445571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:38.445571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:38.445571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:38.445571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:38.445571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:15:38.445571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:15:38.445571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:38.446703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:38.447685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:15:38.447685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:15:38.447685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:15:38.447685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:15:38.447685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:15:38.447685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:15:38.447685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:15:38.447685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:38.447685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 609/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:15:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:38.453646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2be3a-6df1-4d89-a8cb-3ef3e179faf6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:38.580754 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2be3a-6df1-4d89-a8cb-3ef3e179faf6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:38.623997 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153de00-ffe3-4d83-baab-65666af19423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:38.624740 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153de00-ffe3-4d83-baab-65666af19423 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:38.625025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153de00-ffe3-4d83-baab-65666af19423 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:38.625303 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153de00-ffe3-4d83-baab-65666af19423 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:38.626115 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153de00-ffe3-4d83-baab-65666af19423 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:38.626433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153de00-ffe3-4d83-baab-65666af19423 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:38.627935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153de00-ffe3-4d83-baab-65666af19423 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:38.642452 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 622/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:15:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:38.648410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7fd2f-2ea4-4e2f-a59e-fab54a36b012 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:38.723123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:38.761535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7fd2f-2ea4-4e2f-a59e-fab54a36b012 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:38.801172 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfd0f2-3ed6-4093-88c9-49f64aff32c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:38.802084 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfd0f2-3ed6-4093-88c9-49f64aff32c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:38.802404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfd0f2-3ed6-4093-88c9-49f64aff32c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:38.802679 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfd0f2-3ed6-4093-88c9-49f64aff32c7 None admin] PATH_INFO: `/v3/projects/3f8ec287061141028659ab504e7707de/users/b471b5b4ede845c7a9dfbf2a90544591/roles/c5b95b7a83d94e99a828c836efe01929` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:38.818502 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfd0f2-3ed6-4093-88c9-49f64aff32c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f8ec287061141028659ab504e7707de, user_id=b471b5b4ede845c7a9dfbf2a90544591, role_id=c5b95b7a83d94e99a828c836efe01929)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:38.820100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfd0f2-3ed6-4093-88c9-49f64aff32c7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:38.846302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 610/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:15:38 2022] PUT /identity/v3/projects/3f8ec287061141028659ab504e7707de/users/b471b5b4ede845c7a9dfbf2a90544591/roles/c5b95b7a83d94e99a828c836efe01929 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:41.079879 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b06953-5bad-456b-9865-94355745eb8a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:41.080454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b06953-5bad-456b-9865-94355745eb8a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:41.080454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b06953-5bad-456b-9865-94355745eb8a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:41.081794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 623/1233] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:15:41.087755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292f1a9-dbfd-4fca-90a2-17d24126b1d8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:41.088325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292f1a9-dbfd-4fca-90a2-17d24126b1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:41.088325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292f1a9-dbfd-4fca-90a2-17d24126b1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:41.107063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c292f1a9-dbfd-4fca-90a2-17d24126b1d8 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:41.108305 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c292f1a9-dbfd-4fca-90a2-17d24126b1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:41.188540 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 611/1234] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:15:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:15:41.214642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b06953-5bad-456b-9865-94355745eb8a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:41.248938 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:41.327852 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b06953-5bad-456b-9865-94355745eb8a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:41.365239 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c3bf8-9f08-4283-abe4-73b4c49da189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:41.366028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c3bf8-9f08-4283-abe4-73b4c49da189 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:41.366372 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c3bf8-9f08-4283-abe4-73b4c49da189 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:41.366723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c3bf8-9f08-4283-abe4-73b4c49da189 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:41.378658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c3bf8-9f08-4283-abe4-73b4c49da189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:15:41.387399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-232c3bf8-9f08-4283-abe4-73b4c49da189 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:15:41.387399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:41.387399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:41.387399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:41.387399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:41.387399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:41.387399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:41.387399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:41.387399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:41.387399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:41.387399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:41.387399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:41.387399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:15:41.387399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:15:41.387399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:15:41.387399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:15:41.394002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:15:41.394002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:15:41.394002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:15:41.394002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:15:41.394002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:41.394002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:41.394002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:41.394002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:41.394002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:41.394002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:41.394002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:41.394002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:41.394002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:41.394002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:41.394002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:41.394002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:41.394922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:41.394922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:41.394922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:41.394922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:41.394922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:15:41.394922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:15:41.394922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:15:41.394922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:15:41.394922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:15:41.394922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:15:41.394922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 15:15:41.394922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:15:41.394922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 624/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 27 15:15:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:41.395655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292f1a9-dbfd-4fca-90a2-17d24126b1d8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:41.442837 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:41.501636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292f1a9-dbfd-4fca-90a2-17d24126b1d8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:41.536053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7478e2-5ec7-4970-8e10-789a3c7420d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:41.536732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7478e2-5ec7-4970-8e10-789a3c7420d3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:41.537015 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7478e2-5ec7-4970-8e10-789a3c7420d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:41.537292 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7478e2-5ec7-4970-8e10-789a3c7420d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:41.538043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7478e2-5ec7-4970-8e10-789a3c7420d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:41.538387 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7478e2-5ec7-4970-8e10-789a3c7420d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:41.539760 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7478e2-5ec7-4970-8e10-789a3c7420d3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:41.554310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 612/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 27 15:15:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:15:41.555547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c3bf8-9f08-4283-abe4-73b4c49da189 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:41.648373 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:41.664483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c3bf8-9f08-4283-abe4-73b4c49da189 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:41.701385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade63053-a079-4deb-bbef-a41e492ae92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:41.702306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade63053-a079-4deb-bbef-a41e492ae92e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:41.702648 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade63053-a079-4deb-bbef-a41e492ae92e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:41.702959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade63053-a079-4deb-bbef-a41e492ae92e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:41.715267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade63053-a079-4deb-bbef-a41e492ae92e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:41.716857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade63053-a079-4deb-bbef-a41e492ae92e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:41.736363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ade63053-a079-4deb-bbef-a41e492ae92e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:41.736363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:41.736363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:41.736363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:41.736363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:41.736363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:41.736363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:41.736363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:41.736363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:41.736363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:41.736363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:41.736363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:41.736363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:15:41.736363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:15:41.736363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:41.737496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:41.738562 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:15:41.738562 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:15:41.738562 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:41.738562 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:15:41.738562 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 625/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:41.744229 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7478e2-5ec7-4970-8e10-789a3c7420d3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:41.859168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7478e2-5ec7-4970-8e10-789a3c7420d3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:41.873584 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:41.913097 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51724877-6f4a-444c-95dc-250105bbb0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:41.913748 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51724877-6f4a-444c-95dc-250105bbb0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:41.914031 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51724877-6f4a-444c-95dc-250105bbb0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:41.914338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51724877-6f4a-444c-95dc-250105bbb0f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:41.915125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51724877-6f4a-444c-95dc-250105bbb0f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:41.915431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51724877-6f4a-444c-95dc-250105bbb0f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:41.917524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51724877-6f4a-444c-95dc-250105bbb0f2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:41.934655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 613/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:41.940604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade63053-a079-4deb-bbef-a41e492ae92e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:42.063765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade63053-a079-4deb-bbef-a41e492ae92e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:42.101540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42aec95-ad97-46fd-8829-9e110440f620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:42.102396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aec95-ad97-46fd-8829-9e110440f620 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:42.102693 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aec95-ad97-46fd-8829-9e110440f620 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:42.102990 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aec95-ad97-46fd-8829-9e110440f620 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:42.106643 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:42.112851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42aec95-ad97-46fd-8829-9e110440f620 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:42.114404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42aec95-ad97-46fd-8829-9e110440f620 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:42.130604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f42aec95-ad97-46fd-8829-9e110440f620 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 15:15:42.130604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:42.130604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:42.130604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:42.130604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:42.130604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:42.130604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:42.130604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:42.130604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:42.130604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:42.130604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:42.130604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:42.130604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:15:42.130604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:15:42.130604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:15:42.130604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:42.131888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:42.132848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:42.132848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:42.132848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:15:42.132848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:15:42.132848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:15:42.132848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:15:42.132848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:15:42.132848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:15:42.132848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 15:15:42.132848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:15:42.132848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 626/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:42.139656 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51724877-6f4a-444c-95dc-250105bbb0f2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:42.253371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51724877-6f4a-444c-95dc-250105bbb0f2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:42.294482 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a77162-cbed-4db7-b1c8-299d74e3144d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:42.295184 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a77162-cbed-4db7-b1c8-299d74e3144d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:42.295466 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a77162-cbed-4db7-b1c8-299d74e3144d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:42.295766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a77162-cbed-4db7-b1c8-299d74e3144d None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:42.296623 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a77162-cbed-4db7-b1c8-299d74e3144d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:42.296936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a77162-cbed-4db7-b1c8-299d74e3144d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:42.298775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a77162-cbed-4db7-b1c8-299d74e3144d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:42.324026 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 614/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Jun 27 15:15:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:42.325679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42aec95-ad97-46fd-8829-9e110440f620 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:42.447657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42aec95-ad97-46fd-8829-9e110440f620 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:42.487563 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f6812-6bed-4143-978b-af71b30721e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:42.488250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f6812-6bed-4143-978b-af71b30721e2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:42.488532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f6812-6bed-4143-978b-af71b30721e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:42.488871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f6812-6bed-4143-978b-af71b30721e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:42.563779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:42.571652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f6812-6bed-4143-978b-af71b30721e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:42.573714 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f6812-6bed-4143-978b-af71b30721e2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:42.711750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 627/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:15:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:15:42.718045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a77162-cbed-4db7-b1c8-299d74e3144d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:42.751688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:42.843232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a77162-cbed-4db7-b1c8-299d74e3144d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:42.890434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03f552-751b-4296-aa3f-298deaa7da21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:42.891334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03f552-751b-4296-aa3f-298deaa7da21 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:42.891617 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03f552-751b-4296-aa3f-298deaa7da21 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:42.891894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03f552-751b-4296-aa3f-298deaa7da21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:42.903954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03f552-751b-4296-aa3f-298deaa7da21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:42.905716 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03f552-751b-4296-aa3f-298deaa7da21 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:42.924221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-3e03f552-751b-4296-aa3f-298deaa7da21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:42.924221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:42.924221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:42.924221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:42.924221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:42.924221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:42.924221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:42.924221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:42.924221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:42.924221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:42.924221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:42.924221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:42.924221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:15:42.924221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:15:42.924221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:42.925885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:42.927007 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:15:42.927007 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:15:42.927007 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:42.927007 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:42.927007 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 615/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:42.932458 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f6812-6bed-4143-978b-af71b30721e2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:43.047529 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:43.056456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f6812-6bed-4143-978b-af71b30721e2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:43.094578 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ed908-db0a-445c-81df-e7bb02cb1623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:43.095177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ed908-db0a-445c-81df-e7bb02cb1623 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:43.095465 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ed908-db0a-445c-81df-e7bb02cb1623 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:43.095777 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ed908-db0a-445c-81df-e7bb02cb1623 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:43.096494 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ed908-db0a-445c-81df-e7bb02cb1623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:43.096811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ed908-db0a-445c-81df-e7bb02cb1623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:43.098203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ed908-db0a-445c-81df-e7bb02cb1623 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:43.111406 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 628/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:43.117548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03f552-751b-4296-aa3f-298deaa7da21 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:43.201816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:43.224071 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03f552-751b-4296-aa3f-298deaa7da21 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:43.259617 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9558597-b6c3-45a8-a07d-817618a12f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:43.260442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9558597-b6c3-45a8-a07d-817618a12f23 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:43.260723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9558597-b6c3-45a8-a07d-817618a12f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:43.260994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9558597-b6c3-45a8-a07d-817618a12f23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:43.267762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9558597-b6c3-45a8-a07d-817618a12f23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:43.269222 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9558597-b6c3-45a8-a07d-817618a12f23 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:43.283507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e9558597-b6c3-45a8-a07d-817618a12f23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:15:43.283507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:43.283507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:43.283507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:43.283507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:43.283507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:43.283507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:43.283507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:43.283507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:43.283507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:43.283507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:43.283507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:43.283507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:15:43.283507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:15:43.283507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:43.284555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:43.285929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:15:43.285929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:15:43.285929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:15:43.285929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:15:43.285929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:15:43.285929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:15:43.285929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:15:43.285929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:43.285929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 616/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:15:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:43.291547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ed908-db0a-445c-81df-e7bb02cb1623 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:43.402507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ed908-db0a-445c-81df-e7bb02cb1623 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:43.438618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8d8ae-6466-4223-9127-c12fe092b112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:43.439457 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8d8ae-6466-4223-9127-c12fe092b112 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:43.439820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8d8ae-6466-4223-9127-c12fe092b112 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:43.440099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8d8ae-6466-4223-9127-c12fe092b112 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:43.440905 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8d8ae-6466-4223-9127-c12fe092b112 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:43.441211 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8d8ae-6466-4223-9127-c12fe092b112 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:43.442702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8d8ae-6466-4223-9127-c12fe092b112 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:43.456366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 629/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:15:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:43.463083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9558597-b6c3-45a8-a07d-817618a12f23 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:43.579003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9558597-b6c3-45a8-a07d-817618a12f23 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:43.620885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3a2d1-1dad-48d2-91f2-64a159fac8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:43.621594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3a2d1-1dad-48d2-91f2-64a159fac8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:43.621884 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3a2d1-1dad-48d2-91f2-64a159fac8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:43.622163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3a2d1-1dad-48d2-91f2-64a159fac8f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:43.623039 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3a2d1-1dad-48d2-91f2-64a159fac8f0 None admin] RBAC: Adding query filter params (role.id=c5b95b7a83d94e99a828c836efe01929, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=b471b5b4ede845c7a9dfbf2a90544591) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:43.623357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3a2d1-1dad-48d2-91f2-64a159fac8f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:43.624812 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3a2d1-1dad-48d2-91f2-64a159fac8f0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:43.634261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 617/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:15:43 2022] GET /identity/v3/role_assignments?user.id=b471b5b4ede845c7a9dfbf2a90544591&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=c5b95b7a83d94e99a828c836efe01929 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:45.956632 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aee0a5-e436-4433-848e-0ca1312bff7d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:45.957271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aee0a5-e436-4433-848e-0ca1312bff7d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:45.957271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aee0a5-e436-4433-848e-0ca1312bff7d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:45.958875 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 630/1247] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:15:45.965203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca07c6-bab1-4cbf-961f-37b083cab7de None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:45.965678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca07c6-bab1-4cbf-961f-37b083cab7de None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:45.965892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca07c6-bab1-4cbf-961f-37b083cab7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:45.971503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:45.986653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bbca07c6-bab1-4cbf-961f-37b083cab7de None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:45.988040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bbca07c6-bab1-4cbf-961f-37b083cab7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:46.069441 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 618/1248] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:15:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:15:46.098848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aee0a5-e436-4433-848e-0ca1312bff7d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:46.122000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:46.223075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aee0a5-e436-4433-848e-0ca1312bff7d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:46.262607 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106791aa-3715-41a0-a8c6-6331dd55f3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:46.263462 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106791aa-3715-41a0-a8c6-6331dd55f3ef None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:46.263799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106791aa-3715-41a0-a8c6-6331dd55f3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:46.264110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106791aa-3715-41a0-a8c6-6331dd55f3ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:46.275363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106791aa-3715-41a0-a8c6-6331dd55f3ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:15:46.283469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-106791aa-3715-41a0-a8c6-6331dd55f3ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:15:46.283469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:46.283469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:46.283469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:46.283469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:46.283469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:46.283469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:46.283469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:46.283469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:46.283469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:46.283469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:46.283469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:46.283469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:15:46.283469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:15:46.283469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:15:46.283469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:15:46.284519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:15:46.284519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:15:46.284519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:15:46.284519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:15:46.284519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:46.284519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:46.284519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:46.284519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:46.284519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:46.284519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:46.284519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:46.284519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:46.284519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:46.284519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:46.284519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:46.284519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:46.285360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:46.285360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:46.285360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:46.285360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:46.285360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:15:46.285360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:15:46.285360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:15:46.285360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:15:46.285360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:15:46.285360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:15:46.285360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:15:46.285360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:15:46.285360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 631/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:15:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:46.292059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca07c6-bab1-4cbf-961f-37b083cab7de None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:46.411433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca07c6-bab1-4cbf-961f-37b083cab7de None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:46.447393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:46.453605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050e828-5bf1-41e4-ab23-ec03643e225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:46.454321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050e828-5bf1-41e4-ab23-ec03643e225f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:46.454611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050e828-5bf1-41e4-ab23-ec03643e225f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:46.454910 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050e828-5bf1-41e4-ab23-ec03643e225f None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:46.455668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050e828-5bf1-41e4-ab23-ec03643e225f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:46.456022 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050e828-5bf1-41e4-ab23-ec03643e225f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:46.457349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050e828-5bf1-41e4-ab23-ec03643e225f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:46.467320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 619/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:15:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:46.474088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106791aa-3715-41a0-a8c6-6331dd55f3ef None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:46.569208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:46.598368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106791aa-3715-41a0-a8c6-6331dd55f3ef None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:46.638604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac49f1-cfc2-4d00-b497-ec033260437f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:46.639542 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac49f1-cfc2-4d00-b497-ec033260437f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:46.639886 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac49f1-cfc2-4d00-b497-ec033260437f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:46.640190 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac49f1-cfc2-4d00-b497-ec033260437f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:46.652449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac49f1-cfc2-4d00-b497-ec033260437f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:46.653906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac49f1-cfc2-4d00-b497-ec033260437f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:46.671945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3bac49f1-cfc2-4d00-b497-ec033260437f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:46.671945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:46.671945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:46.671945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:46.671945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:46.671945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:46.671945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:46.671945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:46.671945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:46.671945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:46.671945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:46.671945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:46.671945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:15:46.671945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:15:46.671945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:46.673994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:46.675301 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:15:46.675301 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:15:46.675301 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:46.675301 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:15:46.675301 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 632/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:46.679843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050e828-5bf1-41e4-ab23-ec03643e225f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:46.805366 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050e828-5bf1-41e4-ab23-ec03643e225f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:46.849318 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95577c7e-81f6-4f4e-82a9-53b0973c1e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:46.850119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95577c7e-81f6-4f4e-82a9-53b0973c1e35 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:46.850522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95577c7e-81f6-4f4e-82a9-53b0973c1e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:46.850813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95577c7e-81f6-4f4e-82a9-53b0973c1e35 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:46.851683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95577c7e-81f6-4f4e-82a9-53b0973c1e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:46.852028 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95577c7e-81f6-4f4e-82a9-53b0973c1e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:46.854991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95577c7e-81f6-4f4e-82a9-53b0973c1e35 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:46.871029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 620/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:46.877318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac49f1-cfc2-4d00-b497-ec033260437f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:46.997673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac49f1-cfc2-4d00-b497-ec033260437f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:47.027972 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:47.036572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18210ca-6d40-4c5f-8c31-60f2864edc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:47.037393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18210ca-6d40-4c5f-8c31-60f2864edc52 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:47.037706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18210ca-6d40-4c5f-8c31-60f2864edc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:47.038068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18210ca-6d40-4c5f-8c31-60f2864edc52 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:47.049037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18210ca-6d40-4c5f-8c31-60f2864edc52 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:47.050799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18210ca-6d40-4c5f-8c31-60f2864edc52 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:47.069812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f18210ca-6d40-4c5f-8c31-60f2864edc52 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 15:15:47.069812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:47.069812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:47.069812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:47.069812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:47.069812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:47.069812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:47.069812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:47.069812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:47.069812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:47.069812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:47.069812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:47.069812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:15:47.069812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:15:47.069812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:15:47.069812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:47.070889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:47.071840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:47.071840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:47.071840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:15:47.071840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:15:47.071840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:15:47.071840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:15:47.071840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:15:47.071840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:15:47.071840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 15:15:47.071840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:15:47.071840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 633/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 15:15:47.079632 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95577c7e-81f6-4f4e-82a9-53b0973c1e35 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:47.149966 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:47.207070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95577c7e-81f6-4f4e-82a9-53b0973c1e35 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:47.249146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c2b5a-8409-4660-b5b3-cb129ec0d2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:47.249930 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c2b5a-8409-4660-b5b3-cb129ec0d2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:47.250279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c2b5a-8409-4660-b5b3-cb129ec0d2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:47.250629 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c2b5a-8409-4660-b5b3-cb129ec0d2b0 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:47.251616 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c2b5a-8409-4660-b5b3-cb129ec0d2b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:47.251995 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c2b5a-8409-4660-b5b3-cb129ec0d2b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:47.253653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c2b5a-8409-4660-b5b3-cb129ec0d2b0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:47.274727 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 621/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Jun 27 15:15:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:47.282349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18210ca-6d40-4c5f-8c31-60f2864edc52 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:47.402003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18210ca-6d40-4c5f-8c31-60f2864edc52 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:47.440027 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6ee56-b518-4d73-bd3b-69d662979f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:47.440774 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6ee56-b518-4d73-bd3b-69d662979f7f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:47.441060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6ee56-b518-4d73-bd3b-69d662979f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:47.441443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6ee56-b518-4d73-bd3b-69d662979f7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:47.507913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:47.522861 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6ee56-b518-4d73-bd3b-69d662979f7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:47.524325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6ee56-b518-4d73-bd3b-69d662979f7f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:47.643214 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 634/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:15:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:15:47.649521 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c2b5a-8409-4660-b5b3-cb129ec0d2b0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:47.776980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c2b5a-8409-4660-b5b3-cb129ec0d2b0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:47.792996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:47.817461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234fd01-2099-4ceb-8d4c-5a85467b7566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:47.818346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234fd01-2099-4ceb-8d4c-5a85467b7566 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:47.818641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234fd01-2099-4ceb-8d4c-5a85467b7566 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:47.818905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234fd01-2099-4ceb-8d4c-5a85467b7566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:47.834471 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234fd01-2099-4ceb-8d4c-5a85467b7566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:47.836679 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234fd01-2099-4ceb-8d4c-5a85467b7566 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:47.861675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c234fd01-2099-4ceb-8d4c-5a85467b7566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:47.861675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:47.861675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:47.861675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:47.861675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:47.861675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:47.861675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:47.861675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:47.861675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:47.861675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:47.861675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:47.861675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:47.861675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:15:47.861675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:15:47.861675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:47.862848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:47.863971 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:15:47.863971 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:15:47.863971 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:47.863971 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:47.869836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 622/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:47.871187 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6ee56-b518-4d73-bd3b-69d662979f7f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:47.974696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:47.991044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6ee56-b518-4d73-bd3b-69d662979f7f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:48.027922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c84e8f-939f-405b-86fe-42de59992e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:48.028574 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c84e8f-939f-405b-86fe-42de59992e2c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:48.028851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c84e8f-939f-405b-86fe-42de59992e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:48.029155 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c84e8f-939f-405b-86fe-42de59992e2c None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:48.029900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c84e8f-939f-405b-86fe-42de59992e2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:48.030213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c84e8f-939f-405b-86fe-42de59992e2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:48.031625 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c84e8f-939f-405b-86fe-42de59992e2c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:48.044394 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 635/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:15:48.051299 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234fd01-2099-4ceb-8d4c-5a85467b7566 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:48.162314 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234fd01-2099-4ceb-8d4c-5a85467b7566 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:48.204227 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918972e8-c9ef-4561-8ce1-5b61de7d32ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:48.205275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918972e8-c9ef-4561-8ce1-5b61de7d32ba None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:48.205668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918972e8-c9ef-4561-8ce1-5b61de7d32ba None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:48.206103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918972e8-c9ef-4561-8ce1-5b61de7d32ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:48.215403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918972e8-c9ef-4561-8ce1-5b61de7d32ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:48.217421 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918972e8-c9ef-4561-8ce1-5b61de7d32ba None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:48.235106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-918972e8-c9ef-4561-8ce1-5b61de7d32ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:15:48.235106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:48.235106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:48.235106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:48.235106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:48.235106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:48.235106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:48.235106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:48.235106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:48.235106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:48.235106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:48.235106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:48.235106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:15:48.235106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:15:48.235106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:48.237137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:48.238274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:15:48.238274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:15:48.238274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:15:48.238274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:15:48.238274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:15:48.238274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:15:48.238274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:15:48.238274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:48.238274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 623/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:48.245663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c84e8f-939f-405b-86fe-42de59992e2c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:48.364205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c84e8f-939f-405b-86fe-42de59992e2c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:48.401947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66372e03-26b3-4a2a-a67a-ac7ce7a0bcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:48.402731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66372e03-26b3-4a2a-a67a-ac7ce7a0bcff None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:48.403051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66372e03-26b3-4a2a-a67a-ac7ce7a0bcff None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:48.403357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66372e03-26b3-4a2a-a67a-ac7ce7a0bcff None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:48.404384 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66372e03-26b3-4a2a-a67a-ac7ce7a0bcff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:48.404753 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66372e03-26b3-4a2a-a67a-ac7ce7a0bcff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:48.406563 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66372e03-26b3-4a2a-a67a-ac7ce7a0bcff None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:48.419553 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 636/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:15:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:48.426081 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918972e8-c9ef-4561-8ce1-5b61de7d32ba None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:48.456917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:48.555595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918972e8-c9ef-4561-8ce1-5b61de7d32ba None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:48.597064 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02a47d-22ad-41b2-83b1-9525c3baedb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:48.597752 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a47d-22ad-41b2-83b1-9525c3baedb7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:48.598044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a47d-22ad-41b2-83b1-9525c3baedb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:48.598409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a47d-22ad-41b2-83b1-9525c3baedb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:48.599290 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02a47d-22ad-41b2-83b1-9525c3baedb7 None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=b471b5b4ede845c7a9dfbf2a90544591) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:48.599675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02a47d-22ad-41b2-83b1-9525c3baedb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:48.601385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02a47d-22ad-41b2-83b1-9525c3baedb7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:48.609295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 624/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:15:48 2022] GET /identity/v3/role_assignments?user.id=b471b5b4ede845c7a9dfbf2a90544591&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:50.672414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3347d7b-3e5d-41d4-9ea8-c3fc9e84f135 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:50.673368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3347d7b-3e5d-41d4-9ea8-c3fc9e84f135 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:50.673368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3347d7b-3e5d-41d4-9ea8-c3fc9e84f135 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:50.674712 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 637/1261] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:15:50.680167 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486da9c-2bbb-46b3-8c5a-ec5a22842727 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:50.680577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486da9c-2bbb-46b3-8c5a-ec5a22842727 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:50.680725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486da9c-2bbb-46b3-8c5a-ec5a22842727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:50.698450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2486da9c-2bbb-46b3-8c5a-ec5a22842727 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:50.699640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2486da9c-2bbb-46b3-8c5a-ec5a22842727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:50.771134 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 625/1262] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:15:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:15:50.793994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3347d7b-3e5d-41d4-9ea8-c3fc9e84f135 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:50.805875 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:50.912393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3347d7b-3e5d-41d4-9ea8-c3fc9e84f135 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:50.948495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9baa8-5ca9-4d21-beaf-eec0805880f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:50.949303 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9baa8-5ca9-4d21-beaf-eec0805880f5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:50.949582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9baa8-5ca9-4d21-beaf-eec0805880f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:50.949859 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9baa8-5ca9-4d21-beaf-eec0805880f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:50.960536 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9baa8-5ca9-4d21-beaf-eec0805880f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:15:50.968150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c1d9baa8-5ca9-4d21-beaf-eec0805880f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:15:50.968150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:50.968150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:50.968150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:50.968150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:50.968150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:50.968150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:50.968150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:50.968150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:50.968150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:50.968150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:50.968150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:50.968150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:15:50.968150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:15:50.968150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:15:50.968150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:15:50.969226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:15:50.969226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:15:50.969226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:15:50.969226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:15:50.969226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:50.969226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:50.969226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:50.969226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:50.969226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:50.969226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:50.969226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:50.969226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:50.969226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:50.969226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:50.969226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:50.969226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:50.970262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:50.970262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:50.970262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:50.970262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:50.970262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:15:50.970262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:15:50.970262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:15:50.970262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:15:50.970262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:15:50.970262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:15:50.970262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:15:50.970262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:15:50.970262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 638/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:15:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:50.975905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486da9c-2bbb-46b3-8c5a-ec5a22842727 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:50.996631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:51.081261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486da9c-2bbb-46b3-8c5a-ec5a22842727 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:51.119811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33e845-a684-411a-8593-d9463e6ea6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:51.120513 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33e845-a684-411a-8593-d9463e6ea6ac None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.120798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33e845-a684-411a-8593-d9463e6ea6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.121078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33e845-a684-411a-8593-d9463e6ea6ac None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.121864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33e845-a684-411a-8593-d9463e6ea6ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:51.122175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33e845-a684-411a-8593-d9463e6ea6ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:51.123668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33e845-a684-411a-8593-d9463e6ea6ac None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:51.133554 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 626/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:15:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:51.140001 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9baa8-5ca9-4d21-beaf-eec0805880f5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:51.212173 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:51.247618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9baa8-5ca9-4d21-beaf-eec0805880f5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:51.282955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877422f-deaf-470d-a83e-73cde6e174ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:51.283765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877422f-deaf-470d-a83e-73cde6e174ac None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.284047 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877422f-deaf-470d-a83e-73cde6e174ac None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.284327 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877422f-deaf-470d-a83e-73cde6e174ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.296058 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877422f-deaf-470d-a83e-73cde6e174ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:51.297534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877422f-deaf-470d-a83e-73cde6e174ac None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:51.315647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a877422f-deaf-470d-a83e-73cde6e174ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:51.315647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:51.315647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:51.315647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:51.315647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:51.315647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:51.315647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:51.315647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:51.315647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:51.315647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:51.315647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:51.315647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:51.315647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:15:51.315647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:15:51.315647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:51.316700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:51.317635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:15:51.317635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:15:51.317635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:51.317635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:15:51.317635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 639/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:51.323057 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33e845-a684-411a-8593-d9463e6ea6ac None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:51.405575 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:51.425697 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33e845-a684-411a-8593-d9463e6ea6ac None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:51.459772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232318ac-5fda-4706-a825-623eca04d238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:51.460450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232318ac-5fda-4706-a825-623eca04d238 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.460736 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232318ac-5fda-4706-a825-623eca04d238 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.461014 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232318ac-5fda-4706-a825-623eca04d238 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.461743 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232318ac-5fda-4706-a825-623eca04d238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:51.462078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232318ac-5fda-4706-a825-623eca04d238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:51.463585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232318ac-5fda-4706-a825-623eca04d238 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:51.475732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 627/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:51.482447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877422f-deaf-470d-a83e-73cde6e174ac None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:51.587688 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877422f-deaf-470d-a83e-73cde6e174ac None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:51.607455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:51.622635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e213edb-a710-4536-87b3-d5d16f88709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:51.623453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e213edb-a710-4536-87b3-d5d16f88709c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.623735 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e213edb-a710-4536-87b3-d5d16f88709c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.624006 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e213edb-a710-4536-87b3-d5d16f88709c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.631827 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e213edb-a710-4536-87b3-d5d16f88709c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:51.633270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e213edb-a710-4536-87b3-d5d16f88709c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:51.647764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3e213edb-a710-4536-87b3-d5d16f88709c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 15:15:51.647764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:51.647764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:51.647764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:51.647764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:51.647764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:51.647764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:51.647764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:51.647764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:51.647764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:51.647764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:51.647764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:51.647764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:15:51.647764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:15:51.647764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:15:51.647764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:51.648888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:51.650933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:51.650933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:51.650933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:15:51.650933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:15:51.650933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:15:51.650933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:15:51.650933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:15:51.650933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:15:51.650933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 15:15:51.650933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:15:51.650933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 640/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:51.655216 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232318ac-5fda-4706-a825-623eca04d238 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:51.762347 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232318ac-5fda-4706-a825-623eca04d238 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:51.800156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c984db-ccbc-4344-bb87-492fa184447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:51.800850 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c984db-ccbc-4344-bb87-492fa184447d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.801129 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c984db-ccbc-4344-bb87-492fa184447d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.801403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c984db-ccbc-4344-bb87-492fa184447d None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.802273 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c984db-ccbc-4344-bb87-492fa184447d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:51.802594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c984db-ccbc-4344-bb87-492fa184447d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:51.804070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c984db-ccbc-4344-bb87-492fa184447d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:51.814849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:51.826874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 628/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Jun 27 15:15:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:51.834894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e213edb-a710-4536-87b3-d5d16f88709c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:51.949623 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e213edb-a710-4536-87b3-d5d16f88709c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:51.984727 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f013d2-2efd-45a0-be72-4849e373029c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:51.985530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f013d2-2efd-45a0-be72-4849e373029c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.985819 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f013d2-2efd-45a0-be72-4849e373029c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.986095 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f013d2-2efd-45a0-be72-4849e373029c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.997381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f013d2-2efd-45a0-be72-4849e373029c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:51.998904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f013d2-2efd-45a0-be72-4849e373029c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:52.017979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-31f013d2-2efd-45a0-be72-4849e373029c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:52.017979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:52.017979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:52.017979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:52.017979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:52.017979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:52.017979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:52.017979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:52.017979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:52.017979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:52.017979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:52.017979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:52.017979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:15:52.017979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:15:52.017979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:52.019117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:52.020385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:15:52.020385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:15:52.020385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:52.020385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:15:52.020385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 641/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:52.025451 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c984db-ccbc-4344-bb87-492fa184447d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:52.139607 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c984db-ccbc-4344-bb87-492fa184447d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:52.178746 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1438625-df83-4884-8440-caa08dc0a7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:52.179434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1438625-df83-4884-8440-caa08dc0a7bf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:52.179721 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1438625-df83-4884-8440-caa08dc0a7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:52.180000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1438625-df83-4884-8440-caa08dc0a7bf None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:52.180716 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1438625-df83-4884-8440-caa08dc0a7bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:52.181100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1438625-df83-4884-8440-caa08dc0a7bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:52.182567 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1438625-df83-4884-8440-caa08dc0a7bf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:52.195863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 629/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:52.202599 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f013d2-2efd-45a0-be72-4849e373029c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:52.237234 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:52.314086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f013d2-2efd-45a0-be72-4849e373029c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:52.349769 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c775a4-4df1-49b2-903f-f97d8ee462da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:52.350613 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c775a4-4df1-49b2-903f-f97d8ee462da None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:52.350901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c775a4-4df1-49b2-903f-f97d8ee462da None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:52.351176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c775a4-4df1-49b2-903f-f97d8ee462da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:52.358083 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c775a4-4df1-49b2-903f-f97d8ee462da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:52.359566 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c775a4-4df1-49b2-903f-f97d8ee462da None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:52.373539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a2c775a4-4df1-49b2-903f-f97d8ee462da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:15:52.373539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:52.373539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:52.373539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:52.373539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:52.373539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:52.373539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:52.373539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:52.373539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:52.373539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:52.373539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:52.373539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:52.373539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:15:52.373539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:15:52.373539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:52.374515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:52.375414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:15:52.375414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:15:52.375414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:15:52.375414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:15:52.375414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:15:52.375414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:15:52.375414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:15:52.375414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:15:52.375414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 642/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:15:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:52.381041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1438625-df83-4884-8440-caa08dc0a7bf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:52.444637 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:52.491730 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1438625-df83-4884-8440-caa08dc0a7bf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:52.526629 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520a5c4-1492-41ff-bc92-be718e4af5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:52.527295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520a5c4-1492-41ff-bc92-be718e4af5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:52.527579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520a5c4-1492-41ff-bc92-be718e4af5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:52.527858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520a5c4-1492-41ff-bc92-be718e4af5c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:52.528650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520a5c4-1492-41ff-bc92-be718e4af5c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:52.528961 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520a5c4-1492-41ff-bc92-be718e4af5c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:52.530435 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520a5c4-1492-41ff-bc92-be718e4af5c0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:52.542604 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 630/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:15:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:52.549219 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c775a4-4df1-49b2-903f-f97d8ee462da None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:52.646467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:52.656098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c775a4-4df1-49b2-903f-f97d8ee462da None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:52.691803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf8daa-a5ac-4c49-b2f1-7575db1e9a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:52.692707 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf8daa-a5ac-4c49-b2f1-7575db1e9a35 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:52.692993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf8daa-a5ac-4c49-b2f1-7575db1e9a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:52.693268 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf8daa-a5ac-4c49-b2f1-7575db1e9a35 None admin] PATH_INFO: `/v3/projects/3f8ec287061141028659ab504e7707de/users/b471b5b4ede845c7a9dfbf2a90544591/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:52.695280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf8daa-a5ac-4c49-b2f1-7575db1e9a35 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f8ec287061141028659ab504e7707de, user_id=b471b5b4ede845c7a9dfbf2a90544591, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:52.696779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf8daa-a5ac-4c49-b2f1-7575db1e9a35 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:52.710836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 643/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 27 15:15:52 2022] PUT /identity/v3/projects/3f8ec287061141028659ab504e7707de/users/b471b5b4ede845c7a9dfbf2a90544591/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:54.753836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a8459-9489-4913-99e0-a1c51cf8d1e3 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:54.754479 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a8459-9489-4913-99e0-a1c51cf8d1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:54.754479 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a8459-9489-4913-99e0-a1c51cf8d1e3 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:54.755814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 631/1274] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:15:54.761417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9a313-ac2e-458c-9e85-437fd96d36c6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:54.761890 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9a313-ac2e-458c-9e85-437fd96d36c6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:54.761992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9a313-ac2e-458c-9e85-437fd96d36c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:54.779409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-50e9a313-ac2e-458c-9e85-437fd96d36c6 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:54.780613 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-50e9a313-ac2e-458c-9e85-437fd96d36c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:54.856341 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 644/1275] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:15:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 15:15:54.880818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a8459-9489-4913-99e0-a1c51cf8d1e3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:54.987591 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a8459-9489-4913-99e0-a1c51cf8d1e3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:55.005448 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:55.023389 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6398f-90e4-4447-a682-33a926fcc193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:55.024193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6398f-90e4-4447-a682-33a926fcc193 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:55.024501 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6398f-90e4-4447-a682-33a926fcc193 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:55.024991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6398f-90e4-4447-a682-33a926fcc193 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:55.035806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6398f-90e4-4447-a682-33a926fcc193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 15:15:55.043489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f7f6398f-90e4-4447-a682-33a926fcc193 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:15:55.043489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:55.043489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:55.043489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:55.043489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:55.043489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:55.043489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:55.043489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:55.043489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:55.043489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:55.043489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:55.043489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:55.043489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 15:15:55.043489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 15:15:55.043489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 15:15:55.043489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 15:15:55.044650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 15:15:55.044650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 15:15:55.044650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 15:15:55.044650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 15:15:55.044650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:55.044650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:55.044650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:55.044650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:55.044650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:55.044650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:55.044650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:55.044650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:55.044650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:55.044650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:55.044650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:55.044650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:55.045667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:55.045667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:55.045667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:55.045667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:55.045667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 15:15:55.045667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 15:15:55.045667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 15:15:55.045667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 15:15:55.045667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 15:15:55.045667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 15:15:55.045667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 15:15:55.045667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:55.045667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 632/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 27 15:15:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:55.051375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9a313-ac2e-458c-9e85-437fd96d36c6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:55.133971 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:55.155270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9a313-ac2e-458c-9e85-437fd96d36c6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:55.191252 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e51b9-a45f-4e49-a199-6b60d08e1ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:55.191924 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e51b9-a45f-4e49-a199-6b60d08e1ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:55.192212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e51b9-a45f-4e49-a199-6b60d08e1ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:55.192491 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e51b9-a45f-4e49-a199-6b60d08e1ae2 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:55.193244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e51b9-a45f-4e49-a199-6b60d08e1ae2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:55.193555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e51b9-a45f-4e49-a199-6b60d08e1ae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:55.194965 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e51b9-a45f-4e49-a199-6b60d08e1ae2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:55.203383 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 645/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 27 15:15:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:55.209339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6398f-90e4-4447-a682-33a926fcc193 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:55.317206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6398f-90e4-4447-a682-33a926fcc193 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:55.352150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d2cad-5262-42ae-bad0-8cdf5fc9afe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:55.352991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d2cad-5262-42ae-bad0-8cdf5fc9afe9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:55.353284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d2cad-5262-42ae-bad0-8cdf5fc9afe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:55.353559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d2cad-5262-42ae-bad0-8cdf5fc9afe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:55.364759 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d2cad-5262-42ae-bad0-8cdf5fc9afe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:55.366274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d2cad-5262-42ae-bad0-8cdf5fc9afe9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:55.384072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-886d2cad-5262-42ae-bad0-8cdf5fc9afe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:55.384072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:55.384072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:55.384072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:55.384072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:55.384072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:55.384072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:55.384072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:55.384072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:55.384072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:55.384072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:55.384072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:55.384072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:15:55.384072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:15:55.384072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:55.385214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:55.391018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:15:55.391018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:15:55.391018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:55.391018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:55.391018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 633/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:55.391492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e51b9-a45f-4e49-a199-6b60d08e1ae2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:55.499466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e51b9-a45f-4e49-a199-6b60d08e1ae2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:55.535721 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae143d2-4ef7-4f21-a320-bc8e849b2fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:55.536397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae143d2-4ef7-4f21-a320-bc8e849b2fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:55.536676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae143d2-4ef7-4f21-a320-bc8e849b2fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:55.536952 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae143d2-4ef7-4f21-a320-bc8e849b2fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:55.537672 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae143d2-4ef7-4f21-a320-bc8e849b2fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:55.537976 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae143d2-4ef7-4f21-a320-bc8e849b2fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:55.539384 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae143d2-4ef7-4f21-a320-bc8e849b2fc3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:55.552334 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 646/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:55.558811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d2cad-5262-42ae-bad0-8cdf5fc9afe9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:55.599992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:55.673215 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d2cad-5262-42ae-bad0-8cdf5fc9afe9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:55.708333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dbd02-72db-4150-bf2d-2c9a4676152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:55.709141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dbd02-72db-4150-bf2d-2c9a4676152e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:55.709426 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dbd02-72db-4150-bf2d-2c9a4676152e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:55.709704 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dbd02-72db-4150-bf2d-2c9a4676152e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:55.718002 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dbd02-72db-4150-bf2d-2c9a4676152e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:55.719524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dbd02-72db-4150-bf2d-2c9a4676152e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:55.735029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-9d0dbd02-72db-4150-bf2d-2c9a4676152e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 15:15:55.735029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:55.735029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:55.735029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:55.735029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:55.735029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:55.735029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:55.735029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:55.735029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:55.735029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:55.735029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:55.735029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:55.735029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 15:15:55.735029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 15:15:55.735029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 15:15:55.735029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:55.736236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:55.737382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:55.737382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:55.737382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 15:15:55.737382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 15:15:55.737382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 15:15:55.737382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 15:15:55.737382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 15:15:55.737382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 15:15:55.737382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 15:15:55.737382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:55.737382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 634/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:55.742246 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae143d2-4ef7-4f21-a320-bc8e849b2fc3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:55.746555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:55.850196 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae143d2-4ef7-4f21-a320-bc8e849b2fc3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:55.891936 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763de49-78c7-4710-8f33-e60ce454223b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:55.892871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763de49-78c7-4710-8f33-e60ce454223b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:55.893266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763de49-78c7-4710-8f33-e60ce454223b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:55.893645 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763de49-78c7-4710-8f33-e60ce454223b None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:55.894764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763de49-78c7-4710-8f33-e60ce454223b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:55.895156 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763de49-78c7-4710-8f33-e60ce454223b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:55.897247 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763de49-78c7-4710-8f33-e60ce454223b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:55.914894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 647/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Jun 27 15:15:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:55.920960 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dbd02-72db-4150-bf2d-2c9a4676152e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:56.015082 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:56.025812 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dbd02-72db-4150-bf2d-2c9a4676152e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:56.061712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a8b45-460c-4128-8de0-b54cd8fd6636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:56.062421 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a8b45-460c-4128-8de0-b54cd8fd6636 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:56.062706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a8b45-460c-4128-8de0-b54cd8fd6636 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:56.062985 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a8b45-460c-4128-8de0-b54cd8fd6636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:56.142392 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a8b45-460c-4128-8de0-b54cd8fd6636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:56.143906 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a8b45-460c-4128-8de0-b54cd8fd6636 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:56.258982 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:56.270644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 635/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 27 15:15:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 15:15:56.277434 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763de49-78c7-4710-8f33-e60ce454223b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:56.345435 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:56.385931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763de49-78c7-4710-8f33-e60ce454223b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:56.418864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c2e92-0730-4ed4-866d-21c80698dca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:56.419673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c2e92-0730-4ed4-866d-21c80698dca8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:56.419962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c2e92-0730-4ed4-866d-21c80698dca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:56.420241 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c2e92-0730-4ed4-866d-21c80698dca8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:56.431212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c2e92-0730-4ed4-866d-21c80698dca8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:56.432519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c2e92-0730-4ed4-866d-21c80698dca8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:56.451138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ee8c2e92-0730-4ed4-866d-21c80698dca8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:56.451138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:56.451138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:56.451138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:56.451138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:56.451138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:56.451138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:56.451138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:56.451138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:56.451138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:56.451138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:56.451138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:56.451138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 15:15:56.451138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 15:15:56.451138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:56.452281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:56.453208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 15:15:56.453208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 15:15:56.453208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 15:15:56.453208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:15:56.453208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 648/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:56.458399 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a8b45-460c-4128-8de0-b54cd8fd6636 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:56.571686 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a8b45-460c-4128-8de0-b54cd8fd6636 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:56.607961 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b068a43-07e8-4584-9d63-5f82fdb65cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:56.608625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b068a43-07e8-4584-9d63-5f82fdb65cce None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:56.608903 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b068a43-07e8-4584-9d63-5f82fdb65cce None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:56.609177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b068a43-07e8-4584-9d63-5f82fdb65cce None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:56.609902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b068a43-07e8-4584-9d63-5f82fdb65cce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:56.610206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b068a43-07e8-4584-9d63-5f82fdb65cce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:56.611618 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b068a43-07e8-4584-9d63-5f82fdb65cce None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:56.623145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 636/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 27 15:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:56.629102 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c2e92-0730-4ed4-866d-21c80698dca8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:56.737702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c2e92-0730-4ed4-866d-21c80698dca8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:56.752226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:56.776154 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bba28-b72e-407e-9cea-61afe5dc8e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:56.776958 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bba28-b72e-407e-9cea-61afe5dc8e06 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:56.777240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bba28-b72e-407e-9cea-61afe5dc8e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:56.777516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bba28-b72e-407e-9cea-61afe5dc8e06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:56.784353 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bba28-b72e-407e-9cea-61afe5dc8e06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:56.785807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bba28-b72e-407e-9cea-61afe5dc8e06 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:56.800060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4c8bba28-b72e-407e-9cea-61afe5dc8e06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:15:56.800060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:56.800060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:56.800060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:56.800060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:56.800060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:56.800060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:56.800060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:56.800060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:56.800060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:56.800060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:56.800060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:56.800060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 15:15:56.800060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 15:15:56.800060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:56.801111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:56.802325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 15:15:56.802325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 15:15:56.802325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 15:15:56.802325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 15:15:56.802325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 15:15:56.802325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 15:15:56.802325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 15:15:56.802325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jun 27 15:15:56.802325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 649/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 27 15:15:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:56.807667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b068a43-07e8-4584-9d63-5f82fdb65cce None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:56.865747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:56.920470 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b068a43-07e8-4584-9d63-5f82fdb65cce None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:56.958103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdbf9f-374e-49f0-9119-bc60105d343a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:56.958968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdbf9f-374e-49f0-9119-bc60105d343a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:56.959063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdbf9f-374e-49f0-9119-bc60105d343a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:56.959350 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdbf9f-374e-49f0-9119-bc60105d343a None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:56.960146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdbf9f-374e-49f0-9119-bc60105d343a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:56.960453 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdbf9f-374e-49f0-9119-bc60105d343a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:56.962033 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdbf9f-374e-49f0-9119-bc60105d343a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:56.975673 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 637/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 27 15:15:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:56.982179 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bba28-b72e-407e-9cea-61afe5dc8e06 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:57.089535 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bba28-b72e-407e-9cea-61afe5dc8e06 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:57.125430 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9896c-7707-430c-afe5-364f6d836f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:57.126112 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9896c-7707-430c-afe5-364f6d836f88 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:57.126428 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9896c-7707-430c-afe5-364f6d836f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:57.126702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9896c-7707-430c-afe5-364f6d836f88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:57.127565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9896c-7707-430c-afe5-364f6d836f88 None admin] RBAC: Adding query filter params (role.id=22010253114c4a80a72a1500d1dcc6a8, scope.project.id=3f8ec287061141028659ab504e7707de, user.id=b471b5b4ede845c7a9dfbf2a90544591) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:57.127880 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9896c-7707-430c-afe5-364f6d836f88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:57.129323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9896c-7707-430c-afe5-364f6d836f88 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:57.135922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 650/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 27 15:15:56 2022] GET /identity/v3/role_assignments?user.id=b471b5b4ede845c7a9dfbf2a90544591&scope.project.id=3f8ec287061141028659ab504e7707de&role.id=22010253114c4a80a72a1500d1dcc6a8 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:59.189671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c7bc9-9a6d-499f-954b-6a08bd96d2e4 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:59.190293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c7bc9-9a6d-499f-954b-6a08bd96d2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:59.190293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c7bc9-9a6d-499f-954b-6a08bd96d2e4 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:59.191640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 638/1288] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:15:59.196991 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9faca-42aa-4c10-a4e4-7a04ef4da28b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:59.197424 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9faca-42aa-4c10-a4e4-7a04ef4da28b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:59.197539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9faca-42aa-4c10-a4e4-7a04ef4da28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:59.216140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-80f9faca-42aa-4c10-a4e4-7a04ef4da28b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:59.217361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-80f9faca-42aa-4c10-a4e4-7a04ef4da28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:59.248773 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:59.289206 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 651/1289] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:15:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:15:59.313366 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c7bc9-9a6d-499f-954b-6a08bd96d2e4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:59.419535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c7bc9-9a6d-499f-954b-6a08bd96d2e4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:59.431054 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:59.457346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b45f8-fa49-4fa9-8cb3-19d4d96a7045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:59.458167 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b45f8-fa49-4fa9-8cb3-19d4d96a7045 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:59.458488 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b45f8-fa49-4fa9-8cb3-19d4d96a7045 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:59.458767 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b45f8-fa49-4fa9-8cb3-19d4d96a7045 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:59.459429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b45f8-fa49-4fa9-8cb3-19d4d96a7045 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:59.460812 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b45f8-fa49-4fa9-8cb3-19d4d96a7045 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-470b45f8-fa49-4fa9-8cb3-19d4d96a7045 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:15:59.473095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:15:59.474437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:15:59.474437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:15:59.474437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:15:59.474437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:15:59.474437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:15:59.474437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:15:59.474437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:15:59.474437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:15:59.474437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:15:59.474437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:15:59.474437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:15:59.474437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:15:59.474437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:15:59.474437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:15:59.474437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:15:59.474437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:15:59.475337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:15:59.475337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:15:59.475337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:15:59.475337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:15:59.475337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:15:59.475337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:15:59.475337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:15:59.475337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:15:59.475337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:15:59.475337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:15:59.475337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:15:59.475337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:15:59.475337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 15:15:59.475337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:15:59.475337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 639/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 27 15:15:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:15:59.481105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9faca-42aa-4c10-a4e4-7a04ef4da28b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:59.587532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9faca-42aa-4c10-a4e4-7a04ef4da28b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:59.637943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0ec1c-1ab6-4363-b34d-671b671fbd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:59.638662 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0ec1c-1ab6-4363-b34d-671b671fbd7e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:59.638952 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0ec1c-1ab6-4363-b34d-671b671fbd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:59.639233 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0ec1c-1ab6-4363-b34d-671b671fbd7e None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:59.639955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0ec1c-1ab6-4363-b34d-671b671fbd7e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:59.640267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0ec1c-1ab6-4363-b34d-671b671fbd7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:59.641634 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0ec1c-1ab6-4363-b34d-671b671fbd7e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:59.647272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 652/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Mon Jun 27 15:15:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:15:59.653284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b45f8-fa49-4fa9-8cb3-19d4d96a7045 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:59.756215 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b45f8-fa49-4fa9-8cb3-19d4d96a7045 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:59.791837 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96d329-afe5-4de7-b045-01160983a548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:59.792501 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96d329-afe5-4de7-b045-01160983a548 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:59.792785 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96d329-afe5-4de7-b045-01160983a548 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:59.793059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96d329-afe5-4de7-b045-01160983a548 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:59.793768 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96d329-afe5-4de7-b045-01160983a548 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:59.794081 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96d329-afe5-4de7-b045-01160983a548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:59.795503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96d329-afe5-4de7-b045-01160983a548 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:59.800506 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 640/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Mon Jun 27 15:15:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:16:01.868113 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c570b25-65fc-427f-9018-0d5f215f0d65 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:01.868799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c570b25-65fc-427f-9018-0d5f215f0d65 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:01.868799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c570b25-65fc-427f-9018-0d5f215f0d65 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:01.870046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 653/1293] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:16:01.878185 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8b731-e502-4e92-8820-bac670d7c1fb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:01.878716 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8b731-e502-4e92-8820-bac670d7c1fb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:01.879047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8b731-e502-4e92-8820-bac670d7c1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:01.900213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-30a8b731-e502-4e92-8820-bac670d7c1fb None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:16:01.901464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-30a8b731-e502-4e92-8820-bac670d7c1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:16:01.936481 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:16:01.980908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 641/1294] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:16:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:16:02.009100 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c570b25-65fc-427f-9018-0d5f215f0d65 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:02.045423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:16:02.119894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c570b25-65fc-427f-9018-0d5f215f0d65 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:02.157925 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc0653-5238-4b90-a48f-05332d73e6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:02.158640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc0653-5238-4b90-a48f-05332d73e6bc None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:02.158921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc0653-5238-4b90-a48f-05332d73e6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:02.159194 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc0653-5238-4b90-a48f-05332d73e6bc None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:02.159914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc0653-5238-4b90-a48f-05332d73e6bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:02.161268 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc0653-5238-4b90-a48f-05332d73e6bc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:02.177553 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 654/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 27 15:16:02 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:16:04.239015 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f374a-340c-4e06-b8f0-a6c0c911f299 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:04.239600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f374a-340c-4e06-b8f0-a6c0c911f299 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:04.239600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f374a-340c-4e06-b8f0-a6c0c911f299 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:04.240962 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 642/1296] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:16:04.246453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4685e-91c7-4181-85a1-20103c2fc54b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:04.246883 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4685e-91c7-4181-85a1-20103c2fc54b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:04.247032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4685e-91c7-4181-85a1-20103c2fc54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:04.265215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a9f4685e-91c7-4181-85a1-20103c2fc54b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:16:04.266459 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a9f4685e-91c7-4181-85a1-20103c2fc54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:16:04.346109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 655/1297] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:16:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:16:04.369463 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f374a-340c-4e06-b8f0-a6c0c911f299 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:04.478325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f374a-340c-4e06-b8f0-a6c0c911f299 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:04.515227 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dcacd-8029-4aa5-b69f-9c95c15b187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:04.516045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dcacd-8029-4aa5-b69f-9c95c15b187d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:04.516332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dcacd-8029-4aa5-b69f-9c95c15b187d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:04.516617 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dcacd-8029-4aa5-b69f-9c95c15b187d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:04.517282 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dcacd-8029-4aa5-b69f-9c95c15b187d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:04.518721 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dcacd-8029-4aa5-b69f-9c95c15b187d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-578dcacd-8029-4aa5-b69f-9c95c15b187d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:16:04.530817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:16:04.531967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:16:04.531967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:16:04.531967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:16:04.531967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:16:04.531967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:16:04.531967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:16:04.531967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:16:04.531967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:16:04.531967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:16:04.531967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:16:04.531967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:16:04.531967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:16:04.531967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:16:04.531967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:16:04.531967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:16:04.531967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:16:04.532809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:16:04.532809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:16:04.532809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:16:04.532809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:16:04.532809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:16:04.532809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:16:04.532809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:16:04.532809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:16:04.532809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:16:04.532809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:16:04.532809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:16:04.532809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:16:04.532809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 15:16:04.532809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:16:04.532809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 643/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 27 15:16:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:16:04.538400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4685e-91c7-4181-85a1-20103c2fc54b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:04.559497 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:16:04.644424 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4685e-91c7-4181-85a1-20103c2fc54b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:04.681060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cade6-7c7b-4aef-9def-484935180d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:04.681739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cade6-7c7b-4aef-9def-484935180d57 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:04.682026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cade6-7c7b-4aef-9def-484935180d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:04.682329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cade6-7c7b-4aef-9def-484935180d57 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:04.683049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cade6-7c7b-4aef-9def-484935180d57 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:16:04.683362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cade6-7c7b-4aef-9def-484935180d57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:04.684758 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cade6-7c7b-4aef-9def-484935180d57 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:04.690580 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 656/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Mon Jun 27 15:16:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:16:04.696818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dcacd-8029-4aa5-b69f-9c95c15b187d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:04.731678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:16:04.803515 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dcacd-8029-4aa5-b69f-9c95c15b187d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:04.840834 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe961f-a4bf-45c4-ba35-a8ffde58dad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:04.841516 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe961f-a4bf-45c4-ba35-a8ffde58dad5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:04.841804 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe961f-a4bf-45c4-ba35-a8ffde58dad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:04.842083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe961f-a4bf-45c4-ba35-a8ffde58dad5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:04.842922 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe961f-a4bf-45c4-ba35-a8ffde58dad5 None admin] RBAC: Adding query filter params (interface=public, service_id=5a535c4b06d34898a8e612b123a94c63, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:16:04.843241 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe961f-a4bf-45c4-ba35-a8ffde58dad5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:04.844636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe961f-a4bf-45c4-ba35-a8ffde58dad5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:04.850191 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 644/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Jun 27 15:16:04 2022] GET /identity/v3/endpoints?service_id=5a535c4b06d34898a8e612b123a94c63&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:16:04.856322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cade6-7c7b-4aef-9def-484935180d57 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:04.941797 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:16:04.962620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cade6-7c7b-4aef-9def-484935180d57 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:04.998645 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700c2d4-0623-4fa9-8fc4-2d3c3c6f96f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:04.999215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700c2d4-0623-4fa9-8fc4-2d3c3c6f96f8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:04.999496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700c2d4-0623-4fa9-8fc4-2d3c3c6f96f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:04.999770 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700c2d4-0623-4fa9-8fc4-2d3c3c6f96f8 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:05.000452 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700c2d4-0623-4fa9-8fc4-2d3c3c6f96f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:05.001821 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700c2d4-0623-4fa9-8fc4-2d3c3c6f96f8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:05.009025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 657/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 27 15:16:04 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:16:07.042285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fef631-26a4-4cce-a6cf-6b0b65b8b83b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:07.042887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fef631-26a4-4cce-a6cf-6b0b65b8b83b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:07.042887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fef631-26a4-4cce-a6cf-6b0b65b8b83b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:07.044249 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 645/1302] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:16:07.050111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d2de5-cf99-4413-b312-c90dcc8d6de2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:07.050583 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d2de5-cf99-4413-b312-c90dcc8d6de2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:07.050752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d2de5-cf99-4413-b312-c90dcc8d6de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:07.068685 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0f9d2de5-cf99-4413-b312-c90dcc8d6de2 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:16:07.069908 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0f9d2de5-cf99-4413-b312-c90dcc8d6de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:16:07.142942 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 658/1303] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:16:07 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 15:16:07.166171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fef631-26a4-4cce-a6cf-6b0b65b8b83b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:07.269911 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:16:07.277713 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fef631-26a4-4cce-a6cf-6b0b65b8b83b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:07.314095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82960ecc-d45b-4a62-9604-68fe3ce56253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:07.314843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82960ecc-d45b-4a62-9604-68fe3ce56253 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:07.315127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82960ecc-d45b-4a62-9604-68fe3ce56253 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:07.315408 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82960ecc-d45b-4a62-9604-68fe3ce56253 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:07.316076 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82960ecc-d45b-4a62-9604-68fe3ce56253 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:07.317467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82960ecc-d45b-4a62-9604-68fe3ce56253 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-82960ecc-d45b-4a62-9604-68fe3ce56253 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 15:16:07.329928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 15:16:07.331110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 15:16:07.331110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 15:16:07.331110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 15:16:07.331110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 15:16:07.331110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 15:16:07.331110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 15:16:07.331110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 15:16:07.331110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 15:16:07.331110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 15:16:07.331110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 15:16:07.331110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 15:16:07.331110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 15:16:07.331110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 15:16:07.331110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 15:16:07.331110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 15:16:07.331110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 15:16:07.332351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 15:16:07.332351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jun 27 15:16:07.332351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 15:16:07.332351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jun 27 15:16:07.332351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 15:16:07.332351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 15:16:07.332351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 15:16:07.332351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jun 27 15:16:07.332351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 15:16:07.332351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jun 27 15:16:07.332351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 15:16:07.332351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 15:16:07.332351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 15:16:07.332351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jun 27 15:16:07.332351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 646/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 27 15:16:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 15:16:07.340576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d2de5-cf99-4413-b312-c90dcc8d6de2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:07.420722 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:16:07.445334 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d2de5-cf99-4413-b312-c90dcc8d6de2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:07.480400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef36c98-da38-4bc5-af46-c2b7d3cc4549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:07.481271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef36c98-da38-4bc5-af46-c2b7d3cc4549 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:07.481422 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef36c98-da38-4bc5-af46-c2b7d3cc4549 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:07.481609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef36c98-da38-4bc5-af46-c2b7d3cc4549 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:07.482355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef36c98-da38-4bc5-af46-c2b7d3cc4549 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:16:07.482662 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef36c98-da38-4bc5-af46-c2b7d3cc4549 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:07.484040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef36c98-da38-4bc5-af46-c2b7d3cc4549 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:07.489578 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 659/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Mon Jun 27 15:16:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:16:07.496312 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82960ecc-d45b-4a62-9604-68fe3ce56253 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:07.599562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82960ecc-d45b-4a62-9604-68fe3ce56253 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:07.636065 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261612-cf61-42a3-a57f-d8d5cc97b971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:07.636720 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261612-cf61-42a3-a57f-d8d5cc97b971 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:07.637000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261612-cf61-42a3-a57f-d8d5cc97b971 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:07.637272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261612-cf61-42a3-a57f-d8d5cc97b971 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:07.638016 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93261612-cf61-42a3-a57f-d8d5cc97b971 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:07.639429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93261612-cf61-42a3-a57f-d8d5cc97b971 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:07.659708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 647/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 27 15:16:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:16:17.487146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=30 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:16:17.655455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:18.360443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de69a2-73d9-4217-bab6-99e70fca8e72 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:18.360443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de69a2-73d9-4217-bab6-99e70fca8e72 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:18.362113 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de69a2-73d9-4217-bab6-99e70fca8e72 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:18.362113 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 660/1307] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:17:18.370310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0abde0-ec13-4c16-b07c-1b157120d6f8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:18.370787 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0abde0-ec13-4c16-b07c-1b157120d6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:18.370867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0abde0-ec13-4c16-b07c-1b157120d6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:18.551540 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8e0abde0-ec13-4c16-b07c-1b157120d6f8 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:17:18.553328 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8e0abde0-ec13-4c16-b07c-1b157120d6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:18.766883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 648/1308] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:17:18.811178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99b4ae-680e-4dec-bf5b-953bae769376 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:18.812150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99b4ae-680e-4dec-bf5b-953bae769376 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:18.812767 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99b4ae-680e-4dec-bf5b-953bae769376 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:18.817139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 661/1309] 10.222.0.33 () {54 vars in 964 bytes} [Mon Jun 27 15:17:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:17:18.824216 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0442ca-a16a-4793-9692-0f75530147aa None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:18.824711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0442ca-a16a-4793-9692-0f75530147aa None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:18.825143 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0442ca-a16a-4793-9692-0f75530147aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:18.942353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fa0442ca-a16a-4793-9692-0f75530147aa None None] MFA Rules not processed for user `67dbb53f47ca406c96377408e9f893f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:17:18.944825 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fa0442ca-a16a-4793-9692-0f75530147aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:18.980579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:19.067398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 649/1310] 10.222.0.33 () {58 vars in 1061 bytes} [Mon Jun 27 15:17:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:17:19.076991 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99b4ae-680e-4dec-bf5b-953bae769376 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:17:19.079414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9c99b4ae-680e-4dec-bf5b-953bae769376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:19.271802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99b4ae-680e-4dec-bf5b-953bae769376 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:17:19.390400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684aae66-1ce4-47d3-98a9-ec596e4ed37d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:17:19.391862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aae66-1ce4-47d3-98a9-ec596e4ed37d service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:19.392361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aae66-1ce4-47d3-98a9-ec596e4ed37d service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:19.393055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aae66-1ce4-47d3-98a9-ec596e4ed37d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:19.396283 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-684aae66-1ce4-47d3-98a9-ec596e4ed37d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:19.469605 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:19.541796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aae66-1ce4-47d3-98a9-ec596e4ed37d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:17:19.544405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aae66-1ce4-47d3-98a9-ec596e4ed37d service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:17:19.571897 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 662/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:17:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:17:21.925905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af71a60-690e-4041-8282-6727dd8ddb5b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:21.926580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af71a60-690e-4041-8282-6727dd8ddb5b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:21.926580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af71a60-690e-4041-8282-6727dd8ddb5b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:21.927910 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 650/1312] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:17:21.933949 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857b959-f6d0-4a41-9a77-bfca7bf811e3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:21.934421 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857b959-f6d0-4a41-9a77-bfca7bf811e3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:21.934530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857b959-f6d0-4a41-9a77-bfca7bf811e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:22.025108 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0857b959-f6d0-4a41-9a77-bfca7bf811e3 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:17:22.026390 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0857b959-f6d0-4a41-9a77-bfca7bf811e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:22.129876 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 663/1313] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:17:22.169028 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af71a60-690e-4041-8282-6727dd8ddb5b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:17:22.171046 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6af71a60-690e-4041-8282-6727dd8ddb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:22.287332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af71a60-690e-4041-8282-6727dd8ddb5b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:17:22.374907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:22.377942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa9fdc-a38c-4b24-b23b-bcddd02c4a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:17:22.378584 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa9fdc-a38c-4b24-b23b-bcddd02c4a7d service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:22.378880 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa9fdc-a38c-4b24-b23b-bcddd02c4a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:22.379170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa9fdc-a38c-4b24-b23b-bcddd02c4a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:22.381571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a7aa9fdc-a38c-4b24-b23b-bcddd02c4a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:22.496003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa9fdc-a38c-4b24-b23b-bcddd02c4a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:17:22.497457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa9fdc-a38c-4b24-b23b-bcddd02c4a7d service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:17:22.516862 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 651/1314] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:17:24.928134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4b792-767d-4d8a-b4a2-b0dc8054d21a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:24.928708 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4b792-767d-4d8a-b4a2-b0dc8054d21a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:24.928708 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4b792-767d-4d8a-b4a2-b0dc8054d21a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:24.930085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 664/1315] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:17:24.935643 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cf0f2-8a24-44be-9eee-f6abacfb1e9f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:24.936067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cf0f2-8a24-44be-9eee-f6abacfb1e9f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:24.936161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cf0f2-8a24-44be-9eee-f6abacfb1e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:25.005062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ca4cf0f2-8a24-44be-9eee-f6abacfb1e9f None None] MFA Rules not processed for user `b837aa4151fc426f856f309fe1286c92`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:17:25.006357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ca4cf0f2-8a24-44be-9eee-f6abacfb1e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:25.059616 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:25.109714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 652/1316] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:17:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:17:25.150306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4b792-767d-4d8a-b4a2-b0dc8054d21a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:17:25.154510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-49d4b792-767d-4d8a-b4a2-b0dc8054d21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:25.165215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:25.270343 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4b792-767d-4d8a-b4a2-b0dc8054d21a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:17:25.347418 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fb7c1-9262-4c24-a32a-ff827c6ed3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:17:25.348085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fb7c1-9262-4c24-a32a-ff827c6ed3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:25.348368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fb7c1-9262-4c24-a32a-ff827c6ed3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:25.348657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fb7c1-9262-4c24-a32a-ff827c6ed3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:25.350618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dd9fb7c1-9262-4c24-a32a-ff827c6ed3f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:25.415384 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:25.465106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9fb7c1-9262-4c24-a32a-ff827c6ed3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:17:25.466597 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9fb7c1-9262-4c24-a32a-ff827c6ed3f8 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:17:25.485046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 665/1317] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:17:25 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:17:28.113422 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f696ea-98e7-41d8-97da-950a349558ff None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:28.113992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f696ea-98e7-41d8-97da-950a349558ff None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:28.113992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f696ea-98e7-41d8-97da-950a349558ff None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:28.115433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 653/1318] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:17:28.121305 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f778b-4ae8-4d29-86f4-c925174ba5bd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:28.121791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f778b-4ae8-4d29-86f4-c925174ba5bd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:28.121891 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f778b-4ae8-4d29-86f4-c925174ba5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:28.207745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ca5f778b-4ae8-4d29-86f4-c925174ba5bd None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:17:28.209783 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ca5f778b-4ae8-4d29-86f4-c925174ba5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:28.322824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 666/1319] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:17:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:17:28.376636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fae07-a78d-4ced-9db1-b7fbffef977c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:28.376919 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fae07-a78d-4ced-9db1-b7fbffef977c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:28.377087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fae07-a78d-4ced-9db1-b7fbffef977c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:28.378491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 654/1320] 10.222.0.33 () {54 vars in 964 bytes} [Mon Jun 27 15:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:17:28.387400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530ff8-19a0-4c0c-85e5-e35c954e11ff None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:28.387698 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530ff8-19a0-4c0c-85e5-e35c954e11ff None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:28.387981 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530ff8-19a0-4c0c-85e5-e35c954e11ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:28.410432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:28.481722 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-03530ff8-19a0-4c0c-85e5-e35c954e11ff None None] MFA Rules not processed for user `67dbb53f47ca406c96377408e9f893f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:17:28.483020 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-03530ff8-19a0-4c0c-85e5-e35c954e11ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:28.565986 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 667/1321] 10.222.0.33 () {58 vars in 1061 bytes} [Mon Jun 27 15:17:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:17:28.575930 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fae07-a78d-4ced-9db1-b7fbffef977c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:17:28.577496 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fb7fae07-a78d-4ced-9db1-b7fbffef977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:28.690652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fae07-a78d-4ced-9db1-b7fbffef977c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:17:28.768270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d77c1-96b1-4a76-a240-4ad7766fad60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:17:28.768938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d77c1-96b1-4a76-a240-4ad7766fad60 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:28.769223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d77c1-96b1-4a76-a240-4ad7766fad60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:28.769502 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d77c1-96b1-4a76-a240-4ad7766fad60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:28.771255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5c3d77c1-96b1-4a76-a240-4ad7766fad60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:28.779613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:28.899648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d77c1-96b1-4a76-a240-4ad7766fad60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:17:28.901092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d77c1-96b1-4a76-a240-4ad7766fad60 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:17:28.922017 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 655/1322] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:17:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:17:32.383726 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4a2a5-eeb5-4624-a7ab-c3513f9d4976 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:32.384284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4a2a5-eeb5-4624-a7ab-c3513f9d4976 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:32.384284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4a2a5-eeb5-4624-a7ab-c3513f9d4976 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:32.385715 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 668/1323] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:17:32.391549 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1c24-fe93-471b-bed8-7d423289b989 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:32.392027 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1c24-fe93-471b-bed8-7d423289b989 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:32.392131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1c24-fe93-471b-bed8-7d423289b989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:32.474704 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c0ea1c24-fe93-471b-bed8-7d423289b989 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:17:32.476031 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c0ea1c24-fe93-471b-bed8-7d423289b989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:32.550114 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:32.595138 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 656/1324] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:17:32.636367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4a2a5-eeb5-4624-a7ab-c3513f9d4976 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:17:32.636367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d0c4a2a5-eeb5-4624-a7ab-c3513f9d4976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:32.756769 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4a2a5-eeb5-4624-a7ab-c3513f9d4976 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:17:32.770199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:32.858978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e736d-fb41-4f58-9f62-c0d99fac1a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:17:32.859658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e736d-fb41-4f58-9f62-c0d99fac1a65 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:32.859941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e736d-fb41-4f58-9f62-c0d99fac1a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:32.860217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e736d-fb41-4f58-9f62-c0d99fac1a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:32.861968 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6b2e736d-fb41-4f58-9f62-c0d99fac1a65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:32.989395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e736d-fb41-4f58-9f62-c0d99fac1a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:17:32.992019 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e736d-fb41-4f58-9f62-c0d99fac1a65 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:17:33.018202 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 669/1325] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:17:35.170267 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f80031-5957-4d0a-b31d-acd0947f4b4a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:35.170857 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f80031-5957-4d0a-b31d-acd0947f4b4a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:35.170857 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f80031-5957-4d0a-b31d-acd0947f4b4a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:35.172209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 657/1326] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:17:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:17:35.178421 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b86864-05bb-43e6-836d-fca585960595 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:35.178965 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b86864-05bb-43e6-836d-fca585960595 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:35.179082 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b86864-05bb-43e6-836d-fca585960595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:35.234193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:35.258322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-42b86864-05bb-43e6-836d-fca585960595 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:17:35.259542 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-42b86864-05bb-43e6-836d-fca585960595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:35.381717 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 670/1327] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:17:35.419585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f80031-5957-4d0a-b31d-acd0947f4b4a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:17:35.422871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-03f80031-5957-4d0a-b31d-acd0947f4b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:35.545450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f80031-5957-4d0a-b31d-acd0947f4b4a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:17:35.646307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cf2e4-552d-4543-b64b-021f5cc9145f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:17:35.646957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cf2e4-552d-4543-b64b-021f5cc9145f service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:35.647179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cf2e4-552d-4543-b64b-021f5cc9145f service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:35.647378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cf2e4-552d-4543-b64b-021f5cc9145f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:35.649081 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3b1cf2e4-552d-4543-b64b-021f5cc9145f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:35.668570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:35.772275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1cf2e4-552d-4543-b64b-021f5cc9145f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:17:35.774023 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1cf2e4-552d-4543-b64b-021f5cc9145f service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:17:35.795338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 658/1328] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:17:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:17:37.915829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e8395-0689-4802-85f0-02aa05eb8949 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:37.916474 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e8395-0689-4802-85f0-02aa05eb8949 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:37.916474 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e8395-0689-4802-85f0-02aa05eb8949 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:37.917779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 671/1329] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:17:37.924317 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5055e3-8495-46f2-96e4-eb79cadee945 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:37.924918 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5055e3-8495-46f2-96e4-eb79cadee945 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:37.924918 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5055e3-8495-46f2-96e4-eb79cadee945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:37.996518 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-de5055e3-8495-46f2-96e4-eb79cadee945 None None] MFA Rules not processed for user `b837aa4151fc426f856f309fe1286c92`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:17:37.997783 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-de5055e3-8495-46f2-96e4-eb79cadee945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:38.076048 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:38.112537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 659/1330] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:17:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:17:38.149196 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e8395-0689-4802-85f0-02aa05eb8949 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:17:38.150858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7b3e8395-0689-4802-85f0-02aa05eb8949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:38.259055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e8395-0689-4802-85f0-02aa05eb8949 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:17:38.292650 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:38.367912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257688c5-221d-4601-b6b5-387476e9328b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:17:38.368477 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257688c5-221d-4601-b6b5-387476e9328b service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:38.368760 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257688c5-221d-4601-b6b5-387476e9328b service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:38.369034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257688c5-221d-4601-b6b5-387476e9328b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:38.370843 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-257688c5-221d-4601-b6b5-387476e9328b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:38.484080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257688c5-221d-4601-b6b5-387476e9328b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:17:38.485534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257688c5-221d-4601-b6b5-387476e9328b service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:17:38.504887 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 672/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:17:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:17:40.795145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0a7db-eafb-4c32-9d98-716124491638 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:40.795720 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0a7db-eafb-4c32-9d98-716124491638 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:40.795720 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0a7db-eafb-4c32-9d98-716124491638 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:40.797112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 660/1332] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:17:40.802980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b20ad6-e013-4e19-8c6f-2f93d5e27e27 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:40.803416 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b20ad6-e013-4e19-8c6f-2f93d5e27e27 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:40.803528 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b20ad6-e013-4e19-8c6f-2f93d5e27e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:40.872275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:40.875037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-49b20ad6-e013-4e19-8c6f-2f93d5e27e27 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:17:40.876878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-49b20ad6-e013-4e19-8c6f-2f93d5e27e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:40.992759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 673/1333] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:17:41.029756 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0a7db-eafb-4c32-9d98-716124491638 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:17:41.031351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b2b0a7db-eafb-4c32-9d98-716124491638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:41.156581 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0a7db-eafb-4c32-9d98-716124491638 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:17:41.251467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2b366-1bfd-4337-941e-d087df9a6210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:17:41.252136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2b366-1bfd-4337-941e-d087df9a6210 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:41.252416 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2b366-1bfd-4337-941e-d087df9a6210 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:41.252690 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2b366-1bfd-4337-941e-d087df9a6210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:41.254395 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-91d2b366-1bfd-4337-941e-d087df9a6210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:41.285577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:41.378826 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2b366-1bfd-4337-941e-d087df9a6210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:17:41.380247 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2b366-1bfd-4337-941e-d087df9a6210 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:17:41.399607 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 661/1334] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:17:43.520598 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a47f3-8985-45ed-a5bc-5ce29b395117 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:43.521441 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a47f3-8985-45ed-a5bc-5ce29b395117 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:43.521441 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a47f3-8985-45ed-a5bc-5ce29b395117 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:43.522557 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 674/1335] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:17:43.528548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceae41f-365a-49cc-b68d-06889b5d8ee9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:43.529006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceae41f-365a-49cc-b68d-06889b5d8ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:43.529121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceae41f-365a-49cc-b68d-06889b5d8ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:43.600068 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-eceae41f-365a-49cc-b68d-06889b5d8ee9 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:17:43.601317 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-eceae41f-365a-49cc-b68d-06889b5d8ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:43.679425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:43.703086 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 662/1336] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:17:43.744221 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a47f3-8985-45ed-a5bc-5ce29b395117 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:17:43.745794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-887a47f3-8985-45ed-a5bc-5ce29b395117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:43.856470 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a47f3-8985-45ed-a5bc-5ce29b395117 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:17:43.884907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:43.931609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ae170-1320-43f9-8cf9-d9dbfa980524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:17:43.932261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ae170-1320-43f9-8cf9-d9dbfa980524 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:43.932539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ae170-1320-43f9-8cf9-d9dbfa980524 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:43.932818 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ae170-1320-43f9-8cf9-d9dbfa980524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:43.934495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7e6ae170-1320-43f9-8cf9-d9dbfa980524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:44.048165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ae170-1320-43f9-8cf9-d9dbfa980524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:17:44.049565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ae170-1320-43f9-8cf9-d9dbfa980524 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:17:44.073098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 675/1337] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:17:46.522963 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18630bd1-a556-414c-a4d4-2c155b34e667 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:46.523559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18630bd1-a556-414c-a4d4-2c155b34e667 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:46.523559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18630bd1-a556-414c-a4d4-2c155b34e667 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:46.524907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 663/1338] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:17:46.530510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dba137-dad8-466a-a259-46eacacdbd28 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:46.530947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dba137-dad8-466a-a259-46eacacdbd28 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:46.531042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dba137-dad8-466a-a259-46eacacdbd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:46.599629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c7dba137-dad8-466a-a259-46eacacdbd28 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:17:46.600863 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c7dba137-dad8-466a-a259-46eacacdbd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:46.609755 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:46.701238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 676/1339] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:17:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:17:46.737939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18630bd1-a556-414c-a4d4-2c155b34e667 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:17:46.739639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-18630bd1-a556-414c-a4d4-2c155b34e667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:46.851956 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18630bd1-a556-414c-a4d4-2c155b34e667 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:17:46.938440 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23a440-9e68-4c00-bf36-93c34484ab98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:17:46.939109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23a440-9e68-4c00-bf36-93c34484ab98 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:46.939385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23a440-9e68-4c00-bf36-93c34484ab98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:46.939661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23a440-9e68-4c00-bf36-93c34484ab98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:46.941320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fb23a440-9e68-4c00-bf36-93c34484ab98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:46.978865 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:47.058440 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23a440-9e68-4c00-bf36-93c34484ab98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:17:47.059912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23a440-9e68-4c00-bf36-93c34484ab98 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:17:47.080626 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 664/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:17:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:17:51.195251 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf88dc3-6501-4c00-98a3-940f6beb3fda None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:51.195795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf88dc3-6501-4c00-98a3-940f6beb3fda None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:51.195795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf88dc3-6501-4c00-98a3-940f6beb3fda None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:51.197152 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 677/1341] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:17:51.203003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82712e-3512-482e-b471-bda3c8e570ae None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:51.203479 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82712e-3512-482e-b471-bda3c8e570ae None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:51.203576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82712e-3512-482e-b471-bda3c8e570ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:51.284722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ec82712e-3512-482e-b471-bda3c8e570ae None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:17:51.285981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ec82712e-3512-482e-b471-bda3c8e570ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:51.387021 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:51.401751 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 665/1342] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:17:51.441500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf88dc3-6501-4c00-98a3-940f6beb3fda None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:17:51.443963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-caf88dc3-6501-4c00-98a3-940f6beb3fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:51.549064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf88dc3-6501-4c00-98a3-940f6beb3fda None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:17:51.553519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52b56e-fbd0-4c69-ad2b-3157cddeecc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:17:51.554195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52b56e-fbd0-4c69-ad2b-3157cddeecc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:51.554513 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52b56e-fbd0-4c69-ad2b-3157cddeecc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:51.554798 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52b56e-fbd0-4c69-ad2b-3157cddeecc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:51.564900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52b56e-fbd0-4c69-ad2b-3157cddeecc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:17:51.566392 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52b56e-fbd0-4c69-ad2b-3157cddeecc5 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:17:51.576565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 678/1343] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:17:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:17:54.437676 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ad3e2-d4f9-4ed4-8cf9-31461c6307f1 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:54.438286 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ad3e2-d4f9-4ed4-8cf9-31461c6307f1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:54.438286 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ad3e2-d4f9-4ed4-8cf9-31461c6307f1 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:54.439877 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 666/1344] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:17:54.446049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9560b-46ed-495b-9409-8f0bf18a743a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:54.446689 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9560b-46ed-495b-9409-8f0bf18a743a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:54.446689 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9560b-46ed-495b-9409-8f0bf18a743a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:54.479216 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-99e9560b-46ed-495b-9409-8f0bf18a743a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:17:54.480481 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-99e9560b-46ed-495b-9409-8f0bf18a743a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:54.515212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:17:54.572278 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 679/1345] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:17:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:17:54.611109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ad3e2-d4f9-4ed4-8cf9-31461c6307f1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:17:54.613365 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-509ad3e2-d4f9-4ed4-8cf9-31461c6307f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:54.628557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ad3e2-d4f9-4ed4-8cf9-31461c6307f1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:17:54.632921 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b30346-93b0-4ef1-a1ea-c9cab2643ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:17:54.633681 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b30346-93b0-4ef1-a1ea-c9cab2643ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:54.634040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b30346-93b0-4ef1-a1ea-c9cab2643ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:54.634415 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b30346-93b0-4ef1-a1ea-c9cab2643ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:54.644508 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b30346-93b0-4ef1-a1ea-c9cab2643ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:17:54.646005 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b30346-93b0-4ef1-a1ea-c9cab2643ef5 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:17:54.657103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 667/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:17:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:17:58.824592 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311e3b0-4479-41cc-b577-2bb38a338329 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:58.824592 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311e3b0-4479-41cc-b577-2bb38a338329 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:58.824592 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311e3b0-4479-41cc-b577-2bb38a338329 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:58.825587 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 680/1347] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:17:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:17:58.832008 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866904bc-2550-4250-997d-9d8d98debada None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:58.832554 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866904bc-2550-4250-997d-9d8d98debada None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:58.832554 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866904bc-2550-4250-997d-9d8d98debada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:58.851907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-866904bc-2550-4250-997d-9d8d98debada None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:17:58.853157 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-866904bc-2550-4250-997d-9d8d98debada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:17:58.861421 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 668/1348] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:17:58.900140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311e3b0-4479-41cc-b577-2bb38a338329 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:17:58.911701 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311e3b0-4479-41cc-b577-2bb38a338329 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:17:58.915667 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77322c65-fefd-45a6-939b-ae13f56c5a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:17:58.916325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77322c65-fefd-45a6-939b-ae13f56c5a3e service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:17:58.916610 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77322c65-fefd-45a6-939b-ae13f56c5a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:17:58.916885 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77322c65-fefd-45a6-939b-ae13f56c5a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:17:58.928120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77322c65-fefd-45a6-939b-ae13f56c5a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:17:58.929596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77322c65-fefd-45a6-939b-ae13f56c5a3e service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:17:58.941901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 681/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:17:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:18:04.269911 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c96d6-9445-46ee-ac00-5c6080c99ed8 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:04.271347 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c96d6-9445-46ee-ac00-5c6080c99ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:04.272265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c96d6-9445-46ee-ac00-5c6080c99ed8 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:04.275099 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 669/1350] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 27 15:18:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:04.284085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1ec19-3a66-4cd9-acdc-f34fd8655bd3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:04.284085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1ec19-3a66-4cd9-acdc-f34fd8655bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:04.284085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1ec19-3a66-4cd9-acdc-f34fd8655bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:04.413518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e1a1ec19-3a66-4cd9-acdc-f34fd8655bd3 None None] MFA Rules not processed for user `b471b5b4ede845c7a9dfbf2a90544591`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:04.415556 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e1a1ec19-3a66-4cd9-acdc-f34fd8655bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:04.633138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 682/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 27 15:18:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:08.845970 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=13 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:18:09.326333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c140-0cb9-4132-8f44-40b195fae8a1 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:09.327250 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c140-0cb9-4132-8f44-40b195fae8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:09.327921 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c140-0cb9-4132-8f44-40b195fae8a1 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:09.330133 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 670/1352] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 27 15:18:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:09.337801 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f3915-e558-4518-b10a-1b414c9fc75b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:09.338563 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f3915-e558-4518-b10a-1b414c9fc75b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:09.338777 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f3915-e558-4518-b10a-1b414c9fc75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:09.366891 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b04f3915-e558-4518-b10a-1b414c9fc75b None None] MFA Rules not processed for user `b471b5b4ede845c7a9dfbf2a90544591`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:09.368398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b04f3915-e558-4518-b10a-1b414c9fc75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:09.380572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 683/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 27 15:18:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:10.945399 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf7b16-31e5-4138-ba6a-a9b77159b6d0 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:10.946138 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf7b16-31e5-4138-ba6a-a9b77159b6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:10.946609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf7b16-31e5-4138-ba6a-a9b77159b6d0 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:10.949219 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 671/1354] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 27 15:18:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:10.955165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d9eeb-e3e8-4242-a234-f12c173c0bef None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:10.955951 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d9eeb-e3e8-4242-a234-f12c173c0bef None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:10.956172 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d9eeb-e3e8-4242-a234-f12c173c0bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:10.975919 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0f0d9eeb-e3e8-4242-a234-f12c173c0bef None None] MFA Rules not processed for user `b471b5b4ede845c7a9dfbf2a90544591`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:10.977266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0f0d9eeb-e3e8-4242-a234-f12c173c0bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:10.986680 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 684/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 27 15:18:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:18:15.153747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63eae8-b7fa-440d-968a-2940269b0464 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:15.154381 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63eae8-b7fa-440d-968a-2940269b0464 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:15.154381 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63eae8-b7fa-440d-968a-2940269b0464 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:15.155780 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 672/1356] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:18:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:15.162840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9167f-5875-4f0b-8a79-b4861e3b73c5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:15.163476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9167f-5875-4f0b-8a79-b4861e3b73c5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:15.164027 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9167f-5875-4f0b-8a79-b4861e3b73c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:15.187194 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1cd9167f-5875-4f0b-8a79-b4861e3b73c5 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:15.189901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1cd9167f-5875-4f0b-8a79-b4861e3b73c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:15.205579 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 685/1357] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:15.269559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e913d3-dee7-42a5-beb5-f0722f893271 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:15.270584 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e913d3-dee7-42a5-beb5-f0722f893271 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:15.271277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e913d3-dee7-42a5-beb5-f0722f893271 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:15.274603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 673/1358] 10.222.0.33 () {54 vars in 961 bytes} [Mon Jun 27 15:18:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:15.300389 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8be73-5159-4187-8e21-9b352fb8f433 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:15.300389 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8be73-5159-4187-8e21-9b352fb8f433 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:15.300389 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8be73-5159-4187-8e21-9b352fb8f433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:15.379654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:18:15.399194 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-42b8be73-5159-4187-8e21-9b352fb8f433 None None] MFA Rules not processed for user `37a36c30e9dc472d97d762d236dd865a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:15.401075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-42b8be73-5159-4187-8e21-9b352fb8f433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:15.531871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 686/1359] 10.222.0.33 () {58 vars in 1058 bytes} [Mon Jun 27 15:18:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:15.540159 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e913d3-dee7-42a5-beb5-f0722f893271 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:18:15.557588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e913d3-dee7-42a5-beb5-f0722f893271 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:18:15.563624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369eb57-9526-4d44-9125-ed56f482e5c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:18:15.564354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369eb57-9526-4d44-9125-ed56f482e5c8 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:15.564704 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369eb57-9526-4d44-9125-ed56f482e5c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:15.565032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369eb57-9526-4d44-9125-ed56f482e5c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:15.574249 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369eb57-9526-4d44-9125-ed56f482e5c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:18:15.576005 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369eb57-9526-4d44-9125-ed56f482e5c8 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:18:15.587140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 674/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:18:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:18:17.932200 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57135303-6ad3-46f0-aa08-db9a113e31f4 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:17.932821 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57135303-6ad3-46f0-aa08-db9a113e31f4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:17.933228 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57135303-6ad3-46f0-aa08-db9a113e31f4 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:17.936097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 687/1361] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:18:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:17.942294 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660c48-092d-47bc-9d08-be714855b9e2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:17.942911 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660c48-092d-47bc-9d08-be714855b9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:17.942911 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660c48-092d-47bc-9d08-be714855b9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:17.963734 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-22660c48-092d-47bc-9d08-be714855b9e2 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:17.965288 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-22660c48-092d-47bc-9d08-be714855b9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:17.973708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 675/1362] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:18.021531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57135303-6ad3-46f0-aa08-db9a113e31f4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:18:18.036220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57135303-6ad3-46f0-aa08-db9a113e31f4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:18:18.042439 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2d665-3b11-457e-8a1f-c70fb7d390cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:18:18.043134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2d665-3b11-457e-8a1f-c70fb7d390cd service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:18.043425 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2d665-3b11-457e-8a1f-c70fb7d390cd service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:18.043707 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2d665-3b11-457e-8a1f-c70fb7d390cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:18.055767 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2d665-3b11-457e-8a1f-c70fb7d390cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:18:18.057475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2d665-3b11-457e-8a1f-c70fb7d390cd service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:18:18.069208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 688/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:18:20.521671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75f22d-1ca4-4c45-b07e-4b2805ceabda None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:20.522156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75f22d-1ca4-4c45-b07e-4b2805ceabda None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:20.522501 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75f22d-1ca4-4c45-b07e-4b2805ceabda None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:20.523898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 676/1364] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:20.530041 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921b55e-85a8-49fc-8bb6-025bf52bbc8e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:20.530617 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921b55e-85a8-49fc-8bb6-025bf52bbc8e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:20.530814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921b55e-85a8-49fc-8bb6-025bf52bbc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:20.553105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8921b55e-85a8-49fc-8bb6-025bf52bbc8e None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:20.554353 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8921b55e-85a8-49fc-8bb6-025bf52bbc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:20.563213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 689/1365] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:20.610767 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb29e3-4cf8-4d2e-b043-8c2dd6231dd3 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:20.611036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb29e3-4cf8-4d2e-b043-8c2dd6231dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:20.611572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb29e3-4cf8-4d2e-b043-8c2dd6231dd3 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:20.613199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 677/1366] 10.222.0.33 () {54 vars in 961 bytes} [Mon Jun 27 15:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:20.619093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a066c-6f19-471d-b549-3ab7c800fcd2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:20.619434 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a066c-6f19-471d-b549-3ab7c800fcd2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:20.619696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a066c-6f19-471d-b549-3ab7c800fcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:20.641294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7d5a066c-6f19-471d-b549-3ab7c800fcd2 None None] MFA Rules not processed for user `37a36c30e9dc472d97d762d236dd865a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:20.642666 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7d5a066c-6f19-471d-b549-3ab7c800fcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:20.653453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 690/1367] 10.222.0.33 () {58 vars in 1058 bytes} [Mon Jun 27 15:18:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:20.665406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb29e3-4cf8-4d2e-b043-8c2dd6231dd3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:18:20.702928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb29e3-4cf8-4d2e-b043-8c2dd6231dd3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:18:20.708884 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535c467-db73-423f-9932-1dca0a325b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:18:20.712672 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c467-db73-423f-9932-1dca0a325b5e service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:20.712672 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c467-db73-423f-9932-1dca0a325b5e service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:20.712672 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c467-db73-423f-9932-1dca0a325b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:20.722414 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535c467-db73-423f-9932-1dca0a325b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:18:20.724038 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535c467-db73-423f-9932-1dca0a325b5e service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:18:20.734742 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 678/1368] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:18:22.905258 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b265ad-c53e-4f49-8879-1d6f151500e9 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:22.905923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b265ad-c53e-4f49-8879-1d6f151500e9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:22.905923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b265ad-c53e-4f49-8879-1d6f151500e9 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:22.907202 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 691/1369] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:22.912772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008a761-9139-42f2-913d-3118a52a66c8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:22.913237 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008a761-9139-42f2-913d-3118a52a66c8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:22.913367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008a761-9139-42f2-913d-3118a52a66c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:22.933039 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3008a761-9139-42f2-913d-3118a52a66c8 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:22.934257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3008a761-9139-42f2-913d-3118a52a66c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:22.942825 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 679/1370] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:22.986862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b265ad-c53e-4f49-8879-1d6f151500e9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:18:23.011835 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b265ad-c53e-4f49-8879-1d6f151500e9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:18:23.017533 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8a10c-4b8e-4bda-a7be-c1d50aeb7ca7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:18:23.018236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a10c-4b8e-4bda-a7be-c1d50aeb7ca7 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:23.018524 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a10c-4b8e-4bda-a7be-c1d50aeb7ca7 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:23.018798 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a10c-4b8e-4bda-a7be-c1d50aeb7ca7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:23.029532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8a10c-4b8e-4bda-a7be-c1d50aeb7ca7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:18:23.031196 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8a10c-4b8e-4bda-a7be-c1d50aeb7ca7 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:18:23.043353 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 692/1371] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:18:23.730857 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799e6c7-9fd5-4d3d-a36d-fc4e4e6f5fc3 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:23.731410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799e6c7-9fd5-4d3d-a36d-fc4e4e6f5fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:23.731827 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799e6c7-9fd5-4d3d-a36d-fc4e4e6f5fc3 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:23.733319 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 680/1372] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:18:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:23.738923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a045b-ce76-4d86-a7db-e6167bdd3dc9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:23.739216 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a045b-ce76-4d86-a7db-e6167bdd3dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:23.739493 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a045b-ce76-4d86-a7db-e6167bdd3dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:23.759122 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-dc2a045b-ce76-4d86-a7db-e6167bdd3dc9 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:23.760331 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dc2a045b-ce76-4d86-a7db-e6167bdd3dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:23.768424 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 693/1373] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:18:24.084904 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea33a63-a8b8-4699-8e06-dab6b461bcab None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:24.085424 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea33a63-a8b8-4699-8e06-dab6b461bcab None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:24.085532 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea33a63-a8b8-4699-8e06-dab6b461bcab None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:24.086866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 681/1374] 10.222.0.33 () {54 vars in 963 bytes} [Mon Jun 27 15:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:18:24.093833 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dbc1e-dccf-49f3-aa01-ffb47b9fe73d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:24.094515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dbc1e-dccf-49f3-aa01-ffb47b9fe73d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:24.094783 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dbc1e-dccf-49f3-aa01-ffb47b9fe73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:24.155338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f17dbc1e-dccf-49f3-aa01-ffb47b9fe73d None None] MFA Rules not processed for user `0dccf96088954218a4fb8d7b466f970f`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:24.156543 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f17dbc1e-dccf-49f3-aa01-ffb47b9fe73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:24.230093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 694/1375] 10.222.0.33 () {58 vars in 1060 bytes} [Mon Jun 27 15:18:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:24.238660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea33a63-a8b8-4699-8e06-dab6b461bcab None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:18:24.252154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea33a63-a8b8-4699-8e06-dab6b461bcab None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:18:24.262136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919117a1-ef6a-46eb-853a-f9e19faf8b93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:18:24.262854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919117a1-ef6a-46eb-853a-f9e19faf8b93 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:24.263140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919117a1-ef6a-46eb-853a-f9e19faf8b93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:24.263415 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919117a1-ef6a-46eb-853a-f9e19faf8b93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:24.275326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919117a1-ef6a-46eb-853a-f9e19faf8b93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:18:24.277097 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919117a1-ef6a-46eb-853a-f9e19faf8b93 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:18:24.288917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 682/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:18:25.159512 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadbcf6-bf0b-4598-b0ce-2e3f85552428 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:25.160444 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadbcf6-bf0b-4598-b0ce-2e3f85552428 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:25.160444 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadbcf6-bf0b-4598-b0ce-2e3f85552428 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:25.168994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c560d2-56ea-4641-8c37-be97ee36647a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:25.170399 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c560d2-56ea-4641-8c37-be97ee36647a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:25.170399 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c560d2-56ea-4641-8c37-be97ee36647a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:25.173642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 695/1377] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:18:25 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:25.201427 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b7c560d2-56ea-4641-8c37-be97ee36647a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:25.204644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b7c560d2-56ea-4641-8c37-be97ee36647a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:25.222301 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 683/1378] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:18:25.292167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadbcf6-bf0b-4598-b0ce-2e3f85552428 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:18:25.309046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadbcf6-bf0b-4598-b0ce-2e3f85552428 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:18:25.314707 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36089bb-be38-4d33-80b8-73766db74771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:18:25.315468 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36089bb-be38-4d33-80b8-73766db74771 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:25.315826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36089bb-be38-4d33-80b8-73766db74771 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:25.316262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36089bb-be38-4d33-80b8-73766db74771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:25.327149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36089bb-be38-4d33-80b8-73766db74771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:18:25.329775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36089bb-be38-4d33-80b8-73766db74771 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:18:25.333181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:18:25.342367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 696/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:18:27.470267 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de5edd-0baf-4a2b-ac70-65508691dc29 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:27.471623 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de5edd-0baf-4a2b-ac70-65508691dc29 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:27.472122 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de5edd-0baf-4a2b-ac70-65508691dc29 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:27.473891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 684/1380] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:18:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:27.480557 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dae76-ce75-4a51-a309-815a329c3635 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:27.481150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dae76-ce75-4a51-a309-815a329c3635 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:27.481150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dae76-ce75-4a51-a309-815a329c3635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:27.515699 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4f2dae76-ce75-4a51-a309-815a329c3635 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:27.517262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4f2dae76-ce75-4a51-a309-815a329c3635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:27.531213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 697/1381] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:27.576629 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de5edd-0baf-4a2b-ac70-65508691dc29 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:18:27.591452 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de5edd-0baf-4a2b-ac70-65508691dc29 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:18:27.597289 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e79b65-7504-4b88-87c1-d747918464e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:18:27.597955 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e79b65-7504-4b88-87c1-d747918464e5 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:27.598272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e79b65-7504-4b88-87c1-d747918464e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:27.598568 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e79b65-7504-4b88-87c1-d747918464e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:27.608953 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e79b65-7504-4b88-87c1-d747918464e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:18:27.610625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e79b65-7504-4b88-87c1-d747918464e5 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:18:27.622343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 685/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:18:29.776064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da5d42-ff35-466b-89cc-722da670ad81 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:29.776594 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da5d42-ff35-466b-89cc-722da670ad81 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:29.776594 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da5d42-ff35-466b-89cc-722da670ad81 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:29.778153 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 698/1383] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:29.783887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74327819-9c39-4e55-bbad-d5be1a4196a9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:29.784476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74327819-9c39-4e55-bbad-d5be1a4196a9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:29.784476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74327819-9c39-4e55-bbad-d5be1a4196a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:29.804559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-74327819-9c39-4e55-bbad-d5be1a4196a9 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:29.805944 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-74327819-9c39-4e55-bbad-d5be1a4196a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:29.815154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 686/1384] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:29.863670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da5d42-ff35-466b-89cc-722da670ad81 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:18:29.880691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da5d42-ff35-466b-89cc-722da670ad81 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:18:29.887253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306ea41-755f-43c3-b359-0861152d3be6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:18:29.888226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306ea41-755f-43c3-b359-0861152d3be6 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:29.888484 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306ea41-755f-43c3-b359-0861152d3be6 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:29.889013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306ea41-755f-43c3-b359-0861152d3be6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:29.900997 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306ea41-755f-43c3-b359-0861152d3be6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:18:29.903287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306ea41-755f-43c3-b359-0861152d3be6 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:18:29.915338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 699/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:18:32.131097 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed8fd1-c205-4a2f-8f3b-c09b76970c6e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:32.131097 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed8fd1-c205-4a2f-8f3b-c09b76970c6e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:32.131097 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed8fd1-c205-4a2f-8f3b-c09b76970c6e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:32.131097 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 687/1386] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:32.137887 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc7b9e-8567-4f5d-b237-ef785599d949 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:32.137887 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc7b9e-8567-4f5d-b237-ef785599d949 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:32.138957 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc7b9e-8567-4f5d-b237-ef785599d949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:32.175061 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-11fc7b9e-8567-4f5d-b237-ef785599d949 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:32.177191 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-11fc7b9e-8567-4f5d-b237-ef785599d949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:32.188990 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 700/1387] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:32.244946 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed8fd1-c205-4a2f-8f3b-c09b76970c6e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:18:32.262529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed8fd1-c205-4a2f-8f3b-c09b76970c6e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:18:32.274745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345e34d-fdc4-40f6-939e-d723a18da3b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:18:32.275558 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345e34d-fdc4-40f6-939e-d723a18da3b8 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:32.275846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345e34d-fdc4-40f6-939e-d723a18da3b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:32.276122 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345e34d-fdc4-40f6-939e-d723a18da3b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:32.287402 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345e34d-fdc4-40f6-939e-d723a18da3b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:18:32.289161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345e34d-fdc4-40f6-939e-d723a18da3b8 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:18:32.302136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 688/1388] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:18:34.645286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c106d-c758-44d3-b7f5-e9ff46ebc566 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:34.646273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c106d-c758-44d3-b7f5-e9ff46ebc566 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:34.646273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c106d-c758-44d3-b7f5-e9ff46ebc566 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:34.652589 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 701/1389] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:18:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:34.659653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446548f-c65d-4744-b190-fd59e8669ed4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:34.660792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446548f-c65d-4744-b190-fd59e8669ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:34.660792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446548f-c65d-4744-b190-fd59e8669ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:34.683613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a446548f-c65d-4744-b190-fd59e8669ed4 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:34.684940 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a446548f-c65d-4744-b190-fd59e8669ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:34.693626 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 689/1390] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:34.747871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c106d-c758-44d3-b7f5-e9ff46ebc566 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:18:34.771568 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c106d-c758-44d3-b7f5-e9ff46ebc566 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:18:34.779699 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c113c-2bfc-4994-a81b-dbea1ec8345e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:18:34.780689 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c113c-2bfc-4994-a81b-dbea1ec8345e service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:34.781519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c113c-2bfc-4994-a81b-dbea1ec8345e service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:34.781857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c113c-2bfc-4994-a81b-dbea1ec8345e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:34.799062 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c113c-2bfc-4994-a81b-dbea1ec8345e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:18:34.802234 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c113c-2bfc-4994-a81b-dbea1ec8345e service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:18:34.821769 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 702/1391] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:18:37.088045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab7aba-c7de-4deb-ae58-334998b84c32 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:37.088615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab7aba-c7de-4deb-ae58-334998b84c32 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:37.088615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab7aba-c7de-4deb-ae58-334998b84c32 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:37.090059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 690/1392] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:37.098290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802cefd-ba1b-4c9a-924a-d10d77122f35 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:37.098800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802cefd-ba1b-4c9a-924a-d10d77122f35 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:37.099029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802cefd-ba1b-4c9a-924a-d10d77122f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:37.127230 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a802cefd-ba1b-4c9a-924a-d10d77122f35 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:37.129101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a802cefd-ba1b-4c9a-924a-d10d77122f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:37.141701 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 703/1393] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:37.210110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab7aba-c7de-4deb-ae58-334998b84c32 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:18:37.226064 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab7aba-c7de-4deb-ae58-334998b84c32 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:18:37.231531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4570318-f741-4725-9326-11a963db157c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:18:37.232216 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4570318-f741-4725-9326-11a963db157c service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:37.232573 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4570318-f741-4725-9326-11a963db157c service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:37.232777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4570318-f741-4725-9326-11a963db157c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:37.242569 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4570318-f741-4725-9326-11a963db157c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:18:37.244200 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4570318-f741-4725-9326-11a963db157c service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:18:37.254731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 691/1394] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:18:39.397957 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f8e69-4517-4323-bc4b-5871c801ad36 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:39.398534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f8e69-4517-4323-bc4b-5871c801ad36 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:39.398637 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f8e69-4517-4323-bc4b-5871c801ad36 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:39.400085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 704/1395] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:18:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:39.406178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9191f-a848-414e-abff-ff7bde82c97b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:39.406736 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9191f-a848-414e-abff-ff7bde82c97b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:39.406903 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9191f-a848-414e-abff-ff7bde82c97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:39.413854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=52 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:18:39.427701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-89d9191f-a848-414e-abff-ff7bde82c97b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:39.429361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-89d9191f-a848-414e-abff-ff7bde82c97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:39.437746 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 692/1396] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:39.483850 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f8e69-4517-4323-bc4b-5871c801ad36 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:18:39.499303 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f8e69-4517-4323-bc4b-5871c801ad36 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:18:39.504892 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbf696-b2df-4f1c-a88b-8eaf124ed573 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:18:39.505553 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbf696-b2df-4f1c-a88b-8eaf124ed573 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:39.505839 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbf696-b2df-4f1c-a88b-8eaf124ed573 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:39.506243 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbf696-b2df-4f1c-a88b-8eaf124ed573 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:39.515630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbf696-b2df-4f1c-a88b-8eaf124ed573 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:18:39.517257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbf696-b2df-4f1c-a88b-8eaf124ed573 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:18:39.528254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 705/1397] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:18:40.086370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d2b47-eddc-4915-9136-0d62d2bc1121 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:40.086651 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d2b47-eddc-4915-9136-0d62d2bc1121 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:40.086929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d2b47-eddc-4915-9136-0d62d2bc1121 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:40.088304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 693/1398] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:40.094239 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac4dec-733c-41cd-aa82-4fc8d38fee2f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:40.094684 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac4dec-733c-41cd-aa82-4fc8d38fee2f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:40.094966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac4dec-733c-41cd-aa82-4fc8d38fee2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:40.115875 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0bac4dec-733c-41cd-aa82-4fc8d38fee2f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:40.117215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0bac4dec-733c-41cd-aa82-4fc8d38fee2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:40.129664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 706/1399] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:40.189365 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa6efe-84f9-40de-af6d-c054e494968f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:40.189640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa6efe-84f9-40de-af6d-c054e494968f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:40.190083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa6efe-84f9-40de-af6d-c054e494968f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:40.192080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 694/1400] 10.222.0.33 () {54 vars in 962 bytes} [Mon Jun 27 15:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:40.198249 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f23cb6-be4b-4920-86c1-d732fa873c96 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:40.198673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f23cb6-be4b-4920-86c1-d732fa873c96 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:40.199022 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f23cb6-be4b-4920-86c1-d732fa873c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:40.252929 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-04f23cb6-be4b-4920-86c1-d732fa873c96 None None] MFA Rules not processed for user `f18acfb35dfe41a1aeb50c702bd1942b`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:40.254157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-04f23cb6-be4b-4920-86c1-d732fa873c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:40.318906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 707/1401] 10.222.0.33 () {58 vars in 1059 bytes} [Mon Jun 27 15:18:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:40.326721 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa6efe-84f9-40de-af6d-c054e494968f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:18:40.338277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa6efe-84f9-40de-af6d-c054e494968f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:18:40.342180 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c167a-f2a0-44aa-bb91-33478c113e2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f18acfb35dfe41a1aeb50c702bd1942b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:18:40.343105 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c167a-f2a0-44aa-bb91-33478c113e2a service glance] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:40.343389 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c167a-f2a0-44aa-bb91-33478c113e2a service glance] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:40.343663 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c167a-f2a0-44aa-bb91-33478c113e2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:40.353580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c167a-f2a0-44aa-bb91-33478c113e2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:18:40.355128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c167a-f2a0-44aa-bb91-33478c113e2a service glance] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:18:40.364863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 695/1402] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:18:41.129368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218704-fa60-4a3f-866c-b9e1e011007e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:41.129368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218704-fa60-4a3f-866c-b9e1e011007e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:41.129368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218704-fa60-4a3f-866c-b9e1e011007e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:41.181811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-eb218704-fa60-4a3f-866c-b9e1e011007e None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:41.183089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-eb218704-fa60-4a3f-866c-b9e1e011007e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:41.224732 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:18:41.250873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 708/1403] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 27 15:18:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:41.297321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3012e-b0d6-449c-9742-5bf6a7ee68a9 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:41.297806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3012e-b0d6-449c-9742-5bf6a7ee68a9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:41.297924 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3012e-b0d6-449c-9742-5bf6a7ee68a9 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:41.299299 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 696/1404] 10.222.0.33 () {54 vars in 942 bytes} [Mon Jun 27 15:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:41.306029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6356a-f8dc-495c-905e-c00ab6953f18 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:41.306356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6356a-f8dc-495c-905e-c00ab6953f18 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:41.306640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6356a-f8dc-495c-905e-c00ab6953f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:41.359658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-64c6356a-f8dc-495c-905e-c00ab6953f18 None None] MFA Rules not processed for user `0e419f9caf0a4ccb8108d375f527006e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:41.360892 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-64c6356a-f8dc-495c-905e-c00ab6953f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:41.435525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 709/1405] 10.222.0.33 () {58 vars in 1039 bytes} [Mon Jun 27 15:18:41 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:41.445177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3012e-b0d6-449c-9742-5bf6a7ee68a9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:18:41.459213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3012e-b0d6-449c-9742-5bf6a7ee68a9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:18:41.464338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330cff9-4514-4369-a3e1-696a32bb73bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:18:41.464995 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330cff9-4514-4369-a3e1-696a32bb73bd service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:41.465284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330cff9-4514-4369-a3e1-696a32bb73bd service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:41.465555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330cff9-4514-4369-a3e1-696a32bb73bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:41.474340 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330cff9-4514-4369-a3e1-696a32bb73bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:18:41.475984 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330cff9-4514-4369-a3e1-696a32bb73bd service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:18:41.484563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 697/1406] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:18:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:18:41.648897 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b47e9-7f7c-4675-9f19-5c45a08c257b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:41.649144 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b47e9-7f7c-4675-9f19-5c45a08c257b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:41.649451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b47e9-7f7c-4675-9f19-5c45a08c257b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:41.655232 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 710/1407] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:18:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:18:41.656789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815b8e6-1d59-4568-8936-2d83eeb6397c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:41.657075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815b8e6-1d59-4568-8936-2d83eeb6397c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:41.657356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815b8e6-1d59-4568-8936-2d83eeb6397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:41.682338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0815b8e6-1d59-4568-8936-2d83eeb6397c None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:18:41.683927 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0815b8e6-1d59-4568-8936-2d83eeb6397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:18:41.692488 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 698/1408] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:18:41.739982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b47e9-7f7c-4675-9f19-5c45a08c257b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:18:41.756824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b47e9-7f7c-4675-9f19-5c45a08c257b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:18:41.763159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425aeb8a-dadd-44fb-8d31-628eb3557615 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:18:41.763816 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aeb8a-dadd-44fb-8d31-628eb3557615 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:18:41.764103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aeb8a-dadd-44fb-8d31-628eb3557615 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:18:41.764371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aeb8a-dadd-44fb-8d31-628eb3557615 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:18:41.782017 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425aeb8a-dadd-44fb-8d31-628eb3557615 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:18:41.784005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425aeb8a-dadd-44fb-8d31-628eb3557615 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:18:41.795192 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 711/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:18:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:18:51.676053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=17 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:18:51.789854 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=59 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:19:04.394183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a713-65a6-4690-ad22-6d4ea1350dad None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:04.395130 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a713-65a6-4690-ad22-6d4ea1350dad None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:04.395315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a713-65a6-4690-ad22-6d4ea1350dad None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:04.396837 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 699/1410] 10.222.0.33 () {54 vars in 918 bytes} [Mon Jun 27 15:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:04.402704 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d121a-8557-485e-a55c-70575ecfbaa9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:04.403464 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d121a-8557-485e-a55c-70575ecfbaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:04.403464 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d121a-8557-485e-a55c-70575ecfbaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:04.423358 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-676d121a-8557-485e-a55c-70575ecfbaa9 None None] MFA Rules not processed for user `b471b5b4ede845c7a9dfbf2a90544591`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:04.424572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-676d121a-8557-485e-a55c-70575ecfbaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:04.433397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 712/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Mon Jun 27 15:19:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:04.449928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ee9f8-30e5-4afc-85da-d508269ede52 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:04.450206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ee9f8-30e5-4afc-85da-d508269ede52 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:04.450531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ee9f8-30e5-4afc-85da-d508269ede52 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:04.452075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 700/1412] 10.222.0.33 () {54 vars in 918 bytes} [Mon Jun 27 15:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:04.457485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f1da3-e7af-4431-81d4-330df3c55e08 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:04.457770 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f1da3-e7af-4431-81d4-330df3c55e08 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:04.458049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f1da3-e7af-4431-81d4-330df3c55e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:04.477267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f89f1da3-e7af-4431-81d4-330df3c55e08 None None] MFA Rules not processed for user `37a36c30e9dc472d97d762d236dd865a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:04.478529 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f89f1da3-e7af-4431-81d4-330df3c55e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:04.487932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 713/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Mon Jun 27 15:19:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:07.084020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b912ca-c017-4c45-9901-7362d8e4e2d7 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:07.084628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b912ca-c017-4c45-9901-7362d8e4e2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:07.084628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b912ca-c017-4c45-9901-7362d8e4e2d7 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:07.086445 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 15:19:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:07.092041 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72137c2-46d8-45e3-a1c8-cd9816b6ede9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:07.092501 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72137c2-46d8-45e3-a1c8-cd9816b6ede9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:07.092661 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72137c2-46d8-45e3-a1c8-cd9816b6ede9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:07.112026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b72137c2-46d8-45e3-a1c8-cd9816b6ede9 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:07.113244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b72137c2-46d8-45e3-a1c8-cd9816b6ede9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:07.123317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 15:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:07.167319 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b912ca-c017-4c45-9901-7362d8e4e2d7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:07.184980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b912ca-c017-4c45-9901-7362d8e4e2d7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:07.190516 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b44a9-0164-47a3-89a3-ada5b8bd27ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:07.191173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b44a9-0164-47a3-89a3-ada5b8bd27ed service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:07.191461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b44a9-0164-47a3-89a3-ada5b8bd27ed service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:07.191744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b44a9-0164-47a3-89a3-ada5b8bd27ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:07.200820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b44a9-0164-47a3-89a3-ada5b8bd27ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:07.202456 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b44a9-0164-47a3-89a3-ada5b8bd27ed service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:07.212812 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 702/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:08.145505 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4f747-d3b1-41f3-ba9b-71690e103205 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:08.146171 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4f747-d3b1-41f3-ba9b-71690e103205 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:08.146171 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4f747-d3b1-41f3-ba9b-71690e103205 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:08.147454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 15:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:08.153042 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f7d96-108d-4fdc-8008-20033a2a9bf0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:08.153585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f7d96-108d-4fdc-8008-20033a2a9bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:08.153585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f7d96-108d-4fdc-8008-20033a2a9bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:08.177162 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-756f7d96-108d-4fdc-8008-20033a2a9bf0 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:08.178421 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-756f7d96-108d-4fdc-8008-20033a2a9bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:08.188000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 15:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:08.341637 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4f747-d3b1-41f3-ba9b-71690e103205 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:08.362756 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4f747-d3b1-41f3-ba9b-71690e103205 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:08.368802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20489205-a8d6-4aeb-94ab-a10466a12915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:08.369475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20489205-a8d6-4aeb-94ab-a10466a12915 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:08.369759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20489205-a8d6-4aeb-94ab-a10466a12915 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:08.370039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20489205-a8d6-4aeb-94ab-a10466a12915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:08.379231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20489205-a8d6-4aeb-94ab-a10466a12915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:08.380867 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20489205-a8d6-4aeb-94ab-a10466a12915 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:08.391652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 716/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:19:09.287925 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfef3ae-b066-4c73-8360-9723a534fee7 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:09.288625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfef3ae-b066-4c73-8360-9723a534fee7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:09.289186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfef3ae-b066-4c73-8360-9723a534fee7 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:09.290602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 15:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:09.296545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ade59-e38e-4a1a-8c63-8de7f0b32ae4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:09.297046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ade59-e38e-4a1a-8c63-8de7f0b32ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:09.297158 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ade59-e38e-4a1a-8c63-8de7f0b32ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:09.316571 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c73ade59-e38e-4a1a-8c63-8de7f0b32ae4 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:09.317797 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c73ade59-e38e-4a1a-8c63-8de7f0b32ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:09.326572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 15:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:09.476764 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfef3ae-b066-4c73-8360-9723a534fee7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:09.493121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfef3ae-b066-4c73-8360-9723a534fee7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:09.499089 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea96d2-f0c1-4ecb-8818-63e393de14b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:09.499741 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea96d2-f0c1-4ecb-8818-63e393de14b6 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:09.500022 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea96d2-f0c1-4ecb-8818-63e393de14b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:09.500319 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea96d2-f0c1-4ecb-8818-63e393de14b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:09.509467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea96d2-f0c1-4ecb-8818-63e393de14b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:09.511142 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea96d2-f0c1-4ecb-8818-63e393de14b6 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:09.523449 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 705/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:10.410452 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b6b01-2f05-4518-b272-5557c1ed017b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:10.411375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b6b01-2f05-4518-b272-5557c1ed017b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:10.411375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b6b01-2f05-4518-b272-5557c1ed017b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:10.412561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 15:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:10.419118 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe85caa-4a9a-435a-8bc8-dab15f219a00 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:10.419960 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe85caa-4a9a-435a-8bc8-dab15f219a00 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:10.420170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe85caa-4a9a-435a-8bc8-dab15f219a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:10.440211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3fe85caa-4a9a-435a-8bc8-dab15f219a00 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:10.441449 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3fe85caa-4a9a-435a-8bc8-dab15f219a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:10.450114 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 15:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:19:10.604534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b6b01-2f05-4518-b272-5557c1ed017b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:10.622255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b6b01-2f05-4518-b272-5557c1ed017b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:10.628271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2932808-3bab-49e9-9ca6-ec91dd3efc32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:10.628942 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2932808-3bab-49e9-9ca6-ec91dd3efc32 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:10.629232 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2932808-3bab-49e9-9ca6-ec91dd3efc32 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:10.629515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2932808-3bab-49e9-9ca6-ec91dd3efc32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:10.638927 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2932808-3bab-49e9-9ca6-ec91dd3efc32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:10.640554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2932808-3bab-49e9-9ca6-ec91dd3efc32 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:10.652530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 719/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:11.574002 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e731f09-99f6-4117-a54a-dba939b64238 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:11.574712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e731f09-99f6-4117-a54a-dba939b64238 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:11.574712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e731f09-99f6-4117-a54a-dba939b64238 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:11.576053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 15:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:11.581812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b51083-f243-489a-88ca-d7ba5017705e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:11.582451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b51083-f243-489a-88ca-d7ba5017705e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:11.582451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b51083-f243-489a-88ca-d7ba5017705e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:11.601103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-94b51083-f243-489a-88ca-d7ba5017705e None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:11.602374 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-94b51083-f243-489a-88ca-d7ba5017705e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:11.610968 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 15:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:11.767635 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e731f09-99f6-4117-a54a-dba939b64238 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:11.784764 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e731f09-99f6-4117-a54a-dba939b64238 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:11.791287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9a7f4-e791-4f56-a399-643cfa16c868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:11.791959 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9a7f4-e791-4f56-a399-643cfa16c868 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:11.792246 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9a7f4-e791-4f56-a399-643cfa16c868 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:11.792525 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9a7f4-e791-4f56-a399-643cfa16c868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:11.802399 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9a7f4-e791-4f56-a399-643cfa16c868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:11.804840 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9a7f4-e791-4f56-a399-643cfa16c868 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:11.815213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 708/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:12.633655 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326f7e4-e8b1-418d-9389-8e93b43c2488 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:12.634287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326f7e4-e8b1-418d-9389-8e93b43c2488 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:12.634287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326f7e4-e8b1-418d-9389-8e93b43c2488 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:12.635654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 15:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:12.641532 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b71807-4bae-4dd5-b6d6-9180d76c5ef4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:12.642031 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b71807-4bae-4dd5-b6d6-9180d76c5ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:12.642324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b71807-4bae-4dd5-b6d6-9180d76c5ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:12.661865 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-09b71807-4bae-4dd5-b6d6-9180d76c5ef4 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:12.663123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-09b71807-4bae-4dd5-b6d6-9180d76c5ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:12.672781 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 15:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:12.827845 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326f7e4-e8b1-418d-9389-8e93b43c2488 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:12.845545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326f7e4-e8b1-418d-9389-8e93b43c2488 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:12.852335 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b74be4-42dd-45b6-85f1-14ce94155d1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:12.853007 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b74be4-42dd-45b6-85f1-14ce94155d1e service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:12.853279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b74be4-42dd-45b6-85f1-14ce94155d1e service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:12.853555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b74be4-42dd-45b6-85f1-14ce94155d1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:12.862754 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b74be4-42dd-45b6-85f1-14ce94155d1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:12.864355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b74be4-42dd-45b6-85f1-14ce94155d1e service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:12.875013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 722/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:13.702816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462576a4-0465-438e-acf9-2d92cf20f248 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:13.703383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462576a4-0465-438e-acf9-2d92cf20f248 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:13.703383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462576a4-0465-438e-acf9-2d92cf20f248 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:13.704792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 15:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:13.710752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228c575-5885-4615-8e81-9c67bab5b943 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:13.711538 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228c575-5885-4615-8e81-9c67bab5b943 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:13.711538 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228c575-5885-4615-8e81-9c67bab5b943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:13.731198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d228c575-5885-4615-8e81-9c67bab5b943 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:13.732428 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d228c575-5885-4615-8e81-9c67bab5b943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:13.740743 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 15:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:13.895120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462576a4-0465-438e-acf9-2d92cf20f248 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:13.910608 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462576a4-0465-438e-acf9-2d92cf20f248 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:13.917108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b98258-d951-4e1d-a730-bbcb2f4fdf6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:13.917781 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b98258-d951-4e1d-a730-bbcb2f4fdf6c service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:13.918064 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b98258-d951-4e1d-a730-bbcb2f4fdf6c service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:13.918377 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b98258-d951-4e1d-a730-bbcb2f4fdf6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:13.928130 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b98258-d951-4e1d-a730-bbcb2f4fdf6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:13.930309 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b98258-d951-4e1d-a730-bbcb2f4fdf6c service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:13.940391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 711/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:14.772858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c3ddb-2b4a-45af-b9dd-f79192bc2f20 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:14.773561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c3ddb-2b4a-45af-b9dd-f79192bc2f20 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:14.773561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c3ddb-2b4a-45af-b9dd-f79192bc2f20 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:14.775205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 15:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:14.780728 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47ffb8-7194-41cd-afed-211f332345f6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:14.781290 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47ffb8-7194-41cd-afed-211f332345f6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:14.781290 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47ffb8-7194-41cd-afed-211f332345f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:14.802016 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cd47ffb8-7194-41cd-afed-211f332345f6 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:14.803289 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cd47ffb8-7194-41cd-afed-211f332345f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:14.812919 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 15:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:14.968286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c3ddb-2b4a-45af-b9dd-f79192bc2f20 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:14.985176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c3ddb-2b4a-45af-b9dd-f79192bc2f20 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:14.991861 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454d06c-311b-4ab4-9fa2-444c95025a65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:14.992585 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454d06c-311b-4ab4-9fa2-444c95025a65 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:14.992874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454d06c-311b-4ab4-9fa2-444c95025a65 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:14.993157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454d06c-311b-4ab4-9fa2-444c95025a65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:15.002645 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454d06c-311b-4ab4-9fa2-444c95025a65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:15.004278 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454d06c-311b-4ab4-9fa2-444c95025a65 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:15.015159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 725/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:15.868401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e9ac6-2a60-4215-96ba-7a907b99c50b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:15.869054 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e9ac6-2a60-4215-96ba-7a907b99c50b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:15.869054 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e9ac6-2a60-4215-96ba-7a907b99c50b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:15.870412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 15:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:15.876181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d29f23-6836-4dcb-93b4-e7a2a28d140c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:15.876704 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d29f23-6836-4dcb-93b4-e7a2a28d140c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:15.876704 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d29f23-6836-4dcb-93b4-e7a2a28d140c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:15.895854 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c4d29f23-6836-4dcb-93b4-e7a2a28d140c None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:15.897078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c4d29f23-6836-4dcb-93b4-e7a2a28d140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:15.906506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 15:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:16.058240 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e9ac6-2a60-4215-96ba-7a907b99c50b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:16.075396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e9ac6-2a60-4215-96ba-7a907b99c50b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:16.081697 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14257c2-5611-4815-ac98-ee8ab60159f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:16.082409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14257c2-5611-4815-ac98-ee8ab60159f3 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:16.082699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14257c2-5611-4815-ac98-ee8ab60159f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:16.082966 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14257c2-5611-4815-ac98-ee8ab60159f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:16.092574 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14257c2-5611-4815-ac98-ee8ab60159f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:16.094187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14257c2-5611-4815-ac98-ee8ab60159f3 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:16.104613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 714/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:18.061829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59968c4a-208e-4be5-8bda-adbeacf14438 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:18.062518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59968c4a-208e-4be5-8bda-adbeacf14438 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:18.062518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59968c4a-208e-4be5-8bda-adbeacf14438 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:18.063762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 15:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:18.069792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605012bf-3372-4ef5-88ba-3a68193d4f59 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:18.070502 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605012bf-3372-4ef5-88ba-3a68193d4f59 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:18.070714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605012bf-3372-4ef5-88ba-3a68193d4f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:18.090151 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-605012bf-3372-4ef5-88ba-3a68193d4f59 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:18.091424 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-605012bf-3372-4ef5-88ba-3a68193d4f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:18.100569 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 15:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:18.139971 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59968c4a-208e-4be5-8bda-adbeacf14438 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:18.151694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59968c4a-208e-4be5-8bda-adbeacf14438 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:18.155165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554ec1c-6ca5-4726-8364-7de951aba226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:18.155817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554ec1c-6ca5-4726-8364-7de951aba226 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:18.156097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554ec1c-6ca5-4726-8364-7de951aba226 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:18.156371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554ec1c-6ca5-4726-8364-7de951aba226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:18.166834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554ec1c-6ca5-4726-8364-7de951aba226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:18.168295 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554ec1c-6ca5-4726-8364-7de951aba226 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:18.180353 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 728/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:20.553778 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bcacb-0063-443e-afcf-0ee78acd366a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:20.554758 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bcacb-0063-443e-afcf-0ee78acd366a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:20.554758 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bcacb-0063-443e-afcf-0ee78acd366a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:20.555965 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 15:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:20.562512 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d269b2-ae33-4679-8f24-24488c861f4d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:20.563103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d269b2-ae33-4679-8f24-24488c861f4d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:20.563103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d269b2-ae33-4679-8f24-24488c861f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:20.584377 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-45d269b2-ae33-4679-8f24-24488c861f4d None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:20.585851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-45d269b2-ae33-4679-8f24-24488c861f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:20.594683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 15:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:20.636561 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bcacb-0063-443e-afcf-0ee78acd366a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:20.650457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bcacb-0063-443e-afcf-0ee78acd366a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:20.654939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39662dc3-01fb-43f2-a050-9dc687f85690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:20.655626 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39662dc3-01fb-43f2-a050-9dc687f85690 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:20.655907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39662dc3-01fb-43f2-a050-9dc687f85690 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:20.656183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39662dc3-01fb-43f2-a050-9dc687f85690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:20.668447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39662dc3-01fb-43f2-a050-9dc687f85690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:20.669979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39662dc3-01fb-43f2-a050-9dc687f85690 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:20.682728 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 717/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:23.160447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3bf9e-8336-4006-9c85-4be84a788b7b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:23.161157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3bf9e-8336-4006-9c85-4be84a788b7b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:23.161157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3bf9e-8336-4006-9c85-4be84a788b7b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:23.162403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 15:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:23.169619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519a47a-e7c8-469d-86ac-ace6f0fc3675 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:23.170208 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519a47a-e7c8-469d-86ac-ace6f0fc3675 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:23.170208 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519a47a-e7c8-469d-86ac-ace6f0fc3675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:23.191281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d519a47a-e7c8-469d-86ac-ace6f0fc3675 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:23.192564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d519a47a-e7c8-469d-86ac-ace6f0fc3675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:23.201747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 15:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:23.241426 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3bf9e-8336-4006-9c85-4be84a788b7b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:23.254101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3bf9e-8336-4006-9c85-4be84a788b7b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:23.258510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824f06a-5a9e-4ede-89ad-d80308dd4c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:23.259181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824f06a-5a9e-4ede-89ad-d80308dd4c85 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:23.259462 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824f06a-5a9e-4ede-89ad-d80308dd4c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:23.259736 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824f06a-5a9e-4ede-89ad-d80308dd4c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:23.271259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824f06a-5a9e-4ede-89ad-d80308dd4c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:23.272915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824f06a-5a9e-4ede-89ad-d80308dd4c85 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:23.284029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 731/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:25.530662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10371101-ef31-4e88-a139-5efacc6040a0 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:25.531223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10371101-ef31-4e88-a139-5efacc6040a0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:25.531223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10371101-ef31-4e88-a139-5efacc6040a0 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:25.532657 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 15:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:25.538654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69bbfc-5637-49ac-af01-5947135867e1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:25.539445 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69bbfc-5637-49ac-af01-5947135867e1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:25.539445 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69bbfc-5637-49ac-af01-5947135867e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:25.558205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9d69bbfc-5637-49ac-af01-5947135867e1 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:25.559503 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9d69bbfc-5637-49ac-af01-5947135867e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:25.568179 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 15:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:25.608040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10371101-ef31-4e88-a139-5efacc6040a0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:25.620334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10371101-ef31-4e88-a139-5efacc6040a0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:25.624063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f58780-1c37-4724-bd02-c7af017073cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:25.624865 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58780-1c37-4724-bd02-c7af017073cf service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:25.625176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58780-1c37-4724-bd02-c7af017073cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:25.625436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58780-1c37-4724-bd02-c7af017073cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:25.636113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f58780-1c37-4724-bd02-c7af017073cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:25.637595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f58780-1c37-4724-bd02-c7af017073cf service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:25.648991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 720/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:27.954182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2bead-6dea-4f98-9c4a-cfcc440c29ca None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:27.954822 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2bead-6dea-4f98-9c4a-cfcc440c29ca None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:27.954822 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2bead-6dea-4f98-9c4a-cfcc440c29ca None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:27.956293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 15:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:27.965030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54e496-1852-4477-9457-bd68b2ffea49 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:27.965537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54e496-1852-4477-9457-bd68b2ffea49 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:27.965673 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54e496-1852-4477-9457-bd68b2ffea49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:27.991972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9c54e496-1852-4477-9457-bd68b2ffea49 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:27.993609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9c54e496-1852-4477-9457-bd68b2ffea49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:28.003931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 15:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:19:28.044444 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2bead-6dea-4f98-9c4a-cfcc440c29ca None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:28.058373 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2bead-6dea-4f98-9c4a-cfcc440c29ca None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:28.061967 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa778ebc-2ced-42c2-a015-841c7c6007ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:28.062703 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa778ebc-2ced-42c2-a015-841c7c6007ac service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:28.062993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa778ebc-2ced-42c2-a015-841c7c6007ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:28.063276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa778ebc-2ced-42c2-a015-841c7c6007ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:28.074267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa778ebc-2ced-42c2-a015-841c7c6007ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:28.075784 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa778ebc-2ced-42c2-a015-841c7c6007ac service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:28.086120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 734/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:30.254484 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59fe7f-94ae-4410-8e13-d77f6fd408fa None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:30.255178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59fe7f-94ae-4410-8e13-d77f6fd408fa None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:30.255178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59fe7f-94ae-4410-8e13-d77f6fd408fa None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:30.256553 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 15:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:30.262585 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306489fa-10e4-405a-b4e5-9a9453e923c8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:30.263073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306489fa-10e4-405a-b4e5-9a9453e923c8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:30.263238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306489fa-10e4-405a-b4e5-9a9453e923c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:30.286762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-306489fa-10e4-405a-b4e5-9a9453e923c8 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:30.288227 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-306489fa-10e4-405a-b4e5-9a9453e923c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:30.299155 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 15:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:30.344722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59fe7f-94ae-4410-8e13-d77f6fd408fa None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:30.357290 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59fe7f-94ae-4410-8e13-d77f6fd408fa None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:30.361565 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e5ef1-8328-4436-9421-38aa931132f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:30.362264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e5ef1-8328-4436-9421-38aa931132f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:30.362571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e5ef1-8328-4436-9421-38aa931132f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:30.362851 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e5ef1-8328-4436-9421-38aa931132f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:30.373576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e5ef1-8328-4436-9421-38aa931132f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:30.375219 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e5ef1-8328-4436-9421-38aa931132f3 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:30.387316 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 723/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:32.648777 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899adef-ffb8-4e93-9bf1-e61295b99ab9 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:32.649537 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899adef-ffb8-4e93-9bf1-e61295b99ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:32.649679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899adef-ffb8-4e93-9bf1-e61295b99ab9 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:32.651408 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 15:19:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:32.658425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7ee4c-28e4-47bf-84a2-f49d149a9feb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:32.659106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7ee4c-28e4-47bf-84a2-f49d149a9feb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:32.659268 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7ee4c-28e4-47bf-84a2-f49d149a9feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:32.671257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=70 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:19:32.686030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d2d7ee4c-28e4-47bf-84a2-f49d149a9feb None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:32.687337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d2d7ee4c-28e4-47bf-84a2-f49d149a9feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:32.697481 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 15:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:32.736492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899adef-ffb8-4e93-9bf1-e61295b99ab9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:32.742991 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=73 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:19:32.749829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899adef-ffb8-4e93-9bf1-e61295b99ab9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:32.753694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbb81b-5a9f-4bf7-8297-94779d370686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:32.754404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbb81b-5a9f-4bf7-8297-94779d370686 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:32.754695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbb81b-5a9f-4bf7-8297-94779d370686 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:32.754975 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbb81b-5a9f-4bf7-8297-94779d370686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:32.765395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbb81b-5a9f-4bf7-8297-94779d370686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:32.766939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbb81b-5a9f-4bf7-8297-94779d370686 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:32.777495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 737/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:34.946335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fa608-eaa7-49d7-9a7f-ebd5adfce4da None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:34.946950 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fa608-eaa7-49d7-9a7f-ebd5adfce4da None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:34.946950 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fa608-eaa7-49d7-9a7f-ebd5adfce4da None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:34.948293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 15:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:34.955467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943a282-2443-4c4f-9f59-a3eb2896175d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:34.956018 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943a282-2443-4c4f-9f59-a3eb2896175d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:34.956018 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943a282-2443-4c4f-9f59-a3eb2896175d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:34.976138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d943a282-2443-4c4f-9f59-a3eb2896175d None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:34.977592 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d943a282-2443-4c4f-9f59-a3eb2896175d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:34.985829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 15:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:35.030932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fa608-eaa7-49d7-9a7f-ebd5adfce4da None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:35.051375 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fa608-eaa7-49d7-9a7f-ebd5adfce4da None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:35.055308 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b079c9-4fd5-4902-b384-15a675c49ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:35.055976 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b079c9-4fd5-4902-b384-15a675c49ddd service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:35.056259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b079c9-4fd5-4902-b384-15a675c49ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:35.056537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b079c9-4fd5-4902-b384-15a675c49ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:35.066936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b079c9-4fd5-4902-b384-15a675c49ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:35.068395 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b079c9-4fd5-4902-b384-15a675c49ddd service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:35.080869 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 726/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:37.234482 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103c691-7955-40c7-8de6-a1419e851baa None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:37.235129 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103c691-7955-40c7-8de6-a1419e851baa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:37.235129 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103c691-7955-40c7-8de6-a1419e851baa None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:37.236405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 15:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:37.242091 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898ad8-bc30-49f5-892f-f00faadb8fd0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:37.242695 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898ad8-bc30-49f5-892f-f00faadb8fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:37.242695 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898ad8-bc30-49f5-892f-f00faadb8fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:37.261598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a8898ad8-bc30-49f5-892f-f00faadb8fd0 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:37.262847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a8898ad8-bc30-49f5-892f-f00faadb8fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:37.270923 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 15:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:37.309893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103c691-7955-40c7-8de6-a1419e851baa None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:37.326880 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103c691-7955-40c7-8de6-a1419e851baa None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:37.331060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a468fc-0db3-49d2-8e28-099f489137c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:37.331739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a468fc-0db3-49d2-8e28-099f489137c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:37.332024 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a468fc-0db3-49d2-8e28-099f489137c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:37.332299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a468fc-0db3-49d2-8e28-099f489137c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:37.343429 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a468fc-0db3-49d2-8e28-099f489137c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:37.344891 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a468fc-0db3-49d2-8e28-099f489137c2 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:37.356641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 740/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:19:39.440229 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae55cf-1eaf-4814-a7b2-8317232b0b90 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:39.440791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae55cf-1eaf-4814-a7b2-8317232b0b90 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:39.441208 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae55cf-1eaf-4814-a7b2-8317232b0b90 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:39.443100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 15:19:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:39.449479 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14f682-00b8-41a7-bf41-9afa962cfd2c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:39.450138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14f682-00b8-41a7-bf41-9afa962cfd2c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:39.450138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14f682-00b8-41a7-bf41-9afa962cfd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:39.469448 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0d14f682-00b8-41a7-bf41-9afa962cfd2c None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:39.470701 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0d14f682-00b8-41a7-bf41-9afa962cfd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:39.478615 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 15:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:39.517213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae55cf-1eaf-4814-a7b2-8317232b0b90 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:39.532018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae55cf-1eaf-4814-a7b2-8317232b0b90 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:39.535755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa13eb-f679-44b4-8326-37310325a0b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:39.536410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa13eb-f679-44b4-8326-37310325a0b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:39.536688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa13eb-f679-44b4-8326-37310325a0b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:39.536961 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa13eb-f679-44b4-8326-37310325a0b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:39.548042 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa13eb-f679-44b4-8326-37310325a0b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:39.549539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa13eb-f679-44b4-8326-37310325a0b5 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:39.561552 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 729/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:19:49.464307 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=17 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:19:49.555332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=17 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:19:59.689901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3bbee-d503-4adb-955f-4b321661065e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:59.690544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3bbee-d503-4adb-955f-4b321661065e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:59.690544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3bbee-d503-4adb-955f-4b321661065e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:59.691871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 742/1471] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:59.697948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9e608-9320-4474-a18f-bbec06c7fe90 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:59.698502 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9e608-9320-4474-a18f-bbec06c7fe90 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:59.698502 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9e608-9320-4474-a18f-bbec06c7fe90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:59.717403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9fa9e608-9320-4474-a18f-bbec06c7fe90 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:59.718646 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9fa9e608-9320-4474-a18f-bbec06c7fe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:59.727833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 730/1472] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:59.775849 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00408e58-596f-44de-8b99-c2675647adbc None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:59.776140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00408e58-596f-44de-8b99-c2675647adbc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:59.776422 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00408e58-596f-44de-8b99-c2675647adbc None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:59.777789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 743/1473] 10.222.0.33 () {54 vars in 962 bytes} [Mon Jun 27 15:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:19:59.783110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b5986-ad7b-4e87-9cb4-69b77928c215 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:59.783415 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b5986-ad7b-4e87-9cb4-69b77928c215 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:59.783696 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b5986-ad7b-4e87-9cb4-69b77928c215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:59.803515 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-382b5986-ad7b-4e87-9cb4-69b77928c215 None None] MFA Rules not processed for user `f18acfb35dfe41a1aeb50c702bd1942b`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:19:59.804757 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-382b5986-ad7b-4e87-9cb4-69b77928c215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:19:59.812244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 731/1474] 10.222.0.33 () {58 vars in 1059 bytes} [Mon Jun 27 15:19:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:19:59.819949 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00408e58-596f-44de-8b99-c2675647adbc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:19:59.831715 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00408e58-596f-44de-8b99-c2675647adbc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:19:59.835498 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a1d6d-73bf-482e-a8ac-103209cdc3bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f18acfb35dfe41a1aeb50c702bd1942b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:19:59.836151 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a1d6d-73bf-482e-a8ac-103209cdc3bc service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:19:59.836436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a1d6d-73bf-482e-a8ac-103209cdc3bc service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:19:59.836712 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a1d6d-73bf-482e-a8ac-103209cdc3bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:19:59.846586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a1d6d-73bf-482e-a8ac-103209cdc3bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:19:59.848031 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a1d6d-73bf-482e-a8ac-103209cdc3bc service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:19:59.858241 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 744/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:19:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:20:02.015373 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d6ab0-5980-4728-9a1f-0774db7b2b56 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:02.015968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d6ab0-5980-4728-9a1f-0774db7b2b56 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:02.015968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d6ab0-5980-4728-9a1f-0774db7b2b56 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:02.017331 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 732/1476] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:20:02.022969 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2196-1304-43bc-8fd1-c0ef000c5251 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:02.023421 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2196-1304-43bc-8fd1-c0ef000c5251 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:02.023533 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2196-1304-43bc-8fd1-c0ef000c5251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:02.042959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7f6d2196-1304-43bc-8fd1-c0ef000c5251 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:20:02.044197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7f6d2196-1304-43bc-8fd1-c0ef000c5251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:20:02.052964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 745/1477] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:20:02.077241 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d6ab0-5980-4728-9a1f-0774db7b2b56 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:20:02.091788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d6ab0-5980-4728-9a1f-0774db7b2b56 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:20:02.096993 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69726fe-5ed7-4a76-9099-60b631ca593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:20:02.097656 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69726fe-5ed7-4a76-9099-60b631ca593e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:02.097953 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69726fe-5ed7-4a76-9099-60b631ca593e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:02.098253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69726fe-5ed7-4a76-9099-60b631ca593e admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:02.099002 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69726fe-5ed7-4a76-9099-60b631ca593e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:20:02.100833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: WARNING py.warnings [None req-b69726fe-5ed7-4a76-9099-60b631ca593e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:20:02.100833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: warnings.warn(msg) Jun 27 15:20:02.100833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: Jun 27 15:20:02.102086 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69726fe-5ed7-4a76-9099-60b631ca593e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:20:02.122324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 733/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 27 15:20:02 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:20:04.204495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e24bc-ec34-463a-9346-f0b006e52de4 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:04.205347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e24bc-ec34-463a-9346-f0b006e52de4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:04.205347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e24bc-ec34-463a-9346-f0b006e52de4 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:04.206676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 746/1479] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:20:04.214353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd75894-37e2-4f44-84e7-77cad473c798 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:04.214887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd75894-37e2-4f44-84e7-77cad473c798 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:04.214989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd75894-37e2-4f44-84e7-77cad473c798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:04.234549 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-abd75894-37e2-4f44-84e7-77cad473c798 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:20:04.235773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-abd75894-37e2-4f44-84e7-77cad473c798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:20:04.244758 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 734/1480] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:20:04.288653 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e24bc-ec34-463a-9346-f0b006e52de4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:20:04.305278 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e24bc-ec34-463a-9346-f0b006e52de4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:20:04.311611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35eb631-325a-43be-a50d-9650fdd9220f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:20:04.312267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eb631-325a-43be-a50d-9650fdd9220f service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:04.312552 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eb631-325a-43be-a50d-9650fdd9220f service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:04.312826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eb631-325a-43be-a50d-9650fdd9220f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:04.322398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35eb631-325a-43be-a50d-9650fdd9220f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:20:04.324007 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35eb631-325a-43be-a50d-9650fdd9220f service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:20:04.337183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 747/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:20:06.574947 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800ee0d-d6ec-45d8-a364-0c7d4789e4cd None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:06.575534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800ee0d-d6ec-45d8-a364-0c7d4789e4cd None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:06.575534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800ee0d-d6ec-45d8-a364-0c7d4789e4cd None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:06.576888 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 735/1482] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:20:06.582310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca81cef-352a-4b7e-9ad2-0c204172e651 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:06.582765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca81cef-352a-4b7e-9ad2-0c204172e651 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:06.582871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca81cef-352a-4b7e-9ad2-0c204172e651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:06.601918 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1ca81cef-352a-4b7e-9ad2-0c204172e651 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:20:06.603356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1ca81cef-352a-4b7e-9ad2-0c204172e651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:20:06.612870 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 748/1483] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:20:06.650563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800ee0d-d6ec-45d8-a364-0c7d4789e4cd None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:20:06.663081 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800ee0d-d6ec-45d8-a364-0c7d4789e4cd None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:20:06.666800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9aa9b-845a-4370-a2af-b8ac01c11dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:20:06.667447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9aa9b-845a-4370-a2af-b8ac01c11dad service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:06.667724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9aa9b-845a-4370-a2af-b8ac01c11dad service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:06.668001 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9aa9b-845a-4370-a2af-b8ac01c11dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:06.678366 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9aa9b-845a-4370-a2af-b8ac01c11dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:20:06.679824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9aa9b-845a-4370-a2af-b8ac01c11dad service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:20:06.690111 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 736/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:20:08.831809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22924dc1-4e8c-492f-aeaa-0dc46a42bb7b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:08.832417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22924dc1-4e8c-492f-aeaa-0dc46a42bb7b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:08.832417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22924dc1-4e8c-492f-aeaa-0dc46a42bb7b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:08.833729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 749/1485] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:20:08.839874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b15d53-f68a-49dd-b183-980f011ec783 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:08.840405 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b15d53-f68a-49dd-b183-980f011ec783 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:08.840405 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b15d53-f68a-49dd-b183-980f011ec783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:08.860520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e8b15d53-f68a-49dd-b183-980f011ec783 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:20:08.861753 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e8b15d53-f68a-49dd-b183-980f011ec783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:20:08.870407 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 737/1486] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:20:08.909609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22924dc1-4e8c-492f-aeaa-0dc46a42bb7b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:20:08.922244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22924dc1-4e8c-492f-aeaa-0dc46a42bb7b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:20:08.926931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e563022-cd50-4887-b0d0-b1c8f53ac55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:20:08.927589 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e563022-cd50-4887-b0d0-b1c8f53ac55c service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:08.927874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e563022-cd50-4887-b0d0-b1c8f53ac55c service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:08.928140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e563022-cd50-4887-b0d0-b1c8f53ac55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:08.938547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e563022-cd50-4887-b0d0-b1c8f53ac55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:20:08.940003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e563022-cd50-4887-b0d0-b1c8f53ac55c service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:20:08.950572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 750/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:20:11.210194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c81d3c-643e-4627-a33d-75719e58f2b7 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:11.210846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c81d3c-643e-4627-a33d-75719e58f2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:11.210846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c81d3c-643e-4627-a33d-75719e58f2b7 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:11.212314 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 738/1488] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:20:11.217819 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a47208-8132-4427-99e3-8630007f8370 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:11.218334 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a47208-8132-4427-99e3-8630007f8370 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:11.218431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a47208-8132-4427-99e3-8630007f8370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:11.237465 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-73a47208-8132-4427-99e3-8630007f8370 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:20:11.238696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-73a47208-8132-4427-99e3-8630007f8370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:20:11.247383 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 751/1489] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:20:11.288925 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c81d3c-643e-4627-a33d-75719e58f2b7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:20:11.301425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c81d3c-643e-4627-a33d-75719e58f2b7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:20:11.305285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19c09f-563b-41ec-b243-959007303191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:20:11.306398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19c09f-563b-41ec-b243-959007303191 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:11.306682 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19c09f-563b-41ec-b243-959007303191 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:11.306958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19c09f-563b-41ec-b243-959007303191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:11.316089 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19c09f-563b-41ec-b243-959007303191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:20:11.317514 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19c09f-563b-41ec-b243-959007303191 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:20:11.327896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 739/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:20:13.581501 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4375b3-b399-476c-a3d7-5c8d27879be8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:13.582109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4375b3-b399-476c-a3d7-5c8d27879be8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:13.582109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4375b3-b399-476c-a3d7-5c8d27879be8 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:13.583484 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 752/1491] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 27 15:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:20:13.588910 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bbcbc-4b79-4afc-9537-d99864dbfca1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:13.589369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bbcbc-4b79-4afc-9537-d99864dbfca1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:13.589488 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bbcbc-4b79-4afc-9537-d99864dbfca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:13.607786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8f3bbcbc-4b79-4afc-9537-d99864dbfca1 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:20:13.608995 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8f3bbcbc-4b79-4afc-9537-d99864dbfca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:20:13.617343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 740/1492] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 27 15:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:20:13.656570 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4375b3-b399-476c-a3d7-5c8d27879be8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:20:13.668599 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4375b3-b399-476c-a3d7-5c8d27879be8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:20:13.672219 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ff91d-3606-458e-a1b4-44af97489091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:20:13.673226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ff91d-3606-458e-a1b4-44af97489091 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:13.673506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ff91d-3606-458e-a1b4-44af97489091 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:13.673785 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ff91d-3606-458e-a1b4-44af97489091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:13.683231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ff91d-3606-458e-a1b4-44af97489091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:20:13.684970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ff91d-3606-458e-a1b4-44af97489091 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:20:13.694713 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 753/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:20:23.602881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=33 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:20:23.690352 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=33 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:21:56.469536 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6426eb-70cf-4ba4-abb0-b8b3030d1338 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:56.470410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6426eb-70cf-4ba4-abb0-b8b3030d1338 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:56.470410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6426eb-70cf-4ba4-abb0-b8b3030d1338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:56.489716 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8f6426eb-70cf-4ba4-abb0-b8b3030d1338 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:21:56.490960 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8f6426eb-70cf-4ba4-abb0-b8b3030d1338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:21:56.499907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 741/1494] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:21:56.508015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f6e72-53d3-4a91-bdce-bebfbbf87969 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:56.508589 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f6e72-53d3-4a91-bdce-bebfbbf87969 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:56.508589 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f6e72-53d3-4a91-bdce-bebfbbf87969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:56.529237 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f35f6e72-53d3-4a91-bdce-bebfbbf87969 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:21:56.530523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f35f6e72-53d3-4a91-bdce-bebfbbf87969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:21:56.540580 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 754/1495] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:21:56.547411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6426eb-70cf-4ba4-abb0-b8b3030d1338 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:21:56.558739 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6426eb-70cf-4ba4-abb0-b8b3030d1338 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:21:56.563795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9484c8-19b8-4b6d-91a1-9d2708e27265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:21:56.564475 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9484c8-19b8-4b6d-91a1-9d2708e27265 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:56.564786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9484c8-19b8-4b6d-91a1-9d2708e27265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:56.565060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9484c8-19b8-4b6d-91a1-9d2708e27265 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:56.565789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9484c8-19b8-4b6d-91a1-9d2708e27265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:21:56.566098 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9484c8-19b8-4b6d-91a1-9d2708e27265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:21:56.567168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: WARNING py.warnings [None req-8f9484c8-19b8-4b6d-91a1-9d2708e27265 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:21:56.567168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: warnings.warn(msg) Jun 27 15:21:56.567168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: Jun 27 15:21:56.568055 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9484c8-19b8-4b6d-91a1-9d2708e27265 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:21:56.580263 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 742/1496] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:21:56.588992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f6e72-53d3-4a91-bdce-bebfbbf87969 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:21:56.598551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f6e72-53d3-4a91-bdce-bebfbbf87969 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:21:56.603672 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72cee1-290e-4a3a-83d6-4e17a4a47652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:21:56.604343 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72cee1-290e-4a3a-83d6-4e17a4a47652 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:56.604714 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72cee1-290e-4a3a-83d6-4e17a4a47652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:56.604999 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72cee1-290e-4a3a-83d6-4e17a4a47652 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:56.605733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72cee1-290e-4a3a-83d6-4e17a4a47652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:21:56.607573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: WARNING py.warnings [None req-9c72cee1-290e-4a3a-83d6-4e17a4a47652 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:21:56.607573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: warnings.warn(msg) Jun 27 15:21:56.607573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: Jun 27 15:21:56.608789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72cee1-290e-4a3a-83d6-4e17a4a47652 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:21:56.646871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 755/1497] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:21:56 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:21:56.651493 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9484c8-19b8-4b6d-91a1-9d2708e27265 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:21:56.661985 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9484c8-19b8-4b6d-91a1-9d2708e27265 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:21:56.721093 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3d35a-528c-4eb8-929a-93a6f9340364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:21:56.722100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3d35a-528c-4eb8-929a-93a6f9340364 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:56.722436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3d35a-528c-4eb8-929a-93a6f9340364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:56.722716 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3d35a-528c-4eb8-929a-93a6f9340364 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:56.723412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3d35a-528c-4eb8-929a-93a6f9340364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:21:56.724429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: WARNING py.warnings [None req-23e3d35a-528c-4eb8-929a-93a6f9340364 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:21:56.724429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: warnings.warn(msg) Jun 27 15:21:56.724429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: Jun 27 15:21:56.725649 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3d35a-528c-4eb8-929a-93a6f9340364 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:21:56.748267 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 743/1498] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:21:56 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:21:56.752560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72cee1-290e-4a3a-83d6-4e17a4a47652 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:21:56.763988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72cee1-290e-4a3a-83d6-4e17a4a47652 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:21:56.769273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cf769-7fde-434c-97e1-b1b378d56629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:21:56.770335 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cf769-7fde-434c-97e1-b1b378d56629 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:56.770649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cf769-7fde-434c-97e1-b1b378d56629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:56.770928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cf769-7fde-434c-97e1-b1b378d56629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:56.771676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cf769-7fde-434c-97e1-b1b378d56629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:21:56.772797 dv-cinder-847798-1-smb devstack@keystone.service[80192]: WARNING py.warnings [None req-0d8cf769-7fde-434c-97e1-b1b378d56629 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:21:56.772797 dv-cinder-847798-1-smb devstack@keystone.service[80192]: warnings.warn(msg) Jun 27 15:21:56.772797 dv-cinder-847798-1-smb devstack@keystone.service[80192]: Jun 27 15:21:56.773701 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cf769-7fde-434c-97e1-b1b378d56629 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:21:56.788252 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 756/1499] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:21:56.794182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3d35a-528c-4eb8-929a-93a6f9340364 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:21:56.805031 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3d35a-528c-4eb8-929a-93a6f9340364 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:21:56.811155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b747f6-f776-4eca-aa1e-e448a19e0fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:21:56.811832 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b747f6-f776-4eca-aa1e-e448a19e0fef admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:56.812139 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b747f6-f776-4eca-aa1e-e448a19e0fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:56.812406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b747f6-f776-4eca-aa1e-e448a19e0fef admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:56.813139 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b747f6-f776-4eca-aa1e-e448a19e0fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:21:56.814149 dv-cinder-847798-1-smb devstack@keystone.service[80193]: WARNING py.warnings [None req-d8b747f6-f776-4eca-aa1e-e448a19e0fef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:21:56.814149 dv-cinder-847798-1-smb devstack@keystone.service[80193]: warnings.warn(msg) Jun 27 15:21:56.814149 dv-cinder-847798-1-smb devstack@keystone.service[80193]: Jun 27 15:21:56.815074 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b747f6-f776-4eca-aa1e-e448a19e0fef admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:21:56.830249 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 744/1500] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:21:56.835050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cf769-7fde-434c-97e1-b1b378d56629 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:21:56.845999 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cf769-7fde-434c-97e1-b1b378d56629 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:21:56.852109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1249c-bfa8-4f5b-b952-0cc50d7db5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:21:56.853042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1249c-bfa8-4f5b-b952-0cc50d7db5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:56.853325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1249c-bfa8-4f5b-b952-0cc50d7db5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:56.853603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1249c-bfa8-4f5b-b952-0cc50d7db5a2 admin admin] PATH_INFO: `/v3/projects/a2b8f50b50e04cef8ee196f3d60b1718/users/9098cf0df19d4cb59a5d311c7bad9b4c/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:56.872074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1249c-bfa8-4f5b-b952-0cc50d7db5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b8f50b50e04cef8ee196f3d60b1718, user_id=9098cf0df19d4cb59a5d311c7bad9b4c, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:21:56.873141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: WARNING py.warnings [None req-acc1249c-bfa8-4f5b-b952-0cc50d7db5a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:21:56.873141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: warnings.warn(msg) Jun 27 15:21:56.873141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: Jun 27 15:21:56.875137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1249c-bfa8-4f5b-b952-0cc50d7db5a2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:21:56.892077 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 757/1501] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:21:56 2022] PUT /identity/v3/projects/a2b8f50b50e04cef8ee196f3d60b1718/users/9098cf0df19d4cb59a5d311c7bad9b4c/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:21:56.904750 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349188b-ff2b-4f87-9bb9-0061725bcac9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:56.905068 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349188b-ff2b-4f87-9bb9-0061725bcac9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:56.905430 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349188b-ff2b-4f87-9bb9-0061725bcac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:56.936178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6349188b-ff2b-4f87-9bb9-0061725bcac9 None None] MFA Rules not processed for user `9098cf0df19d4cb59a5d311c7bad9b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:21:56.937437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6349188b-ff2b-4f87-9bb9-0061725bcac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:21:57.006243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 745/1502] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:21:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:21:57.022289 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551d2f8-47d9-4203-9a08-0776834864bd None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:57.022770 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551d2f8-47d9-4203-9a08-0776834864bd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:57.022964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551d2f8-47d9-4203-9a08-0776834864bd None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:57.024317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 758/1503] 10.222.0.33 () {54 vars in 963 bytes} [Mon Jun 27 15:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:21:57.029542 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe457f1-134c-41f3-b150-3ec122fb8c0c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:57.029837 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe457f1-134c-41f3-b150-3ec122fb8c0c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:57.030123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe457f1-134c-41f3-b150-3ec122fb8c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:57.053259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-dfe457f1-134c-41f3-b150-3ec122fb8c0c None None] MFA Rules not processed for user `0dccf96088954218a4fb8d7b466f970f`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:21:57.054537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dfe457f1-134c-41f3-b150-3ec122fb8c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:21:57.102041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:21:57.118604 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 746/1504] 10.222.0.33 () {58 vars in 1060 bytes} [Mon Jun 27 15:21:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:21:57.127519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551d2f8-47d9-4203-9a08-0776834864bd None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:21:57.140064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551d2f8-47d9-4203-9a08-0776834864bd None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:21:57.144432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d1daf-bc35-4b9d-9628-e0b2cfc18480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:21:57.145106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d1daf-bc35-4b9d-9628-e0b2cfc18480 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:57.145393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d1daf-bc35-4b9d-9628-e0b2cfc18480 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:57.145697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d1daf-bc35-4b9d-9628-e0b2cfc18480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:57.156294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d1daf-bc35-4b9d-9628-e0b2cfc18480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:21:57.157995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d1daf-bc35-4b9d-9628-e0b2cfc18480 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:21:57.168589 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 759/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:21:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:21:57.216253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76a8f0-b5e1-4bf8-980b-9046c718e191 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:57.216553 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76a8f0-b5e1-4bf8-980b-9046c718e191 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:57.217135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76a8f0-b5e1-4bf8-980b-9046c718e191 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:57.218525 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 747/1506] 10.222.0.33 () {52 vars in 829 bytes} [Mon Jun 27 15:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:21:57.222563 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d1daf-bc35-4b9d-9628-e0b2cfc18480 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:21:57.288215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d1daf-bc35-4b9d-9628-e0b2cfc18480 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:21:57.293723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3687961-2b1c-4997-a4f2-15cb4d9e8a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:21:57.294645 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3687961-2b1c-4997-a4f2-15cb4d9e8a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:57.294913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3687961-2b1c-4997-a4f2-15cb4d9e8a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:57.295198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3687961-2b1c-4997-a4f2-15cb4d9e8a27 admin admin] PATH_INFO: `/v3/users/9098cf0df19d4cb59a5d311c7bad9b4c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:57.296449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3687961-2b1c-4997-a4f2-15cb4d9e8a27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9098cf0df19d4cb59a5d311c7bad9b4c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:21:57.297483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: WARNING py.warnings [None req-e3687961-2b1c-4997-a4f2-15cb4d9e8a27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:21:57.297483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: warnings.warn(msg) Jun 27 15:21:57.297483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: Jun 27 15:21:57.299088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3687961-2b1c-4997-a4f2-15cb4d9e8a27 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:21:57.371218 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e3687961-2b1c-4997-a4f2-15cb4d9e8a27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9098cf0df19d4cb59a5d311c7bad9b4c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:21:57.384831 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e3687961-2b1c-4997-a4f2-15cb4d9e8a27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9098cf0df19d4cb59a5d311c7bad9b4c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:21:57.386092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e3687961-2b1c-4997-a4f2-15cb4d9e8a27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9098cf0df19d4cb59a5d311c7bad9b4c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:21:57.386905 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e3687961-2b1c-4997-a4f2-15cb4d9e8a27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9098cf0df19d4cb59a5d311c7bad9b4c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:21:57.409672 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e3687961-2b1c-4997-a4f2-15cb4d9e8a27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9098cf0df19d4cb59a5d311c7bad9b4c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:21:57.413823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:21:57.428376 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 760/1507] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:21:57 2022] DELETE /identity/v3/users/9098cf0df19d4cb59a5d311c7bad9b4c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:21:57.433261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d77ec2-aab1-4b68-b6f3-4ea0653d740f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:57.433614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d77ec2-aab1-4b68-b6f3-4ea0653d740f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:57.433990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d77ec2-aab1-4b68-b6f3-4ea0653d740f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:57.452234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c1d77ec2-aab1-4b68-b6f3-4ea0653d740f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:21:57.453439 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c1d77ec2-aab1-4b68-b6f3-4ea0653d740f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:21:57.534410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 748/1508] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:21:57.545081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3687961-2b1c-4997-a4f2-15cb4d9e8a27 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:21:57.546646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e3687961-2b1c-4997-a4f2-15cb4d9e8a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:21:57.609371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3687961-2b1c-4997-a4f2-15cb4d9e8a27 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:21:57.613532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbde213-d575-4ecb-be48-2599dde27c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:21:57.614176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbde213-d575-4ecb-be48-2599dde27c3d service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:57.614499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbde213-d575-4ecb-be48-2599dde27c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:57.614779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbde213-d575-4ecb-be48-2599dde27c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:57.626112 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbde213-d575-4ecb-be48-2599dde27c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:21:57.627680 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbde213-d575-4ecb-be48-2599dde27c3d service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:21:57.638404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 761/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:21:57.996973 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d77ec2-aab1-4b68-b6f3-4ea0653d740f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:21:57.998493 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c1d77ec2-aab1-4b68-b6f3-4ea0653d740f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:21:58.011753 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d77ec2-aab1-4b68-b6f3-4ea0653d740f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:21:58.016997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52b515-34bb-4697-936b-36a7ff505949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:21:58.017892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52b515-34bb-4697-936b-36a7ff505949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:21:58.018171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52b515-34bb-4697-936b-36a7ff505949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:21:58.018477 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52b515-34bb-4697-936b-36a7ff505949 admin admin] PATH_INFO: `/v3/projects/a2b8f50b50e04cef8ee196f3d60b1718` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:21:58.019762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52b515-34bb-4697-936b-36a7ff505949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b8f50b50e04cef8ee196f3d60b1718)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:21:58.020819 dv-cinder-847798-1-smb devstack@keystone.service[80193]: WARNING py.warnings [None req-cf52b515-34bb-4697-936b-36a7ff505949 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:21:58.020819 dv-cinder-847798-1-smb devstack@keystone.service[80193]: warnings.warn(msg) Jun 27 15:21:58.020819 dv-cinder-847798-1-smb devstack@keystone.service[80193]: Jun 27 15:21:58.022034 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52b515-34bb-4697-936b-36a7ff505949 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:21:58.086538 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cf52b515-34bb-4697-936b-36a7ff505949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b8f50b50e04cef8ee196f3d60b1718', 'request_id': 'req-cf52b515-34bb-4697-936b-36a7ff505949'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:21:58.098135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cf52b515-34bb-4697-936b-36a7ff505949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b8f50b50e04cef8ee196f3d60b1718', 'request_id': 'req-cf52b515-34bb-4697-936b-36a7ff505949'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:21:58.104700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cf52b515-34bb-4697-936b-36a7ff505949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b8f50b50e04cef8ee196f3d60b1718', 'request_id': 'req-cf52b515-34bb-4697-936b-36a7ff505949'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:21:58.127023 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cf52b515-34bb-4697-936b-36a7ff505949 admin admin] The token cache is being invalidate because project a2b8f50b50e04cef8ee196f3d60b1718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:21:58.127271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cf52b515-34bb-4697-936b-36a7ff505949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:21:58.128035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cf52b515-34bb-4697-936b-36a7ff505949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:21:58.129844 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 749/1510] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:21:57 2022] DELETE /identity/v3/projects/a2b8f50b50e04cef8ee196f3d60b1718 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:22:07.633195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:22:08.123102 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:23:45.588507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea8565-914a-4a8a-b6be-e3c633a3f16d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:45.589133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea8565-914a-4a8a-b6be-e3c633a3f16d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:45.589133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea8565-914a-4a8a-b6be-e3c633a3f16d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:45.590496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 15:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:23:45.596655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9fe7f-c53f-4e93-9422-5eccd003d492 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:45.597120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9fe7f-c53f-4e93-9422-5eccd003d492 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:45.597225 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9fe7f-c53f-4e93-9422-5eccd003d492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:45.622111 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-10e9fe7f-c53f-4e93-9422-5eccd003d492 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:23:45.623374 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-10e9fe7f-c53f-4e93-9422-5eccd003d492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:23:45.686485 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 15:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:23:45.850202 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea8565-914a-4a8a-b6be-e3c633a3f16d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:23:45.853084 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-92ea8565-914a-4a8a-b6be-e3c633a3f16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:23:45.934779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea8565-914a-4a8a-b6be-e3c633a3f16d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:23:45.940379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65722e1d-8fd0-4a1e-8f3c-87d7944ed16b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:23:45.941041 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65722e1d-8fd0-4a1e-8f3c-87d7944ed16b service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:45.941325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65722e1d-8fd0-4a1e-8f3c-87d7944ed16b service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:45.942304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65722e1d-8fd0-4a1e-8f3c-87d7944ed16b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:45.952251 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65722e1d-8fd0-4a1e-8f3c-87d7944ed16b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:23:45.954931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65722e1d-8fd0-4a1e-8f3c-87d7944ed16b service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:23:45.970147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 763/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:23:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:23:46.825273 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1633ed-c72c-45d7-acec-d10d73cead63 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:46.825760 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1633ed-c72c-45d7-acec-d10d73cead63 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:46.825863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1633ed-c72c-45d7-acec-d10d73cead63 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:46.827300 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 15:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:23:46.833098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67728f-c8a5-40d8-a894-8b86a322a9d0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:46.833657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67728f-c8a5-40d8-a894-8b86a322a9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:46.833657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67728f-c8a5-40d8-a894-8b86a322a9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:46.854895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ae67728f-c8a5-40d8-a894-8b86a322a9d0 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:23:46.856227 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ae67728f-c8a5-40d8-a894-8b86a322a9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:23:46.865174 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 15:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:23:47.032159 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1633ed-c72c-45d7-acec-d10d73cead63 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:23:47.053775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1633ed-c72c-45d7-acec-d10d73cead63 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:23:47.061855 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f151b6-0325-4598-8e91-145eaea5ea34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:23:47.062697 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f151b6-0325-4598-8e91-145eaea5ea34 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:47.063224 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f151b6-0325-4598-8e91-145eaea5ea34 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:47.063557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f151b6-0325-4598-8e91-145eaea5ea34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:47.074887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f151b6-0325-4598-8e91-145eaea5ea34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:23:47.076767 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f151b6-0325-4598-8e91-145eaea5ea34 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:23:47.087696 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 752/1516] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:23:47.202674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0febe0a-cc37-42b9-a042-9cf89ddd93b1 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:47.202968 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0febe0a-cc37-42b9-a042-9cf89ddd93b1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:47.203252 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0febe0a-cc37-42b9-a042-9cf89ddd93b1 None None] PATH_INFO: `/v3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:47.204590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 765/1517] 10.222.0.49 () {54 vars in 925 bytes} [Mon Jun 27 15:23:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:23:47.211295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadc654-5855-4687-88d3-7d55b9401f67 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:47.211602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadc654-5855-4687-88d3-7d55b9401f67 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:47.211862 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadc654-5855-4687-88d3-7d55b9401f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:47.232198 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5aadc654-5855-4687-88d3-7d55b9401f67 None None] MFA Rules not processed for user `b471b5b4ede845c7a9dfbf2a90544591`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:23:47.233459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5aadc654-5855-4687-88d3-7d55b9401f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:23:47.303624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 753/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Jun 27 15:23:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:23:51.122935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5588d17-cc94-4869-a485-03549a4482aa None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:51.123519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5588d17-cc94-4869-a485-03549a4482aa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:51.123519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5588d17-cc94-4869-a485-03549a4482aa None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:51.124786 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 766/1519] 10.222.0.33 () {54 vars in 960 bytes} [Mon Jun 27 15:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:23:51.131232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d26698-87dc-4479-abe7-bb885fbcad41 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:51.131715 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d26698-87dc-4479-abe7-bb885fbcad41 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:51.131825 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d26698-87dc-4479-abe7-bb885fbcad41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:51.160846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c1d26698-87dc-4479-abe7-bb885fbcad41 None None] MFA Rules not processed for user `b471b5b4ede845c7a9dfbf2a90544591`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:23:51.162493 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c1d26698-87dc-4479-abe7-bb885fbcad41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:23:51.172221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 754/1520] 10.222.0.33 () {58 vars in 1057 bytes} [Mon Jun 27 15:23:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:23:51.180707 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5588d17-cc94-4869-a485-03549a4482aa None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:23:51.196771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5588d17-cc94-4869-a485-03549a4482aa None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:23:51.203016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c437f-6612-4886-856e-697e3e516889 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b471b5b4ede845c7a9dfbf2a90544591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:23:51.203671 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c437f-6612-4886-856e-697e3e516889 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:51.203965 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c437f-6612-4886-856e-697e3e516889 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:51.204260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c437f-6612-4886-856e-697e3e516889 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:51.213342 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c437f-6612-4886-856e-697e3e516889 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:23:51.215044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c437f-6612-4886-856e-697e3e516889 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:23:51.225570 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 767/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:23:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:23:58.350728 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3300e-3dcf-4622-b829-7f456b51a388 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:58.351284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3300e-3dcf-4622-b829-7f456b51a388 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:58.351284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3300e-3dcf-4622-b829-7f456b51a388 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:58.353342 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 15:23:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:23:58.358477 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d23e1-c054-4ea8-829f-93efc5f9e39f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:58.358935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d23e1-c054-4ea8-829f-93efc5f9e39f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:58.359057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d23e1-c054-4ea8-829f-93efc5f9e39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:58.381522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a09d23e1-c054-4ea8-829f-93efc5f9e39f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:23:58.382774 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a09d23e1-c054-4ea8-829f-93efc5f9e39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:23:58.393061 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 15:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:23:58.550453 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3300e-3dcf-4622-b829-7f456b51a388 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:23:58.567052 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3300e-3dcf-4622-b829-7f456b51a388 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:23:58.573715 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32885de3-1cfe-4a21-9c1b-a32e9e7f4f32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:23:58.574442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32885de3-1cfe-4a21-9c1b-a32e9e7f4f32 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:58.574726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32885de3-1cfe-4a21-9c1b-a32e9e7f4f32 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:58.575004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32885de3-1cfe-4a21-9c1b-a32e9e7f4f32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:58.585145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32885de3-1cfe-4a21-9c1b-a32e9e7f4f32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:23:58.587281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32885de3-1cfe-4a21-9c1b-a32e9e7f4f32 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:23:58.597732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 756/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:23:59.429541 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71279218-ef54-489d-a3cf-ce9f1f981a7a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:59.430441 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71279218-ef54-489d-a3cf-ce9f1f981a7a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:59.430441 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71279218-ef54-489d-a3cf-ce9f1f981a7a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:59.432538 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 15:23:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:23:59.438620 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a668d1-7c55-48d9-bbb7-01ca00105531 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:59.439099 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a668d1-7c55-48d9-bbb7-01ca00105531 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:59.439230 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a668d1-7c55-48d9-bbb7-01ca00105531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:59.461612 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d0a668d1-7c55-48d9-bbb7-01ca00105531 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:23:59.462873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d0a668d1-7c55-48d9-bbb7-01ca00105531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:23:59.471879 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 15:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:23:59.627375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71279218-ef54-489d-a3cf-ce9f1f981a7a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:23:59.658009 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71279218-ef54-489d-a3cf-ce9f1f981a7a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:23:59.666534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580b72c-3c76-4424-8655-3165ba4c5a6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:23:59.667195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580b72c-3c76-4424-8655-3165ba4c5a6c service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:23:59.667480 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580b72c-3c76-4424-8655-3165ba4c5a6c service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:23:59.667757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580b72c-3c76-4424-8655-3165ba4c5a6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:23:59.678475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580b72c-3c76-4424-8655-3165ba4c5a6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:23:59.681259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580b72c-3c76-4424-8655-3165ba4c5a6c service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:23:59.694713 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 770/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:24:03.938587 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd02b-dd7d-4beb-a2b9-d0550148dc60 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:24:03.939442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd02b-dd7d-4beb-a2b9-d0550148dc60 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:24:03.939442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd02b-dd7d-4beb-a2b9-d0550148dc60 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:24:03.941749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 15:24:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:24:03.950093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbb61e-1561-465b-84e1-e76e85bac598 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:24:03.950588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbb61e-1561-465b-84e1-e76e85bac598 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:24:03.950707 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbb61e-1561-465b-84e1-e76e85bac598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:24:03.970458 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bccbb61e-1561-465b-84e1-e76e85bac598 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:24:03.971658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bccbb61e-1561-465b-84e1-e76e85bac598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:24:03.980004 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 15:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:24:04.016594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fd02b-dd7d-4beb-a2b9-d0550148dc60 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:24:04.018893 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-aa0fd02b-dd7d-4beb-a2b9-d0550148dc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:24:04.079436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fd02b-dd7d-4beb-a2b9-d0550148dc60 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:24:04.083290 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f51e72-647c-4c1c-9d4f-9df7b917c884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:24:04.083942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51e72-647c-4c1c-9d4f-9df7b917c884 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:24:04.084224 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51e72-647c-4c1c-9d4f-9df7b917c884 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:24:04.084498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51e72-647c-4c1c-9d4f-9df7b917c884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:24:04.093846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f51e72-647c-4c1c-9d4f-9df7b917c884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:24:04.095318 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f51e72-647c-4c1c-9d4f-9df7b917c884 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:24:04.100127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:24:04.104991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 759/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:24:06.130374 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e074c1-f366-404b-bcfe-b05ef3a470ea None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:24:06.130842 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e074c1-f366-404b-bcfe-b05ef3a470ea None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:24:06.130949 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e074c1-f366-404b-bcfe-b05ef3a470ea None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:24:06.132346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 15:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:24:06.139441 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860dea0-f146-4ab4-9418-f97b517b376d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:24:06.139899 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860dea0-f146-4ab4-9418-f97b517b376d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:24:06.140015 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860dea0-f146-4ab4-9418-f97b517b376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:24:06.159954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3860dea0-f146-4ab4-9418-f97b517b376d None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:24:06.161210 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3860dea0-f146-4ab4-9418-f97b517b376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:24:06.170090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 15:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:24:06.210400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e074c1-f366-404b-bcfe-b05ef3a470ea None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:24:06.223487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e074c1-f366-404b-bcfe-b05ef3a470ea None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:24:06.227780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e20f1-e1c6-4379-8dd1-b268eb2d537a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:24:06.228431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e20f1-e1c6-4379-8dd1-b268eb2d537a service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:24:06.228713 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e20f1-e1c6-4379-8dd1-b268eb2d537a service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:24:06.228994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e20f1-e1c6-4379-8dd1-b268eb2d537a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:24:06.238535 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e20f1-e1c6-4379-8dd1-b268eb2d537a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:24:06.239987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e20f1-e1c6-4379-8dd1-b268eb2d537a service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:24:06.251276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 773/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:24:10.068704 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0436354-2a84-48a6-8e42-88973a1a8a77 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:24:10.069163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0436354-2a84-48a6-8e42-88973a1a8a77 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:24:10.069388 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0436354-2a84-48a6-8e42-88973a1a8a77 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:24:10.070834 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 15:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:24:10.077157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946f50a-1848-4261-b103-212751f813b3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:24:10.077647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946f50a-1848-4261-b103-212751f813b3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:24:10.077749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946f50a-1848-4261-b103-212751f813b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:24:10.084522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=62 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:24:10.099039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8946f50a-1848-4261-b103-212751f813b3 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:24:10.100274 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8946f50a-1848-4261-b103-212751f813b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:24:10.108765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 15:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:24:10.420705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0436354-2a84-48a6-8e42-88973a1a8a77 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:24:10.424164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d0436354-2a84-48a6-8e42-88973a1a8a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:24:10.505396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0436354-2a84-48a6-8e42-88973a1a8a77 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:24:10.509796 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe764c-e630-4676-823e-efc4adcf3d4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:24:10.510531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe764c-e630-4676-823e-efc4adcf3d4c service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:24:10.510828 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe764c-e630-4676-823e-efc4adcf3d4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:24:10.511098 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe764c-e630-4676-823e-efc4adcf3d4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:24:10.524708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe764c-e630-4676-823e-efc4adcf3d4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:24:10.526187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe764c-e630-4676-823e-efc4adcf3d4c service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:24:10.541403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 762/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:24:12.661657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de44c-f9a6-41be-a73f-b44df36976dd None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:24:12.662295 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de44c-f9a6-41be-a73f-b44df36976dd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:24:12.662295 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de44c-f9a6-41be-a73f-b44df36976dd None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:24:12.663597 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 15:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:24:12.669398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c68ab5-16ef-4aef-9113-b4042bb359ae None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:24:12.670166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c68ab5-16ef-4aef-9113-b4042bb359ae None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:24:12.670166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c68ab5-16ef-4aef-9113-b4042bb359ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:24:12.690137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e6c68ab5-16ef-4aef-9113-b4042bb359ae None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:24:12.691487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e6c68ab5-16ef-4aef-9113-b4042bb359ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:24:12.701521 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 15:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:24:13.032312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3de44c-f9a6-41be-a73f-b44df36976dd None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:24:13.034154 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2a3de44c-f9a6-41be-a73f-b44df36976dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:24:13.049036 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3de44c-f9a6-41be-a73f-b44df36976dd None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:24:13.053334 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a411778-ccf2-44af-ad42-705128e611d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:24:13.053970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a411778-ccf2-44af-ad42-705128e611d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:24:13.054322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a411778-ccf2-44af-ad42-705128e611d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:24:13.054532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a411778-ccf2-44af-ad42-705128e611d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:24:13.065627 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a411778-ccf2-44af-ad42-705128e611d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:24:13.067131 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a411778-ccf2-44af-ad42-705128e611d8 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:24:13.077394 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 776/1539] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:24:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:24:22.684552 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=32 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:24:23.072810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=8 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:45.229675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d16e24-d55e-43d2-a4ac-4de0ae661f65 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.229675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d16e24-d55e-43d2-a4ac-4de0ae661f65 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.229675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d16e24-d55e-43d2-a4ac-4de0ae661f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:45.229675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-80d16e24-d55e-43d2-a4ac-4de0ae661f65 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:45.229675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-80d16e24-d55e-43d2-a4ac-4de0ae661f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:45.229675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 764/1540] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:45.235072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db865c1b-c305-4e14-baba-c35f8bf1a354 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.235814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db865c1b-c305-4e14-baba-c35f8bf1a354 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.235814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db865c1b-c305-4e14-baba-c35f8bf1a354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:45.259066 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-db865c1b-c305-4e14-baba-c35f8bf1a354 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:45.268230 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-db865c1b-c305-4e14-baba-c35f8bf1a354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:45.270415 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 777/1541] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:45.275494 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d16e24-d55e-43d2-a4ac-4de0ae661f65 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:45.286061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d16e24-d55e-43d2-a4ac-4de0ae661f65 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:45.295101 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63695ab-ec44-4b0a-9d61-2ee255f2da12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:45.295822 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63695ab-ec44-4b0a-9d61-2ee255f2da12 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.296107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63695ab-ec44-4b0a-9d61-2ee255f2da12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.296388 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63695ab-ec44-4b0a-9d61-2ee255f2da12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:45.297136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63695ab-ec44-4b0a-9d61-2ee255f2da12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:25:45.297802 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63695ab-ec44-4b0a-9d61-2ee255f2da12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:45.299529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63695ab-ec44-4b0a-9d61-2ee255f2da12 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:45.319049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 765/1542] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:25:45.327755 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db865c1b-c305-4e14-baba-c35f8bf1a354 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:45.341160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db865c1b-c305-4e14-baba-c35f8bf1a354 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:45.349826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381963eb-0982-497e-92cd-fafcc86cc951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:45.350572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381963eb-0982-497e-92cd-fafcc86cc951 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.350848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381963eb-0982-497e-92cd-fafcc86cc951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.351124 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381963eb-0982-497e-92cd-fafcc86cc951 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:45.351839 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381963eb-0982-497e-92cd-fafcc86cc951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:45.353881 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381963eb-0982-497e-92cd-fafcc86cc951 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:45.392088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 778/1543] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:25:45 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:45.396866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63695ab-ec44-4b0a-9d61-2ee255f2da12 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:45.408747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63695ab-ec44-4b0a-9d61-2ee255f2da12 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:45.505789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d3c2-4208-4198-8a74-e805c4b08e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:45.506804 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d3c2-4208-4198-8a74-e805c4b08e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.507141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d3c2-4208-4198-8a74-e805c4b08e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.507484 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d3c2-4208-4198-8a74-e805c4b08e14 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:45.508260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71d3c2-4208-4198-8a74-e805c4b08e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:45.510316 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71d3c2-4208-4198-8a74-e805c4b08e14 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:45.543125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 766/1544] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:25:45 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:45.548160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381963eb-0982-497e-92cd-fafcc86cc951 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:45.564742 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381963eb-0982-497e-92cd-fafcc86cc951 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:45.571826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426e16a-e360-492d-8ec9-a8780a55819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:45.572597 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426e16a-e360-492d-8ec9-a8780a55819c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.572886 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426e16a-e360-492d-8ec9-a8780a55819c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.573165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426e16a-e360-492d-8ec9-a8780a55819c admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:45.573921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426e16a-e360-492d-8ec9-a8780a55819c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:45.575621 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426e16a-e360-492d-8ec9-a8780a55819c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:45.591788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 779/1545] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:25:45.595884 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d3c2-4208-4198-8a74-e805c4b08e14 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:45.612574 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d3c2-4208-4198-8a74-e805c4b08e14 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:45.622564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8963c7-86cf-4558-9ca1-dc3e0f5f2d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:45.623276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8963c7-86cf-4558-9ca1-dc3e0f5f2d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.623565 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8963c7-86cf-4558-9ca1-dc3e0f5f2d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.623858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8963c7-86cf-4558-9ca1-dc3e0f5f2d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:45.624610 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8963c7-86cf-4558-9ca1-dc3e0f5f2d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:45.626324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8963c7-86cf-4558-9ca1-dc3e0f5f2d46 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:45.643260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 767/1546] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:45.648105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426e16a-e360-492d-8ec9-a8780a55819c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:45.664800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426e16a-e360-492d-8ec9-a8780a55819c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:45.675243 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68eb46-0e2d-493f-a347-6b7b31128806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:45.676194 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68eb46-0e2d-493f-a347-6b7b31128806 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.676471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68eb46-0e2d-493f-a347-6b7b31128806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.676748 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68eb46-0e2d-493f-a347-6b7b31128806 admin admin] PATH_INFO: `/v3/projects/e79c93921a6444e68048cf12a02baa24/users/69c9809662bc441f8e95bfe2e4d069f5/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:45.699560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68eb46-0e2d-493f-a347-6b7b31128806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79c93921a6444e68048cf12a02baa24, user_id=69c9809662bc441f8e95bfe2e4d069f5, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:45.702769 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68eb46-0e2d-493f-a347-6b7b31128806 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:45.716327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791af9ad-9eb7-469b-a43e-2aa3fdc1faba None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.716589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791af9ad-9eb7-469b-a43e-2aa3fdc1faba None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.716887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791af9ad-9eb7-469b-a43e-2aa3fdc1faba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:45.745263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 780/1547] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:25:45 2022] PUT /identity/v3/projects/e79c93921a6444e68048cf12a02baa24/users/69c9809662bc441f8e95bfe2e4d069f5/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:45.748528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-791af9ad-9eb7-469b-a43e-2aa3fdc1faba None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:45.754873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201d85d-20bb-424f-9727-288c0cee7d3a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.755175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201d85d-20bb-424f-9727-288c0cee7d3a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.755447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201d85d-20bb-424f-9727-288c0cee7d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:45.755563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-791af9ad-9eb7-469b-a43e-2aa3fdc1faba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:45.788258 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6201d85d-20bb-424f-9727-288c0cee7d3a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:45.789541 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6201d85d-20bb-424f-9727-288c0cee7d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:45.862987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 768/1548] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:25:45.864526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd604e-41bf-4aa8-8227-4cd6a59d2392 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.864817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd604e-41bf-4aa8-8227-4cd6a59d2392 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.865095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd604e-41bf-4aa8-8227-4cd6a59d2392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:45.894214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ffdd604e-41bf-4aa8-8227-4cd6a59d2392 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:45.895454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ffdd604e-41bf-4aa8-8227-4cd6a59d2392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:45.904130 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 769/1549] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:45.910170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e8d25-a7a6-4da3-a903-f38ab9b6628f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.910170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e8d25-a7a6-4da3-a903-f38ab9b6628f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.910170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e8d25-a7a6-4da3-a903-f38ab9b6628f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:45.925477 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 781/1550] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:45.927128 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fed70-fa42-4361-b021-961d7d66c605 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.927258 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-550e8d25-a7a6-4da3-a903-f38ab9b6628f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:45.927488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fed70-fa42-4361-b021-961d7d66c605 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.927935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fed70-fa42-4361-b021-961d7d66c605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:45.928670 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-550e8d25-a7a6-4da3-a903-f38ab9b6628f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:45.937924 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 770/1551] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:45.939267 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1270c-9ad9-40db-a8bc-295c7903aa55 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.939562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1270c-9ad9-40db-a8bc-295c7903aa55 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.939841 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1270c-9ad9-40db-a8bc-295c7903aa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:45.951196 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bd4fed70-fa42-4361-b021-961d7d66c605 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:45.952435 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bd4fed70-fa42-4361-b021-961d7d66c605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:45.958599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d9f1270c-9ad9-40db-a8bc-295c7903aa55 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:45.960333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d9f1270c-9ad9-40db-a8bc-295c7903aa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:45.960711 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 782/1552] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:45.962055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbec249-d0bc-4796-8290-9a0b5cb923c9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.962383 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbec249-d0bc-4796-8290-9a0b5cb923c9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.962670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbec249-d0bc-4796-8290-9a0b5cb923c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:45.969907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 771/1553] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:45.971285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7f7f4-ef10-4afc-8726-e9c47572ec1c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.971567 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7f7f4-ef10-4afc-8726-e9c47572ec1c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.971839 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7f7f4-ef10-4afc-8726-e9c47572ec1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:45.986075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2fbec249-d0bc-4796-8290-9a0b5cb923c9 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:45.987607 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2fbec249-d0bc-4796-8290-9a0b5cb923c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:45.991040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1ca7f7f4-ef10-4afc-8726-e9c47572ec1c None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:45.992360 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1ca7f7f4-ef10-4afc-8726-e9c47572ec1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:45.996393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 783/1554] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:45.997697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfb551-5e9c-40b9-b5ae-3cb3cbaef004 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:45.997979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfb551-5e9c-40b9-b5ae-3cb3cbaef004 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:45.998281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfb551-5e9c-40b9-b5ae-3cb3cbaef004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.007921 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 772/1555] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:46.009256 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c177b2d-c96c-44ea-bdc0-22bbc23af072 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.009609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c177b2d-c96c-44ea-bdc0-22bbc23af072 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.009895 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c177b2d-c96c-44ea-bdc0-22bbc23af072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.018838 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-98bfb551-5e9c-40b9-b5ae-3cb3cbaef004 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:46.020070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-98bfb551-5e9c-40b9-b5ae-3cb3cbaef004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:46.028190 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 784/1556] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:46.028687 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9c177b2d-c96c-44ea-bdc0-22bbc23af072 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:46.029063 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfb551-5e9c-40b9-b5ae-3cb3cbaef004 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.029985 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9c177b2d-c96c-44ea-bdc0-22bbc23af072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:46.039592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 773/1557] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:46.040933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cf189-b0f8-4878-bcfc-ec3fb9cd59ea None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.041230 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cf189-b0f8-4878-bcfc-ec3fb9cd59ea None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.041512 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cf189-b0f8-4878-bcfc-ec3fb9cd59ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.064524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7a7cf189-b0f8-4878-bcfc-ec3fb9cd59ea None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:46.066331 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7a7cf189-b0f8-4878-bcfc-ec3fb9cd59ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:46.075614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 774/1558] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:46.076968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadad1d-7789-4f11-b1d1-87cf8617ef90 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.077261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadad1d-7789-4f11-b1d1-87cf8617ef90 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.077543 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadad1d-7789-4f11-b1d1-87cf8617ef90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.101362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8cadad1d-7789-4f11-b1d1-87cf8617ef90 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:46.102635 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8cadad1d-7789-4f11-b1d1-87cf8617ef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:46.105492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfb551-5e9c-40b9-b5ae-3cb3cbaef004 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.109100 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e242f7-b991-4db7-ad75-da13a8202af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.109771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e242f7-b991-4db7-ad75-da13a8202af5 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.110062 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e242f7-b991-4db7-ad75-da13a8202af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.110383 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e242f7-b991-4db7-ad75-da13a8202af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.112805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 775/1559] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:46.114133 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadad1d-7789-4f11-b1d1-87cf8617ef90 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.124703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadad1d-7789-4f11-b1d1-87cf8617ef90 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.126114 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e242f7-b991-4db7-ad75-da13a8202af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.128094 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e242f7-b991-4db7-ad75-da13a8202af5 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.129414 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da47f1-4fd3-4c4a-b2d0-7cca54ab1b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.130098 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da47f1-4fd3-4c4a-b2d0-7cca54ab1b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.130424 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da47f1-4fd3-4c4a-b2d0-7cca54ab1b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.130714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da47f1-4fd3-4c4a-b2d0-7cca54ab1b70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.131538 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da47f1-4fd3-4c4a-b2d0-7cca54ab1b70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:25:46.131852 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da47f1-4fd3-4c4a-b2d0-7cca54ab1b70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.133507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da47f1-4fd3-4c4a-b2d0-7cca54ab1b70 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.139352 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 785/1560] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:25:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:25:46.140779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3fdee-d711-4a57-aede-33acb2ca8074 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.140942 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3fdee-d711-4a57-aede-33acb2ca8074 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.141223 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3fdee-d711-4a57-aede-33acb2ca8074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.143337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:46.150742 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 776/1561] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:25:46.152725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c980dec-fcd6-4b35-9eb9-55e3e8556484 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.153015 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c980dec-fcd6-4b35-9eb9-55e3e8556484 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.153301 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c980dec-fcd6-4b35-9eb9-55e3e8556484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.167837 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c7c3fdee-d711-4a57-aede-33acb2ca8074 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:46.169042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c7c3fdee-d711-4a57-aede-33acb2ca8074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:46.174625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8c980dec-fcd6-4b35-9eb9-55e3e8556484 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:46.175946 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8c980dec-fcd6-4b35-9eb9-55e3e8556484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:46.182475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 786/1562] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:46.182475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3fdee-d711-4a57-aede-33acb2ca8074 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.188959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3fdee-d711-4a57-aede-33acb2ca8074 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.189493 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 777/1563] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:46.193457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a322c-45e1-4db4-9a61-402e5d8b2e8b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.193457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a322c-45e1-4db4-9a61-402e5d8b2e8b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.193457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a322c-45e1-4db4-9a61-402e5d8b2e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.198742 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8522f-0504-4dc8-ac78-14654e0adfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.199974 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8522f-0504-4dc8-ac78-14654e0adfeb admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.200311 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8522f-0504-4dc8-ac78-14654e0adfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.200570 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8522f-0504-4dc8-ac78-14654e0adfeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.201742 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8522f-0504-4dc8-ac78-14654e0adfeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:25:46.201884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8522f-0504-4dc8-ac78-14654e0adfeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.203248 dv-cinder-847798-1-smb devstack@keystone.service[80192]: WARNING py.warnings [None req-fad8522f-0504-4dc8-ac78-14654e0adfeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:25:46.203248 dv-cinder-847798-1-smb devstack@keystone.service[80192]: warnings.warn(msg) Jun 27 15:25:46.203248 dv-cinder-847798-1-smb devstack@keystone.service[80192]: Jun 27 15:25:46.204335 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8522f-0504-4dc8-ac78-14654e0adfeb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.214844 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c41a322c-45e1-4db4-9a61-402e5d8b2e8b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:46.215071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:46.216076 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c41a322c-45e1-4db4-9a61-402e5d8b2e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:46.222578 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 787/1564] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:25:46.223540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8522f-0504-4dc8-ac78-14654e0adfeb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.227253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 778/1565] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:46.228573 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a322c-45e1-4db4-9a61-402e5d8b2e8b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.234747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8522f-0504-4dc8-ac78-14654e0adfeb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.239966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916be007-729d-45d4-9456-d364bd528167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.240815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916be007-729d-45d4-9456-d364bd528167 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.241087 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916be007-729d-45d4-9456-d364bd528167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.241194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a322c-45e1-4db4-9a61-402e5d8b2e8b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.241705 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916be007-729d-45d4-9456-d364bd528167 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.242122 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916be007-729d-45d4-9456-d364bd528167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:25:46.242431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916be007-729d-45d4-9456-d364bd528167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.244066 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916be007-729d-45d4-9456-d364bd528167 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.247767 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2bd4c-84a5-479a-8dd8-6f1a410e4bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.248597 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2bd4c-84a5-479a-8dd8-6f1a410e4bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.248987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2bd4c-84a5-479a-8dd8-6f1a410e4bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.249357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2bd4c-84a5-479a-8dd8-6f1a410e4bbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.250205 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2bd4c-84a5-479a-8dd8-6f1a410e4bbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:25:46.250651 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2bd4c-84a5-479a-8dd8-6f1a410e4bbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.252884 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2bd4c-84a5-479a-8dd8-6f1a410e4bbd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.257276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 788/1566] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:25:46.265187 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916be007-729d-45d4-9456-d364bd528167 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.270276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 779/1567] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:25:46.271248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2bd4c-84a5-479a-8dd8-6f1a410e4bbd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.280776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916be007-729d-45d4-9456-d364bd528167 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.282463 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2bd4c-84a5-479a-8dd8-6f1a410e4bbd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.286523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abed80-8738-44c5-806c-9ffbf310a5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.287536 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafed3a-3ba6-4b66-8f63-fdf3f4d0de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.287939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abed80-8738-44c5-806c-9ffbf310a5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.288259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafed3a-3ba6-4b66-8f63-fdf3f4d0de57 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.288541 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafed3a-3ba6-4b66-8f63-fdf3f4d0de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.288802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abed80-8738-44c5-806c-9ffbf310a5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.288917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafed3a-3ba6-4b66-8f63-fdf3f4d0de57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.289378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abed80-8738-44c5-806c-9ffbf310a5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.289536 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafed3a-3ba6-4b66-8f63-fdf3f4d0de57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:25:46.289850 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafed3a-3ba6-4b66-8f63-fdf3f4d0de57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.290597 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abed80-8738-44c5-806c-9ffbf310a5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.291577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafed3a-3ba6-4b66-8f63-fdf3f4d0de57 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.292935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abed80-8738-44c5-806c-9ffbf310a5f7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.308186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 780/1568] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:25:46.309075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafed3a-3ba6-4b66-8f63-fdf3f4d0de57 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.328038 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafed3a-3ba6-4b66-8f63-fdf3f4d0de57 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.331683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 789/1569] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:46.332511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abed80-8738-44c5-806c-9ffbf310a5f7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.337306 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa7810-47bb-4777-b0cb-e8284ad8754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.338287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa7810-47bb-4777-b0cb-e8284ad8754d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.338685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa7810-47bb-4777-b0cb-e8284ad8754d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.339080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa7810-47bb-4777-b0cb-e8284ad8754d admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.339714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa7810-47bb-4777-b0cb-e8284ad8754d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:25:46.340023 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa7810-47bb-4777-b0cb-e8284ad8754d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.344274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa7810-47bb-4777-b0cb-e8284ad8754d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.357865 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 781/1570] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:25:46.358925 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa7810-47bb-4777-b0cb-e8284ad8754d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.371834 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa7810-47bb-4777-b0cb-e8284ad8754d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.420886 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abed80-8738-44c5-806c-9ffbf310a5f7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.426461 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ec9b7-36d8-41c8-be42-9d7f64bf1e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.427269 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ec9b7-36d8-41c8-be42-9d7f64bf1e85 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.427551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ec9b7-36d8-41c8-be42-9d7f64bf1e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.427954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ec9b7-36d8-41c8-be42-9d7f64bf1e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.429575 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ec9b7-36d8-41c8-be42-9d7f64bf1e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.431590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ec9b7-36d8-41c8-be42-9d7f64bf1e85 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.440099 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc611f-8424-4ab7-8fe3-a6dbd914f9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.440908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc611f-8424-4ab7-8fe3-a6dbd914f9bc admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.441229 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc611f-8424-4ab7-8fe3-a6dbd914f9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.441581 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc611f-8424-4ab7-8fe3-a6dbd914f9bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.442422 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc611f-8424-4ab7-8fe3-a6dbd914f9bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:25:46.442813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc611f-8424-4ab7-8fe3-a6dbd914f9bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.444529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc611f-8424-4ab7-8fe3-a6dbd914f9bc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.457541 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 782/1571] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:25:46.458625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc611f-8424-4ab7-8fe3-a6dbd914f9bc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.469577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc611f-8424-4ab7-8fe3-a6dbd914f9bc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.473198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 790/1572] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/projects => generated 363 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:46.473198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ec9b7-36d8-41c8-be42-9d7f64bf1e85 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.537730 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab59b40-6572-414e-81af-614d94d07a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.538464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab59b40-6572-414e-81af-614d94d07a29 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.538748 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab59b40-6572-414e-81af-614d94d07a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.539021 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab59b40-6572-414e-81af-614d94d07a29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.539864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab59b40-6572-414e-81af-614d94d07a29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.540894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: WARNING py.warnings [None req-2ab59b40-6572-414e-81af-614d94d07a29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:25:46.540894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: warnings.warn(msg) Jun 27 15:25:46.540894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: Jun 27 15:25:46.542117 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab59b40-6572-414e-81af-614d94d07a29 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.548615 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ec9b7-36d8-41c8-be42-9d7f64bf1e85 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.556443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b0fe8-9cac-4e9c-8c8d-0a38f62dd549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.557329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b0fe8-9cac-4e9c-8c8d-0a38f62dd549 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.557713 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b0fe8-9cac-4e9c-8c8d-0a38f62dd549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.558274 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b0fe8-9cac-4e9c-8c8d-0a38f62dd549 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.559198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b0fe8-9cac-4e9c-8c8d-0a38f62dd549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.561271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b0fe8-9cac-4e9c-8c8d-0a38f62dd549 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.579657 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 783/1573] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:46.579657 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab59b40-6572-414e-81af-614d94d07a29 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.608993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 791/1574] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:46.609927 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b0fe8-9cac-4e9c-8c8d-0a38f62dd549 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.634865 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:46.673987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab59b40-6572-414e-81af-614d94d07a29 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.675123 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:46.714549 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b0fe8-9cac-4e9c-8c8d-0a38f62dd549 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.719385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51493ce-2dbc-4b3a-8c0b-36288ccc26a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.720245 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51493ce-2dbc-4b3a-8c0b-36288ccc26a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.720551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51493ce-2dbc-4b3a-8c0b-36288ccc26a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.720832 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51493ce-2dbc-4b3a-8c0b-36288ccc26a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.722211 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51493ce-2dbc-4b3a-8c0b-36288ccc26a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.723264 dv-cinder-847798-1-smb devstack@keystone.service[80192]: WARNING py.warnings [None req-a51493ce-2dbc-4b3a-8c0b-36288ccc26a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:25:46.723264 dv-cinder-847798-1-smb devstack@keystone.service[80192]: warnings.warn(msg) Jun 27 15:25:46.723264 dv-cinder-847798-1-smb devstack@keystone.service[80192]: Jun 27 15:25:46.725039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51493ce-2dbc-4b3a-8c0b-36288ccc26a2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.747718 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709be33-9ef1-43d1-be20-96477e7126b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.751765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 792/1575] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:46.751941 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709be33-9ef1-43d1-be20-96477e7126b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.751941 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709be33-9ef1-43d1-be20-96477e7126b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.752132 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51493ce-2dbc-4b3a-8c0b-36288ccc26a2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.752244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709be33-9ef1-43d1-be20-96477e7126b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.752244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709be33-9ef1-43d1-be20-96477e7126b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.753317 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709be33-9ef1-43d1-be20-96477e7126b0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.763044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51493ce-2dbc-4b3a-8c0b-36288ccc26a2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.767676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0d935-4de4-44af-8c7e-48643f19ec69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.768403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0d935-4de4-44af-8c7e-48643f19ec69 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.768693 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0d935-4de4-44af-8c7e-48643f19ec69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.768970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0d935-4de4-44af-8c7e-48643f19ec69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.770691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0d935-4de4-44af-8c7e-48643f19ec69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.771982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0d935-4de4-44af-8c7e-48643f19ec69 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.785267 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 784/1576] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:46.786482 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709be33-9ef1-43d1-be20-96477e7126b0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.804312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 793/1577] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:46.808443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0d935-4de4-44af-8c7e-48643f19ec69 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.859542 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709be33-9ef1-43d1-be20-96477e7126b0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.892090 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0d935-4de4-44af-8c7e-48643f19ec69 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.898873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f16d92-ac50-4641-a2e9-0f783e0ee8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.899598 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f16d92-ac50-4641-a2e9-0f783e0ee8eb admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.899886 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f16d92-ac50-4641-a2e9-0f783e0ee8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.900198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f16d92-ac50-4641-a2e9-0f783e0ee8eb admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.900871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f16d92-ac50-4641-a2e9-0f783e0ee8eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.902890 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f16d92-ac50-4641-a2e9-0f783e0ee8eb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.939680 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 794/1578] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/users => generated 282 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:46.939680 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f16d92-ac50-4641-a2e9-0f783e0ee8eb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:46.955455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f16d92-ac50-4641-a2e9-0f783e0ee8eb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:46.961804 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30819b3a-a8c9-4a39-b468-0c9ee812bde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.962630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30819b3a-a8c9-4a39-b468-0c9ee812bde6 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.963038 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30819b3a-a8c9-4a39-b468-0c9ee812bde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.963388 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30819b3a-a8c9-4a39-b468-0c9ee812bde6 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.964174 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30819b3a-a8c9-4a39-b468-0c9ee812bde6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.966297 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30819b3a-a8c9-4a39-b468-0c9ee812bde6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.967594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28185234-ac2e-4978-8ff8-5d3f8e192b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:46.968395 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28185234-ac2e-4978-8ff8-5d3f8e192b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:46.968680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28185234-ac2e-4978-8ff8-5d3f8e192b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:46.968958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28185234-ac2e-4978-8ff8-5d3f8e192b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:46.969968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28185234-ac2e-4978-8ff8-5d3f8e192b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:46.972276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28185234-ac2e-4978-8ff8-5d3f8e192b32 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:46.985530 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:46.993586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 795/1579] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/users => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:46.994544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30819b3a-a8c9-4a39-b468-0c9ee812bde6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.014924 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30819b3a-a8c9-4a39-b468-0c9ee812bde6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.024116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253ef0d-7269-4327-9e4a-3a3c4787c2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.025164 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253ef0d-7269-4327-9e4a-3a3c4787c2ca admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.025615 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253ef0d-7269-4327-9e4a-3a3c4787c2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.026047 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253ef0d-7269-4327-9e4a-3a3c4787c2ca admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.026314 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 785/1580] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/projects => generated 393 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:47.027258 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28185234-ac2e-4978-8ff8-5d3f8e192b32 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.027651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253ef0d-7269-4327-9e4a-3a3c4787c2ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.031086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253ef0d-7269-4327-9e4a-3a3c4787c2ca admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.060882 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 796/1581] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:25:46 2022] POST /identity/v3/users => generated 293 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:47.066032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253ef0d-7269-4327-9e4a-3a3c4787c2ca admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.078792 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253ef0d-7269-4327-9e4a-3a3c4787c2ca admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.141302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28185234-ac2e-4978-8ff8-5d3f8e192b32 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.147270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d8915-c882-40e8-b1ec-c9590dacb05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.148206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8915-c882-40e8-b1ec-c9590dacb05f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.148494 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8915-c882-40e8-b1ec-c9590dacb05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.148825 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8915-c882-40e8-b1ec-c9590dacb05f admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.149722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d8915-c882-40e8-b1ec-c9590dacb05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.151589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d8915-c882-40e8-b1ec-c9590dacb05f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.157976 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:47.166436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 786/1582] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:47.167589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d8915-c882-40e8-b1ec-c9590dacb05f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.170529 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c96639-f0a1-4a2a-bba5-8935756f19f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.171911 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c96639-f0a1-4a2a-bba5-8935756f19f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.172779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c96639-f0a1-4a2a-bba5-8935756f19f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.173378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c96639-f0a1-4a2a-bba5-8935756f19f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.174305 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c96639-f0a1-4a2a-bba5-8935756f19f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.176906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c96639-f0a1-4a2a-bba5-8935756f19f5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.182348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d8915-c882-40e8-b1ec-c9590dacb05f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.187741 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa3ab0-1906-4cd7-9631-cd0c0b229c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.189116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa3ab0-1906-4cd7-9631-cd0c0b229c6c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.189776 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa3ab0-1906-4cd7-9631-cd0c0b229c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.190384 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa3ab0-1906-4cd7-9631-cd0c0b229c6c admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.191417 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa3ab0-1906-4cd7-9631-cd0c0b229c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.193649 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa3ab0-1906-4cd7-9631-cd0c0b229c6c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.207443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 797/1583] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:25:47 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:47.208792 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c96639-f0a1-4a2a-bba5-8935756f19f5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.222207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 787/1584] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:25:47 2022] POST /identity/v3/users => generated 288 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:47.223186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa3ab0-1906-4cd7-9631-cd0c0b229c6c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.228739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c96639-f0a1-4a2a-bba5-8935756f19f5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.233959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8a0d6-931b-4c9b-899c-8306729272b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.234778 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8a0d6-931b-4c9b-899c-8306729272b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.234899 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa3ab0-1906-4cd7-9631-cd0c0b229c6c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.235193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8a0d6-931b-4c9b-899c-8306729272b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.235540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8a0d6-931b-4c9b-899c-8306729272b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.236462 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8a0d6-931b-4c9b-899c-8306729272b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.238159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8a0d6-931b-4c9b-899c-8306729272b3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.240161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21470ae-e0c1-4b61-aafc-129a94c41ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.241297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21470ae-e0c1-4b61-aafc-129a94c41ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.241990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21470ae-e0c1-4b61-aafc-129a94c41ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.242397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21470ae-e0c1-4b61-aafc-129a94c41ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.243307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21470ae-e0c1-4b61-aafc-129a94c41ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.245123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21470ae-e0c1-4b61-aafc-129a94c41ef9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.253052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 798/1585] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:47.254030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8a0d6-931b-4c9b-899c-8306729272b3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.265259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 788/1586] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:47.265259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21470ae-e0c1-4b61-aafc-129a94c41ef9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.267986 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8a0d6-931b-4c9b-899c-8306729272b3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.274839 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23411d7e-414d-48af-995a-2ce7834c1758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.275663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23411d7e-414d-48af-995a-2ce7834c1758 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.275960 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23411d7e-414d-48af-995a-2ce7834c1758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.276246 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23411d7e-414d-48af-995a-2ce7834c1758 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.276979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23411d7e-414d-48af-995a-2ce7834c1758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.278539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21470ae-e0c1-4b61-aafc-129a94c41ef9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.279030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23411d7e-414d-48af-995a-2ce7834c1758 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.284352 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd441a65-e6d7-44e6-a0c8-331993e8e0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.285560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd441a65-e6d7-44e6-a0c8-331993e8e0bf admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.285560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd441a65-e6d7-44e6-a0c8-331993e8e0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.285917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd441a65-e6d7-44e6-a0c8-331993e8e0bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.287097 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd441a65-e6d7-44e6-a0c8-331993e8e0bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.289224 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd441a65-e6d7-44e6-a0c8-331993e8e0bf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.304970 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 789/1587] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:47.306071 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd441a65-e6d7-44e6-a0c8-331993e8e0bf admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.308838 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 799/1588] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:25:47 2022] POST /identity/v3/users => generated 297 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:47.309990 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23411d7e-414d-48af-995a-2ce7834c1758 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.321724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd441a65-e6d7-44e6-a0c8-331993e8e0bf admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.324948 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23411d7e-414d-48af-995a-2ce7834c1758 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.328434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26409a2-0f30-4fe0-9f08-87d426b50b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.329535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26409a2-0f30-4fe0-9f08-87d426b50b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.329948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26409a2-0f30-4fe0-9f08-87d426b50b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.331568 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26409a2-0f30-4fe0-9f08-87d426b50b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.332180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb149562-6faa-4c9a-840f-5555dc9a002d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.332599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26409a2-0f30-4fe0-9f08-87d426b50b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.333390 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb149562-6faa-4c9a-840f-5555dc9a002d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.334341 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb149562-6faa-4c9a-840f-5555dc9a002d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.334813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb149562-6faa-4c9a-840f-5555dc9a002d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.335289 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26409a2-0f30-4fe0-9f08-87d426b50b15 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.335907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb149562-6faa-4c9a-840f-5555dc9a002d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.337943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb149562-6faa-4c9a-840f-5555dc9a002d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.351854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 790/1589] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:47.351854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26409a2-0f30-4fe0-9f08-87d426b50b15 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.356355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 800/1590] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:47.357507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb149562-6faa-4c9a-840f-5555dc9a002d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.365712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26409a2-0f30-4fe0-9f08-87d426b50b15 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.371651 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf458e4a-7260-4958-bde4-a5d92300e73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.372605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf458e4a-7260-4958-bde4-a5d92300e73b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.372895 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf458e4a-7260-4958-bde4-a5d92300e73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.373335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf458e4a-7260-4958-bde4-a5d92300e73b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.374087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf458e4a-7260-4958-bde4-a5d92300e73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.375826 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf458e4a-7260-4958-bde4-a5d92300e73b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.382169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb149562-6faa-4c9a-840f-5555dc9a002d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.387692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adcae3-0e20-49c8-ae9b-434bcd155a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.388394 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adcae3-0e20-49c8-ae9b-434bcd155a5b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.388683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adcae3-0e20-49c8-ae9b-434bcd155a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.388960 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adcae3-0e20-49c8-ae9b-434bcd155a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.390534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 791/1591] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:47.391437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf458e4a-7260-4958-bde4-a5d92300e73b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.394694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adcae3-0e20-49c8-ae9b-434bcd155a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.395710 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adcae3-0e20-49c8-ae9b-434bcd155a5b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.403079 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf458e4a-7260-4958-bde4-a5d92300e73b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.408581 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cc18f-2441-4593-9b6b-4194eb870ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.408891 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 801/1592] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:47.409273 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cc18f-2441-4593-9b6b-4194eb870ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.409560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cc18f-2441-4593-9b6b-4194eb870ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.409838 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adcae3-0e20-49c8-ae9b-434bcd155a5b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.409947 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cc18f-2441-4593-9b6b-4194eb870ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.410627 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cc18f-2441-4593-9b6b-4194eb870ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.412349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cc18f-2441-4593-9b6b-4194eb870ba6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.422940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adcae3-0e20-49c8-ae9b-434bcd155a5b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.428361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e24d52-e649-4871-b4cb-b99d5370acc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.428789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e24d52-e649-4871-b4cb-b99d5370acc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.429078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e24d52-e649-4871-b4cb-b99d5370acc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.433237 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e24d52-e649-4871-b4cb-b99d5370acc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.433406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 792/1593] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:47.433509 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e24d52-e649-4871-b4cb-b99d5370acc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.433594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cc18f-2441-4593-9b6b-4194eb870ba6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.433681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e24d52-e649-4871-b4cb-b99d5370acc5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.446262 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cc18f-2441-4593-9b6b-4194eb870ba6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.449234 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 802/1594] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:47.450194 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e24d52-e649-4871-b4cb-b99d5370acc5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.451639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f07f6-2862-44e5-b364-468dea42bc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.452530 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f07f6-2862-44e5-b364-468dea42bc66 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.452973 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f07f6-2862-44e5-b364-468dea42bc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.453403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f07f6-2862-44e5-b364-468dea42bc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.455049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f07f6-2862-44e5-b364-468dea42bc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.456738 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f07f6-2862-44e5-b364-468dea42bc66 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.470535 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e24d52-e649-4871-b4cb-b99d5370acc5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.476975 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab9e1d-9bc0-45ff-8950-11edef34c4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.478373 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9e1d-9bc0-45ff-8950-11edef34c4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.478953 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9e1d-9bc0-45ff-8950-11edef34c4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.479450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9e1d-9bc0-45ff-8950-11edef34c4c9 admin admin] PATH_INFO: `/v3/projects/8ed24158017d441e98bdf7e57e1cb153/users/202e415e386e4abe8c70a9889448eb02/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.481967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 793/1595] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:47.483755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f07f6-2862-44e5-b364-468dea42bc66 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.499066 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f07f6-2862-44e5-b364-468dea42bc66 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.499536 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab9e1d-9bc0-45ff-8950-11edef34c4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed24158017d441e98bdf7e57e1cb153, user_id=202e415e386e4abe8c70a9889448eb02, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.502477 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab9e1d-9bc0-45ff-8950-11edef34c4c9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.504665 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41e623-9d85-4863-b605-c08c4f3778d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.505694 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41e623-9d85-4863-b605-c08c4f3778d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.506047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41e623-9d85-4863-b605-c08c4f3778d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.506362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41e623-9d85-4863-b605-c08c4f3778d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.507164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41e623-9d85-4863-b605-c08c4f3778d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.510127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41e623-9d85-4863-b605-c08c4f3778d9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.522844 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 794/1596] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:47.523745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41e623-9d85-4863-b605-c08c4f3778d9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.534065 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41e623-9d85-4863-b605-c08c4f3778d9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.536178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 803/1597] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:25:47 2022] PUT /identity/v3/projects/8ed24158017d441e98bdf7e57e1cb153/users/202e415e386e4abe8c70a9889448eb02/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:47.537259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab9e1d-9bc0-45ff-8950-11edef34c4c9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.602954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:47.615497 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45579875-4b36-4945-826c-697b2763d54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.616643 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45579875-4b36-4945-826c-697b2763d54e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.617103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45579875-4b36-4945-826c-697b2763d54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.618420 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45579875-4b36-4945-826c-697b2763d54e admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.619528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45579875-4b36-4945-826c-697b2763d54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.621853 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45579875-4b36-4945-826c-697b2763d54e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.634822 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 795/1598] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:47.635989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45579875-4b36-4945-826c-697b2763d54e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.645443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab9e1d-9bc0-45ff-8950-11edef34c4c9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.647756 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45579875-4b36-4945-826c-697b2763d54e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.653375 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86033fd4-3f1a-4648-bd17-f582c868aaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.653936 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a1391-2107-4d7e-a040-86ba11b4fb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.654339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86033fd4-3f1a-4648-bd17-f582c868aaf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.654628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86033fd4-3f1a-4648-bd17-f582c868aaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.654900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a1391-2107-4d7e-a040-86ba11b4fb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.655010 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86033fd4-3f1a-4648-bd17-f582c868aaf3 admin admin] PATH_INFO: `/v3/projects/5eecbecf72da407fa30e3035276ece75/users/0b9e52d16695470dbbf42a45dae4271b/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.655184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a1391-2107-4d7e-a040-86ba11b4fb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.655483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a1391-2107-4d7e-a040-86ba11b4fb56 admin admin] PATH_INFO: `/v3/projects/f474c5b80f6e4163abf3c6c2a2c26745/users/ca300908c9e148748c7b341b46c03c74/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.674461 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a1391-2107-4d7e-a040-86ba11b4fb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f474c5b80f6e4163abf3c6c2a2c26745, user_id=ca300908c9e148748c7b341b46c03c74, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.677330 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a1391-2107-4d7e-a040-86ba11b4fb56 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.680119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86033fd4-3f1a-4648-bd17-f582c868aaf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eecbecf72da407fa30e3035276ece75, user_id=0b9e52d16695470dbbf42a45dae4271b, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.681844 dv-cinder-847798-1-smb devstack@keystone.service[80193]: WARNING py.warnings [None req-86033fd4-3f1a-4648-bd17-f582c868aaf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:25:47.681844 dv-cinder-847798-1-smb devstack@keystone.service[80193]: warnings.warn(msg) Jun 27 15:25:47.681844 dv-cinder-847798-1-smb devstack@keystone.service[80193]: Jun 27 15:25:47.684478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86033fd4-3f1a-4648-bd17-f582c868aaf3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.696192 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 804/1599] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:25:47 2022] PUT /identity/v3/projects/f474c5b80f6e4163abf3c6c2a2c26745/users/ca300908c9e148748c7b341b46c03c74/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:47.703761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a1391-2107-4d7e-a040-86ba11b4fb56 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.709952 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 796/1600] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:25:47 2022] PUT /identity/v3/projects/5eecbecf72da407fa30e3035276ece75/users/0b9e52d16695470dbbf42a45dae4271b/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:47.712628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86033fd4-3f1a-4648-bd17-f582c868aaf3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.793803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:47.824412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a1391-2107-4d7e-a040-86ba11b4fb56 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.830874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86033fd4-3f1a-4648-bd17-f582c868aaf3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.832264 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca4e54-0f17-4d22-99ea-c55cf58bc58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.833613 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca4e54-0f17-4d22-99ea-c55cf58bc58a admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.834006 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca4e54-0f17-4d22-99ea-c55cf58bc58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.834524 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca4e54-0f17-4d22-99ea-c55cf58bc58a admin admin] PATH_INFO: `/v3/projects/9fd02570608d4ec2b2c92250c1f6fec7/users/d7a8e240ca0d47ddba401b4e90a7d817/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.837497 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722c30c-5873-4959-bcf5-331e9926b8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.838679 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722c30c-5873-4959-bcf5-331e9926b8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.838995 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722c30c-5873-4959-bcf5-331e9926b8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.839334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722c30c-5873-4959-bcf5-331e9926b8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.840058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722c30c-5873-4959-bcf5-331e9926b8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.843222 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722c30c-5873-4959-bcf5-331e9926b8e7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.858438 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca4e54-0f17-4d22-99ea-c55cf58bc58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd02570608d4ec2b2c92250c1f6fec7, user_id=d7a8e240ca0d47ddba401b4e90a7d817, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.858909 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 797/1601] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:47.859887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722c30c-5873-4959-bcf5-331e9926b8e7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:47.863085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca4e54-0f17-4d22-99ea-c55cf58bc58a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.871810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722c30c-5873-4959-bcf5-331e9926b8e7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:47.880128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66660bd4-894e-4543-83f0-c178e8a57253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:47.881484 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66660bd4-894e-4543-83f0-c178e8a57253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.881774 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66660bd4-894e-4543-83f0-c178e8a57253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.882054 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66660bd4-894e-4543-83f0-c178e8a57253 admin admin] PATH_INFO: `/v3/projects/93771456326f40b392908c1b5f2934c4/users/cda453e1b19a4809b3a97147d74d2cac/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.882522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 805/1602] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:25:47 2022] PUT /identity/v3/projects/9fd02570608d4ec2b2c92250c1f6fec7/users/d7a8e240ca0d47ddba401b4e90a7d817/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:47.883878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f97bb-bc1c-4f40-a7f9-67c2d4058d01 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:47.884170 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f97bb-bc1c-4f40-a7f9-67c2d4058d01 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:47.884461 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f97bb-bc1c-4f40-a7f9-67c2d4058d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:47.910803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-801f97bb-bc1c-4f40-a7f9-67c2d4058d01 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:47.912561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-801f97bb-bc1c-4f40-a7f9-67c2d4058d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:47.916660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66660bd4-894e-4543-83f0-c178e8a57253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93771456326f40b392908c1b5f2934c4, user_id=cda453e1b19a4809b3a97147d74d2cac, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:47.922049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66660bd4-894e-4543-83f0-c178e8a57253 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:47.940733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 798/1603] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:25:47 2022] PUT /identity/v3/projects/93771456326f40b392908c1b5f2934c4/users/cda453e1b19a4809b3a97147d74d2cac/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:47.941677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66660bd4-894e-4543-83f0-c178e8a57253 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:48.003829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 806/1604] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:48.005319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e1f88-de5d-478e-8a12-e600caa352d1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:48.005691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e1f88-de5d-478e-8a12-e600caa352d1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:48.006187 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e1f88-de5d-478e-8a12-e600caa352d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:48.019825 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66660bd4-894e-4543-83f0-c178e8a57253 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:48.025195 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002e9aa-a915-42e1-a568-f646c0d04be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:48.026301 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002e9aa-a915-42e1-a568-f646c0d04be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:48.026830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002e9aa-a915-42e1-a568-f646c0d04be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:48.027182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002e9aa-a915-42e1-a568-f646c0d04be0 admin admin] PATH_INFO: `/v3/projects/54ff223e3ce3434d85ee5215f102cc9e/users/38077d8c653b4752814a0c200eb2a713/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:48.041034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bf9e1f88-de5d-478e-8a12-e600caa352d1 None None] MFA Rules not processed for user `ca300908c9e148748c7b341b46c03c74`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:48.043614 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bf9e1f88-de5d-478e-8a12-e600caa352d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:48.045259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002e9aa-a915-42e1-a568-f646c0d04be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ff223e3ce3434d85ee5215f102cc9e, user_id=38077d8c653b4752814a0c200eb2a713, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:48.048529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002e9aa-a915-42e1-a568-f646c0d04be0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:48.153368 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 799/1605] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:25:47 2022] PUT /identity/v3/projects/54ff223e3ce3434d85ee5215f102cc9e/users/38077d8c653b4752814a0c200eb2a713/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:48.153368 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1745e5f-1cc6-48e7-8eef-93941c2b557d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:48.153368 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1745e5f-1cc6-48e7-8eef-93941c2b557d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:48.153368 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1745e5f-1cc6-48e7-8eef-93941c2b557d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:48.153368 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c1745e5f-1cc6-48e7-8eef-93941c2b557d None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:48.154197 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c1745e5f-1cc6-48e7-8eef-93941c2b557d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:48.154197 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:48.214395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 807/1606] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:48.215534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e1f88-de5d-478e-8a12-e600caa352d1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:48.231736 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e1f88-de5d-478e-8a12-e600caa352d1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:48.234010 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 800/1607] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:48.239088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903f70c-bb11-49fb-a481-fb1f9bc30080 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:48.239544 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903f70c-bb11-49fb-a481-fb1f9bc30080 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:48.239952 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903f70c-bb11-49fb-a481-fb1f9bc30080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:48.244443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9952a9-f197-4af0-9b03-3271775fc1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:48.246512 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9952a9-f197-4af0-9b03-3271775fc1fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:48.253533 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9952a9-f197-4af0-9b03-3271775fc1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:48.254184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9952a9-f197-4af0-9b03-3271775fc1fa admin admin] PATH_INFO: `/v3/projects/80bd590dbd764fbf95e6403700207933/users/c5ebe5c2142f49ab8f2455bf1ae952d5/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:48.279604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9952a9-f197-4af0-9b03-3271775fc1fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=80bd590dbd764fbf95e6403700207933, user_id=c5ebe5c2142f49ab8f2455bf1ae952d5, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:48.283174 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9952a9-f197-4af0-9b03-3271775fc1fa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:48.284091 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4903f70c-bb11-49fb-a481-fb1f9bc30080 None None] MFA Rules not processed for user `d7a8e240ca0d47ddba401b4e90a7d817`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:48.285426 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4903f70c-bb11-49fb-a481-fb1f9bc30080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:48.310067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 808/1608] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:25:48 2022] PUT /identity/v3/projects/80bd590dbd764fbf95e6403700207933/users/c5ebe5c2142f49ab8f2455bf1ae952d5/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:48.310067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b212cc1-1135-4c6b-96ee-a71b4ecdfa4b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:48.310067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b212cc1-1135-4c6b-96ee-a71b4ecdfa4b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:48.310067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b212cc1-1135-4c6b-96ee-a71b4ecdfa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:48.347959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9b212cc1-1135-4c6b-96ee-a71b4ecdfa4b None None] MFA Rules not processed for user `cda453e1b19a4809b3a97147d74d2cac`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:48.349216 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9b212cc1-1135-4c6b-96ee-a71b4ecdfa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:48.375582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:48.401552 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 801/1609] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:48.402813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903f70c-bb11-49fb-a481-fb1f9bc30080 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:48.406650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4903f70c-bb11-49fb-a481-fb1f9bc30080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:48.498262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 809/1610] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:48.502111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38a860-dca8-445c-bd05-7eef18570c29 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:48.502381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38a860-dca8-445c-bd05-7eef18570c29 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:48.502642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38a860-dca8-445c-bd05-7eef18570c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:48.535262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ac38a860-dca8-445c-bd05-7eef18570c29 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:48.536507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ac38a860-dca8-445c-bd05-7eef18570c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:48.565814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903f70c-bb11-49fb-a481-fb1f9bc30080 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:48.635329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 810/1611] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:48.635329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38a860-dca8-445c-bd05-7eef18570c29 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:48.657446 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38a860-dca8-445c-bd05-7eef18570c29 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:48.666174 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809f59b-1347-4513-8fce-0d4c42bce930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:48.667044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809f59b-1347-4513-8fce-0d4c42bce930 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:48.667402 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809f59b-1347-4513-8fce-0d4c42bce930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:48.668714 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809f59b-1347-4513-8fce-0d4c42bce930 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:48.670649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809f59b-1347-4513-8fce-0d4c42bce930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:48.673230 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809f59b-1347-4513-8fce-0d4c42bce930 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:48.674301 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ddbe1-b800-49e5-8f61-82ead2bbca47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:48.676450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ddbe1-b800-49e5-8f61-82ead2bbca47 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:48.676450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ddbe1-b800-49e5-8f61-82ead2bbca47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:48.676450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ddbe1-b800-49e5-8f61-82ead2bbca47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:48.693027 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ddbe1-b800-49e5-8f61-82ead2bbca47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:48.694778 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ddbe1-b800-49e5-8f61-82ead2bbca47 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:48.716839 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 802/1612] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:25:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:25:48.718985 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ddbe1-b800-49e5-8f61-82ead2bbca47 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:48.719772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 811/1613] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:25:48 2022] POST /identity/v3/projects => generated 363 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:48.721811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d758af9-7a04-481f-9d95-f3db7d147442 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:48.722110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d758af9-7a04-481f-9d95-f3db7d147442 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:48.722424 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d758af9-7a04-481f-9d95-f3db7d147442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:48.738279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ddbe1-b800-49e5-8f61-82ead2bbca47 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:48.753475 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:48.761094 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5d758af9-7a04-481f-9d95-f3db7d147442 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:48.762395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5d758af9-7a04-481f-9d95-f3db7d147442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:48.836361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76c8b4-608a-4910-9f48-c1ad5da95916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:48.837048 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76c8b4-608a-4910-9f48-c1ad5da95916 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:48.837542 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76c8b4-608a-4910-9f48-c1ad5da95916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:48.837824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76c8b4-608a-4910-9f48-c1ad5da95916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:48.864891 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 812/1614] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:48.868021 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153afd6-6b7a-4e64-ab6a-5dee0df5a967 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:48.868355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153afd6-6b7a-4e64-ab6a-5dee0df5a967 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:48.868666 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153afd6-6b7a-4e64-ab6a-5dee0df5a967 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:48.870545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 813/1615] 10.222.0.33 () {54 vars in 961 bytes} [Mon Jun 27 15:25:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:25:48.871593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153afd6-6b7a-4e64-ab6a-5dee0df5a967 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:48.894961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153afd6-6b7a-4e64-ab6a-5dee0df5a967 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:48.906316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b0172-c813-41cf-bcc3-a60c74743bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:48.907311 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b0172-c813-41cf-bcc3-a60c74743bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:48.907947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b0172-c813-41cf-bcc3-a60c74743bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:48.908398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b0172-c813-41cf-bcc3-a60c74743bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:48.913629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b0172-c813-41cf-bcc3-a60c74743bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:48.916198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b0172-c813-41cf-bcc3-a60c74743bf5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:48.956333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76c8b4-608a-4910-9f48-c1ad5da95916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:48.961866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76c8b4-608a-4910-9f48-c1ad5da95916 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:48.975779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 814/1616] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:25:48 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:48.975779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b0172-c813-41cf-bcc3-a60c74743bf5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:48.976100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 803/1617] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:25:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:25:48.976100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76c8b4-608a-4910-9f48-c1ad5da95916 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:48.987377 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76c8b4-608a-4910-9f48-c1ad5da95916 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:49.021214 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:49.089348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49930a79-cdeb-4bf4-9cf1-d5d97b656b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:49.090644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49930a79-cdeb-4bf4-9cf1-d5d97b656b83 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:49.090809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49930a79-cdeb-4bf4-9cf1-d5d97b656b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:49.091544 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49930a79-cdeb-4bf4-9cf1-d5d97b656b83 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:49.092459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49930a79-cdeb-4bf4-9cf1-d5d97b656b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:49.095443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49930a79-cdeb-4bf4-9cf1-d5d97b656b83 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:49.097682 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b0172-c813-41cf-bcc3-a60c74743bf5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:49.116156 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56959c9a-a4cd-4948-8bc6-4f6d9ccff1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:49.117152 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56959c9a-a4cd-4948-8bc6-4f6d9ccff1fc service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:49.118874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56959c9a-a4cd-4948-8bc6-4f6d9ccff1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:49.119491 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56959c9a-a4cd-4948-8bc6-4f6d9ccff1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:49.132560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 804/1618] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:25:48 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:49.134987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca80bb3-e2ba-4947-89b2-fb0c2a17f7a9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:49.135407 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca80bb3-e2ba-4947-89b2-fb0c2a17f7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:49.135831 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca80bb3-e2ba-4947-89b2-fb0c2a17f7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:49.142788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56959c9a-a4cd-4948-8bc6-4f6d9ccff1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:49.148163 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56959c9a-a4cd-4948-8bc6-4f6d9ccff1fc service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:49.160707 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1ca80bb3-e2ba-4947-89b2-fb0c2a17f7a9 None None] MFA Rules not processed for user `37a36c30e9dc472d97d762d236dd865a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:49.163067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1ca80bb3-e2ba-4947-89b2-fb0c2a17f7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:49.165991 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 815/1619] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:25:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:25:49.168448 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56959c9a-a4cd-4948-8bc6-4f6d9ccff1fc service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:49.181182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56959c9a-a4cd-4948-8bc6-4f6d9ccff1fc service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:49.187499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f0b24-bcb0-4a50-9ae8-822d5864f6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:49.188476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f0b24-bcb0-4a50-9ae8-822d5864f6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:49.188935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f0b24-bcb0-4a50-9ae8-822d5864f6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:49.189384 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f0b24-bcb0-4a50-9ae8-822d5864f6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:49.201399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f0b24-bcb0-4a50-9ae8-822d5864f6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:49.203756 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f0b24-bcb0-4a50-9ae8-822d5864f6c0 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:49.218001 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 816/1620] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:25:49.219166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f0b24-bcb0-4a50-9ae8-822d5864f6c0 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:49.223106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:49.234596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f0b24-bcb0-4a50-9ae8-822d5864f6c0 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:49.255265 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bff34-18f0-4154-ab7b-473e02a592b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:49.256413 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bff34-18f0-4154-ab7b-473e02a592b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:49.257043 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bff34-18f0-4154-ab7b-473e02a592b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:49.257337 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bff34-18f0-4154-ab7b-473e02a592b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:49.259054 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bff34-18f0-4154-ab7b-473e02a592b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:49.261124 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bff34-18f0-4154-ab7b-473e02a592b4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:49.262089 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 805/1621] 10.222.0.33 () {58 vars in 1058 bytes} [Mon Jun 27 15:25:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:49.263350 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca80bb3-e2ba-4947-89b2-fb0c2a17f7a9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:49.276386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca80bb3-e2ba-4947-89b2-fb0c2a17f7a9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:49.283202 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34188235-7acf-4c40-8477-449239983f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:49.284855 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34188235-7acf-4c40-8477-449239983f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:49.286034 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34188235-7acf-4c40-8477-449239983f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:49.286623 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34188235-7acf-4c40-8477-449239983f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:49.288393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34188235-7acf-4c40-8477-449239983f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:49.290597 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34188235-7acf-4c40-8477-449239983f97 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:49.299832 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 817/1622] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:25:49 2022] POST /identity/v3/users => generated 292 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:25:49.302988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bff34-18f0-4154-ab7b-473e02a592b4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:49.312032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 806/1623] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:49.313190 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34188235-7acf-4c40-8477-449239983f97 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:49.339576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bff34-18f0-4154-ab7b-473e02a592b4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:49.341408 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34188235-7acf-4c40-8477-449239983f97 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:49.361335 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cacf8-0d24-42bc-b1ce-c9ddc449a3a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:49.361799 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5d8a1-6a72-43ed-b8ce-ce0e961e47c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:49.364588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5d8a1-6a72-43ed-b8ce-ce0e961e47c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:49.366914 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5d8a1-6a72-43ed-b8ce-ce0e961e47c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:49.367433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cacf8-0d24-42bc-b1ce-c9ddc449a3a0 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:49.368811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5d8a1-6a72-43ed-b8ce-ce0e961e47c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:49.369286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cacf8-0d24-42bc-b1ce-c9ddc449a3a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:49.369982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cacf8-0d24-42bc-b1ce-c9ddc449a3a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:49.373172 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5d8a1-6a72-43ed-b8ce-ce0e961e47c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:49.380450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5d8a1-6a72-43ed-b8ce-ce0e961e47c8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:49.434507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 807/1624] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:49.436465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5d8a1-6a72-43ed-b8ce-ce0e961e47c8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:49.485216 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5d8a1-6a72-43ed-b8ce-ce0e961e47c8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:49.503406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240f456-b6ac-4932-9cd4-b5c728fe6956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:49.507757 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240f456-b6ac-4932-9cd4-b5c728fe6956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:49.510595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240f456-b6ac-4932-9cd4-b5c728fe6956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:49.511652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240f456-b6ac-4932-9cd4-b5c728fe6956 admin admin] PATH_INFO: `/v3/projects/cf2fcd3084c748cc89159140769972b8/users/6de2e935bb7c470380381e1f0141ba3b/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:49.584550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240f456-b6ac-4932-9cd4-b5c728fe6956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2fcd3084c748cc89159140769972b8, user_id=6de2e935bb7c470380381e1f0141ba3b, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:49.599182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240f456-b6ac-4932-9cd4-b5c728fe6956 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:49.614761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023cacf8-0d24-42bc-b1ce-c9ddc449a3a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:49.617220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023cacf8-0d24-42bc-b1ce-c9ddc449a3a0 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:49.630537 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 818/1625] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:25:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:25:49.631904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cacf8-0d24-42bc-b1ce-c9ddc449a3a0 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:49.643338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cacf8-0d24-42bc-b1ce-c9ddc449a3a0 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:49.644327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 808/1626] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:25:49 2022] PUT /identity/v3/projects/cf2fcd3084c748cc89159140769972b8/users/6de2e935bb7c470380381e1f0141ba3b/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:49.651494 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240f456-b6ac-4932-9cd4-b5c728fe6956 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:49.765999 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b45cfa-09f8-4f3b-8e46-0c7cb8c90503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:49.766970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b45cfa-09f8-4f3b-8e46-0c7cb8c90503 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:49.767347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b45cfa-09f8-4f3b-8e46-0c7cb8c90503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:49.768411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b45cfa-09f8-4f3b-8e46-0c7cb8c90503 admin admin] PATH_INFO: `/v3/projects/6e536cf538fd4decb6889b8ee4a0c9a4/users/3a913159d0e143859a7567540b5ec356/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:49.805107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b45cfa-09f8-4f3b-8e46-0c7cb8c90503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e536cf538fd4decb6889b8ee4a0c9a4, user_id=3a913159d0e143859a7567540b5ec356, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:49.808117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b45cfa-09f8-4f3b-8e46-0c7cb8c90503 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:49.840287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 819/1627] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:25:49 2022] PUT /identity/v3/projects/6e536cf538fd4decb6889b8ee4a0c9a4/users/3a913159d0e143859a7567540b5ec356/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:49.844951 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b45cfa-09f8-4f3b-8e46-0c7cb8c90503 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:49.852492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240f456-b6ac-4932-9cd4-b5c728fe6956 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:49.875415 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:50.001114 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b45cfa-09f8-4f3b-8e46-0c7cb8c90503 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:50.011491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf18e3-379b-4a5d-8a1d-f1acd6db325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:50.011897 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf18e3-379b-4a5d-8a1d-f1acd6db325f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:50.012184 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf18e3-379b-4a5d-8a1d-f1acd6db325f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:50.012464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf18e3-379b-4a5d-8a1d-f1acd6db325f admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:50.013209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf18e3-379b-4a5d-8a1d-f1acd6db325f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:50.015067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf18e3-379b-4a5d-8a1d-f1acd6db325f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:50.040178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7900e-2d35-46bc-ae45-ece40e189a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:50.040834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7900e-2d35-46bc-ae45-ece40e189a73 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:50.041132 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7900e-2d35-46bc-ae45-ece40e189a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:50.041411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7900e-2d35-46bc-ae45-ece40e189a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:50.049738 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 809/1628] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:25:50.050508 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf18e3-379b-4a5d-8a1d-f1acd6db325f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:50.052914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7900e-2d35-46bc-ae45-ece40e189a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:50.070486 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7900e-2d35-46bc-ae45-ece40e189a73 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:50.075450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf18e3-379b-4a5d-8a1d-f1acd6db325f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:50.091150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af4a54-6889-456e-8eba-717abcb4a51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:50.092654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af4a54-6889-456e-8eba-717abcb4a51b admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:50.093020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af4a54-6889-456e-8eba-717abcb4a51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:50.093346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af4a54-6889-456e-8eba-717abcb4a51b admin admin] PATH_INFO: `/v3/projects/cf2fcd3084c748cc89159140769972b8/users/6de2e935bb7c470380381e1f0141ba3b/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:50.098412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af4a54-6889-456e-8eba-717abcb4a51b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2fcd3084c748cc89159140769972b8, user_id=6de2e935bb7c470380381e1f0141ba3b, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:50.111989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af4a54-6889-456e-8eba-717abcb4a51b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:50.142623 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 820/1629] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:25:50.145613 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7900e-2d35-46bc-ae45-ece40e189a73 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:50.164680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 810/1630] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:25:50 2022] PUT /identity/v3/projects/cf2fcd3084c748cc89159140769972b8/users/6de2e935bb7c470380381e1f0141ba3b/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:50.189946 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d41a4-3543-49b7-9c25-1dde825bc703 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:50.190486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d41a4-3543-49b7-9c25-1dde825bc703 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:50.190910 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d41a4-3543-49b7-9c25-1dde825bc703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:50.194446 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7900e-2d35-46bc-ae45-ece40e189a73 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:50.258389 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-874d41a4-3543-49b7-9c25-1dde825bc703 None None] MFA Rules not processed for user `6de2e935bb7c470380381e1f0141ba3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:50.259930 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-874d41a4-3543-49b7-9c25-1dde825bc703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:50.297050 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:50.422990 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749c9d7-e406-45dc-90f0-d370f3271998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:50.438551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749c9d7-e406-45dc-90f0-d370f3271998 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:50.439168 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749c9d7-e406-45dc-90f0-d370f3271998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:50.441156 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749c9d7-e406-45dc-90f0-d370f3271998 admin admin] PATH_INFO: `/v3/projects/6e536cf538fd4decb6889b8ee4a0c9a4/users/3a913159d0e143859a7567540b5ec356/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:50.446396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749c9d7-e406-45dc-90f0-d370f3271998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e536cf538fd4decb6889b8ee4a0c9a4, user_id=3a913159d0e143859a7567540b5ec356, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:50.449499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749c9d7-e406-45dc-90f0-d370f3271998 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:50.464992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 811/1631] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:50 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:25:50.467805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0586ee-3b9f-4a53-a297-041945685c9a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:50.468381 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0586ee-3b9f-4a53-a297-041945685c9a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:50.469088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0586ee-3b9f-4a53-a297-041945685c9a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:50.480877 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 812/1632] 10.222.0.33 () {54 vars in 912 bytes} [Mon Jun 27 15:25:50 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:25:50.482055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 821/1633] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:25:50 2022] PUT /identity/v3/projects/6e536cf538fd4decb6889b8ee4a0c9a4/users/3a913159d0e143859a7567540b5ec356/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:50.483170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0586ee-3b9f-4a53-a297-041945685c9a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:50.486208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8c76e-e70c-422c-a84e-a685bc71e92a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:50.486846 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8c76e-e70c-422c-a84e-a685bc71e92a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:50.488365 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8c76e-e70c-422c-a84e-a685bc71e92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:50.531884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e6b8c76e-e70c-422c-a84e-a685bc71e92a None None] MFA Rules not processed for user `37a36c30e9dc472d97d762d236dd865a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:50.533939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e6b8c76e-e70c-422c-a84e-a685bc71e92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:50.605101 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0586ee-3b9f-4a53-a297-041945685c9a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:50.609797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76df3ac-8084-4787-9cce-1580dba96022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:50.610947 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df3ac-8084-4787-9cce-1580dba96022 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:50.611335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df3ac-8084-4787-9cce-1580dba96022 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:50.613021 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df3ac-8084-4787-9cce-1580dba96022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:50.623816 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 822/1634] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 27 15:25:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:50.625525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852719f-f898-47ce-8c70-0f1514fbb950 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:50.626038 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852719f-f898-47ce-8c70-0f1514fbb950 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:50.626564 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852719f-f898-47ce-8c70-0f1514fbb950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:50.676950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6852719f-f898-47ce-8c70-0f1514fbb950 None None] MFA Rules not processed for user `3a913159d0e143859a7567540b5ec356`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:50.678780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6852719f-f898-47ce-8c70-0f1514fbb950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:50.707116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76df3ac-8084-4787-9cce-1580dba96022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:50.709171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76df3ac-8084-4787-9cce-1580dba96022 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:50.715354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:50.734476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 813/1635] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:25:50 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:25:50.737134 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76df3ac-8084-4787-9cce-1580dba96022 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:50.759678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76df3ac-8084-4787-9cce-1580dba96022 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:50.770066 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639613fb-24b3-4cdf-a94f-9aa0652e7e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:50.772322 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639613fb-24b3-4cdf-a94f-9aa0652e7e2a service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:50.773958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639613fb-24b3-4cdf-a94f-9aa0652e7e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:50.774304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639613fb-24b3-4cdf-a94f-9aa0652e7e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:50.783362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 823/1636] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:50 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:50.803683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639613fb-24b3-4cdf-a94f-9aa0652e7e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:50.807040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639613fb-24b3-4cdf-a94f-9aa0652e7e2a service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:50.839159 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 814/1637] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:25:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:25:50.873413 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852719f-f898-47ce-8c70-0f1514fbb950 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:50.891503 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852719f-f898-47ce-8c70-0f1514fbb950 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:50.899365 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69d7c5-e370-4d53-8b53-6385436e73e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:50.900574 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69d7c5-e370-4d53-8b53-6385436e73e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:50.901120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69d7c5-e370-4d53-8b53-6385436e73e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:50.902564 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69d7c5-e370-4d53-8b53-6385436e73e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:50.932814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69d7c5-e370-4d53-8b53-6385436e73e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:50.934694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69d7c5-e370-4d53-8b53-6385436e73e2 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:50.961867 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 824/1638] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:25:50 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:25:52.304771 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639613fb-24b3-4cdf-a94f-9aa0652e7e2a service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:52.322426 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69d7c5-e370-4d53-8b53-6385436e73e2 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:52.435588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:52.477987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639613fb-24b3-4cdf-a94f-9aa0652e7e2a service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:52.478995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69d7c5-e370-4d53-8b53-6385436e73e2 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:52.489571 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e47be-cc1b-44ab-87cc-5822396c4eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:52.490872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10206e5-e595-4b28-b064-df00e430fa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:52.492006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10206e5-e595-4b28-b064-df00e430fa7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:52.492302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10206e5-e595-4b28-b064-df00e430fa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:52.492585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10206e5-e595-4b28-b064-df00e430fa7d admin admin] PATH_INFO: `/v3/users/cda453e1b19a4809b3a97147d74d2cac` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:52.492880 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e47be-cc1b-44ab-87cc-5822396c4eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:52.493191 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e47be-cc1b-44ab-87cc-5822396c4eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:52.493514 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e47be-cc1b-44ab-87cc-5822396c4eef admin admin] PATH_INFO: `/v3/users/ca300908c9e148748c7b341b46c03c74` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:52.496477 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e47be-cc1b-44ab-87cc-5822396c4eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca300908c9e148748c7b341b46c03c74)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:52.498275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10206e5-e595-4b28-b064-df00e430fa7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda453e1b19a4809b3a97147d74d2cac)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:52.499600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: WARNING py.warnings [None req-b10206e5-e595-4b28-b064-df00e430fa7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:25:52.499600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: warnings.warn(msg) Jun 27 15:25:52.499600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: Jun 27 15:25:52.501508 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10206e5-e595-4b28-b064-df00e430fa7d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:52.503274 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e47be-cc1b-44ab-87cc-5822396c4eef admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:52.646895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-134e47be-cc1b-44ab-87cc-5822396c4eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca300908c9e148748c7b341b46c03c74'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:52.667800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-134e47be-cc1b-44ab-87cc-5822396c4eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca300908c9e148748c7b341b46c03c74'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:52.670241 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b10206e5-e595-4b28-b064-df00e430fa7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda453e1b19a4809b3a97147d74d2cac'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:52.670553 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-134e47be-cc1b-44ab-87cc-5822396c4eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca300908c9e148748c7b341b46c03c74'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:52.672033 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-134e47be-cc1b-44ab-87cc-5822396c4eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca300908c9e148748c7b341b46c03c74'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:52.708328 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b10206e5-e595-4b28-b064-df00e430fa7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda453e1b19a4809b3a97147d74d2cac'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:52.713506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-134e47be-cc1b-44ab-87cc-5822396c4eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca300908c9e148748c7b341b46c03c74'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:52.730149 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b10206e5-e595-4b28-b064-df00e430fa7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda453e1b19a4809b3a97147d74d2cac'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:52.731170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b10206e5-e595-4b28-b064-df00e430fa7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda453e1b19a4809b3a97147d74d2cac'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:52.746328 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 825/1639] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:25:52 2022] DELETE /identity/v3/users/ca300908c9e148748c7b341b46c03c74 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:52.747933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36527abe-8c32-4507-b02a-02ec9d37fc24 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:52.748232 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36527abe-8c32-4507-b02a-02ec9d37fc24 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:52.748517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36527abe-8c32-4507-b02a-02ec9d37fc24 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:52.755536 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 826/1640] 10.222.0.33 () {54 vars in 961 bytes} [Mon Jun 27 15:25:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:25:52.756761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff6120-a80f-4d41-b240-57cc2a602a72 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:52.757204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff6120-a80f-4d41-b240-57cc2a602a72 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:52.757506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff6120-a80f-4d41-b240-57cc2a602a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:52.783944 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b10206e5-e595-4b28-b064-df00e430fa7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda453e1b19a4809b3a97147d74d2cac'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:52.808028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-48ff6120-a80f-4d41-b240-57cc2a602a72 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:52.808228 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 815/1641] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:25:52 2022] DELETE /identity/v3/users/cda453e1b19a4809b3a97147d74d2cac => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:52.808343 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-48ff6120-a80f-4d41-b240-57cc2a602a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:52.809504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9703c0-38a9-466c-90d1-5d9797de3f5a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:52.810400 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9703c0-38a9-466c-90d1-5d9797de3f5a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:52.810723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9703c0-38a9-466c-90d1-5d9797de3f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:52.846831 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:52.866101 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0a9703c0-38a9-466c-90d1-5d9797de3f5a None None] MFA Rules not processed for user `37a36c30e9dc472d97d762d236dd865a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:52.870535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0a9703c0-38a9-466c-90d1-5d9797de3f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:52.948906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 827/1642] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:52.950398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110f4a0-c273-4581-a857-9c4e888509fa None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:52.950787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110f4a0-c273-4581-a857-9c4e888509fa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:52.951134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110f4a0-c273-4581-a857-9c4e888509fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:52.978742 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7110f4a0-c273-4581-a857-9c4e888509fa None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:52.980250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7110f4a0-c273-4581-a857-9c4e888509fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:52.997846 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 828/1643] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:53.049622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 816/1644] 10.222.0.33 () {58 vars in 1058 bytes} [Mon Jun 27 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:53.057583 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bd84d-1e69-4d3f-8554-2be9fbb308fd None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:53.058196 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bd84d-1e69-4d3f-8554-2be9fbb308fd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:53.058714 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bd84d-1e69-4d3f-8554-2be9fbb308fd None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:53.062645 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 829/1645] 10.222.0.33 () {54 vars in 912 bytes} [Mon Jun 27 15:25:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:25:53.066357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bd84d-1e69-4d3f-8554-2be9fbb308fd None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:53.068626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e25bd84d-1e69-4d3f-8554-2be9fbb308fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:53.075053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9703c0-38a9-466c-90d1-5d9797de3f5a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:53.079966 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0a9703c0-38a9-466c-90d1-5d9797de3f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:53.243103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9703c0-38a9-466c-90d1-5d9797de3f5a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:53.247993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bd84d-1e69-4d3f-8554-2be9fbb308fd None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:53.253532 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd5cff-e62e-4e3b-983d-b618a8ee5c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:53.254386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd5cff-e62e-4e3b-983d-b618a8ee5c3c service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:53.254581 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd5cff-e62e-4e3b-983d-b618a8ee5c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:53.254810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd5cff-e62e-4e3b-983d-b618a8ee5c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:53.258345 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996e834-9ecc-47d4-b5a0-bc290f1f6565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:53.261950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996e834-9ecc-47d4-b5a0-bc290f1f6565 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:53.262314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996e834-9ecc-47d4-b5a0-bc290f1f6565 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:53.262726 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996e834-9ecc-47d4-b5a0-bc290f1f6565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:53.276756 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd5cff-e62e-4e3b-983d-b618a8ee5c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:53.279063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd5cff-e62e-4e3b-983d-b618a8ee5c3c service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:53.285732 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996e834-9ecc-47d4-b5a0-bc290f1f6565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:53.290680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:53.292522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996e834-9ecc-47d4-b5a0-bc290f1f6565 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:53.330088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 817/1646] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:25:53.330088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187727fc-9442-4a89-8031-04a4cef510da None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:53.330088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187727fc-9442-4a89-8031-04a4cef510da None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:53.330088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187727fc-9442-4a89-8031-04a4cef510da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:53.330934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 830/1647] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:25:53.419479 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-187727fc-9442-4a89-8031-04a4cef510da None None] MFA Rules not processed for user `37a36c30e9dc472d97d762d236dd865a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:53.420957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-187727fc-9442-4a89-8031-04a4cef510da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:53.435078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 818/1648] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 27 15:25:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:53.450780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996e834-9ecc-47d4-b5a0-bc290f1f6565 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:53.453356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d996e834-9ecc-47d4-b5a0-bc290f1f6565 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:53.538056 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996e834-9ecc-47d4-b5a0-bc290f1f6565 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:53.548659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05286c-fe87-430d-b0b4-a64d078c24db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:53.549558 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05286c-fe87-430d-b0b4-a64d078c24db service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:53.549855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05286c-fe87-430d-b0b4-a64d078c24db service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:53.550194 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05286c-fe87-430d-b0b4-a64d078c24db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:53.576507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05286c-fe87-430d-b0b4-a64d078c24db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:53.580089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05286c-fe87-430d-b0b4-a64d078c24db service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:53.615882 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 831/1649] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:25:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:25:55.666128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187727fc-9442-4a89-8031-04a4cef510da None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:55.668647 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-187727fc-9442-4a89-8031-04a4cef510da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:55.694684 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187727fc-9442-4a89-8031-04a4cef510da None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:55.715039 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598445bd-7717-47fd-bb31-e18f7b3a79cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:55.716378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598445bd-7717-47fd-bb31-e18f7b3a79cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:55.716827 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598445bd-7717-47fd-bb31-e18f7b3a79cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:55.717306 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598445bd-7717-47fd-bb31-e18f7b3a79cf admin admin] PATH_INFO: `/v3/projects/f474c5b80f6e4163abf3c6c2a2c26745` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:55.721795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598445bd-7717-47fd-bb31-e18f7b3a79cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f474c5b80f6e4163abf3c6c2a2c26745)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:55.724033 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598445bd-7717-47fd-bb31-e18f7b3a79cf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:55.841665 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-598445bd-7717-47fd-bb31-e18f7b3a79cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f474c5b80f6e4163abf3c6c2a2c26745', 'request_id': 'req-598445bd-7717-47fd-bb31-e18f7b3a79cf'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:55.861855 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-598445bd-7717-47fd-bb31-e18f7b3a79cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f474c5b80f6e4163abf3c6c2a2c26745', 'request_id': 'req-598445bd-7717-47fd-bb31-e18f7b3a79cf'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:55.874462 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05286c-fe87-430d-b0b4-a64d078c24db service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:55.876146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3b05286c-fe87-430d-b0b4-a64d078c24db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:55.877642 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-598445bd-7717-47fd-bb31-e18f7b3a79cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f474c5b80f6e4163abf3c6c2a2c26745', 'request_id': 'req-598445bd-7717-47fd-bb31-e18f7b3a79cf'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:55.896822 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-598445bd-7717-47fd-bb31-e18f7b3a79cf admin admin] The token cache is being invalidate because project f474c5b80f6e4163abf3c6c2a2c26745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:25:55.897349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-598445bd-7717-47fd-bb31-e18f7b3a79cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:55.898780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05286c-fe87-430d-b0b4-a64d078c24db service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:55.911829 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-598445bd-7717-47fd-bb31-e18f7b3a79cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:55.923213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 819/1650] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:25:55 2022] DELETE /identity/v3/projects/f474c5b80f6e4163abf3c6c2a2c26745 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:55.947028 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598445bd-7717-47fd-bb31-e18f7b3a79cf admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:55.951447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-598445bd-7717-47fd-bb31-e18f7b3a79cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:56.042044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacf01d-7065-4cf4-9f8f-7d93ab963594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:56.043004 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacf01d-7065-4cf4-9f8f-7d93ab963594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:56.043294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacf01d-7065-4cf4-9f8f-7d93ab963594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:56.043579 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacf01d-7065-4cf4-9f8f-7d93ab963594 admin admin] PATH_INFO: `/v3/projects/93771456326f40b392908c1b5f2934c4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:56.046761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacf01d-7065-4cf4-9f8f-7d93ab963594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93771456326f40b392908c1b5f2934c4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:56.048681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: WARNING py.warnings [None req-1eacf01d-7065-4cf4-9f8f-7d93ab963594 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:25:56.048681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: warnings.warn(msg) Jun 27 15:25:56.048681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: Jun 27 15:25:56.050252 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacf01d-7065-4cf4-9f8f-7d93ab963594 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:56.063893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:56.100097 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598445bd-7717-47fd-bb31-e18f7b3a79cf admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:56.106989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e353d4-0413-49a5-9589-3a4d4df8fbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:56.108003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e353d4-0413-49a5-9589-3a4d4df8fbf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:56.108356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e353d4-0413-49a5-9589-3a4d4df8fbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:56.108725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e353d4-0413-49a5-9589-3a4d4df8fbf0 admin admin] PATH_INFO: `/v3/users/6de2e935bb7c470380381e1f0141ba3b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:56.112585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e353d4-0413-49a5-9589-3a4d4df8fbf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de2e935bb7c470380381e1f0141ba3b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:56.114715 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e353d4-0413-49a5-9589-3a4d4df8fbf0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:56.197942 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1eacf01d-7065-4cf4-9f8f-7d93ab963594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93771456326f40b392908c1b5f2934c4', 'request_id': 'req-1eacf01d-7065-4cf4-9f8f-7d93ab963594'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:56.217703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e5e353d4-0413-49a5-9589-3a4d4df8fbf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de2e935bb7c470380381e1f0141ba3b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:56.221378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1eacf01d-7065-4cf4-9f8f-7d93ab963594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93771456326f40b392908c1b5f2934c4', 'request_id': 'req-1eacf01d-7065-4cf4-9f8f-7d93ab963594'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:56.244001 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e5e353d4-0413-49a5-9589-3a4d4df8fbf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de2e935bb7c470380381e1f0141ba3b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:56.246457 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1eacf01d-7065-4cf4-9f8f-7d93ab963594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93771456326f40b392908c1b5f2934c4', 'request_id': 'req-1eacf01d-7065-4cf4-9f8f-7d93ab963594'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:56.260479 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e5e353d4-0413-49a5-9589-3a4d4df8fbf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de2e935bb7c470380381e1f0141ba3b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:56.261241 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e5e353d4-0413-49a5-9589-3a4d4df8fbf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de2e935bb7c470380381e1f0141ba3b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:56.284269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:56.287888 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e5e353d4-0413-49a5-9589-3a4d4df8fbf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de2e935bb7c470380381e1f0141ba3b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:56.302130 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 820/1651] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:25:55 2022] DELETE /identity/v3/users/6de2e935bb7c470380381e1f0141ba3b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:56.305965 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba80c6-ca36-4f38-9fe1-91dbd46f9989 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:56.306279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba80c6-ca36-4f38-9fe1-91dbd46f9989 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:56.306578 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba80c6-ca36-4f38-9fe1-91dbd46f9989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:56.355102 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1eacf01d-7065-4cf4-9f8f-7d93ab963594 admin admin] The token cache is being invalidate because project 93771456326f40b392908c1b5f2934c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:25:56.358152 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1eacf01d-7065-4cf4-9f8f-7d93ab963594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:56.359895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1eacf01d-7065-4cf4-9f8f-7d93ab963594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:56.362203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 832/1652] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:25:55 2022] DELETE /identity/v3/projects/93771456326f40b392908c1b5f2934c4 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:56.366456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacf01d-7065-4cf4-9f8f-7d93ab963594 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:56.371794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1eacf01d-7065-4cf4-9f8f-7d93ab963594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:56.380583 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-baba80c6-ca36-4f38-9fe1-91dbd46f9989 None None] MFA Rules not processed for user `69c9809662bc441f8e95bfe2e4d069f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:56.382043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-baba80c6-ca36-4f38-9fe1-91dbd46f9989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:56.498898 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacf01d-7065-4cf4-9f8f-7d93ab963594 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:56.511721 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 821/1653] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:56.528751 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba80c6-ca36-4f38-9fe1-91dbd46f9989 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:56.530591 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-baba80c6-ca36-4f38-9fe1-91dbd46f9989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:56.688877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2572b-f74d-4e32-bea8-c1be8b91fd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:56.690648 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2572b-f74d-4e32-bea8-c1be8b91fd33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:56.690955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2572b-f74d-4e32-bea8-c1be8b91fd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:56.691242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2572b-f74d-4e32-bea8-c1be8b91fd33 admin admin] PATH_INFO: `/v3/users/3a913159d0e143859a7567540b5ec356` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:56.699243 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2572b-f74d-4e32-bea8-c1be8b91fd33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a913159d0e143859a7567540b5ec356)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:56.701497 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2572b-f74d-4e32-bea8-c1be8b91fd33 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:56.771272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba80c6-ca36-4f38-9fe1-91dbd46f9989 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:56.779848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d2f16-dec2-4cf5-9bed-87cd7baca838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:56.780788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d2f16-dec2-4cf5-9bed-87cd7baca838 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:56.781139 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d2f16-dec2-4cf5-9bed-87cd7baca838 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:56.781599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d2f16-dec2-4cf5-9bed-87cd7baca838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:56.800076 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d2f16-dec2-4cf5-9bed-87cd7baca838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:56.801760 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d2f16-dec2-4cf5-9bed-87cd7baca838 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:56.809702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:56.813743 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e5c2572b-f74d-4e32-bea8-c1be8b91fd33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a913159d0e143859a7567540b5ec356'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:56.815954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 822/1654] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:25:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:25:56.834871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e5c2572b-f74d-4e32-bea8-c1be8b91fd33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a913159d0e143859a7567540b5ec356'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:56.835692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e5c2572b-f74d-4e32-bea8-c1be8b91fd33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a913159d0e143859a7567540b5ec356'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:56.836411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e5c2572b-f74d-4e32-bea8-c1be8b91fd33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a913159d0e143859a7567540b5ec356'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:56.863239 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e5c2572b-f74d-4e32-bea8-c1be8b91fd33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a913159d0e143859a7567540b5ec356'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:56.896334 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 833/1655] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:25:56 2022] DELETE /identity/v3/users/3a913159d0e143859a7567540b5ec356 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:58.553900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d2f16-dec2-4cf5-9bed-87cd7baca838 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:58.553900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-039d2f16-dec2-4cf5-9bed-87cd7baca838 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:58.589307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d2f16-dec2-4cf5-9bed-87cd7baca838 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:58.724594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4ac6e-3bd0-4adb-ad5a-8db645e0f5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:58.725558 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4ac6e-3bd0-4adb-ad5a-8db645e0f5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:58.725893 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4ac6e-3bd0-4adb-ad5a-8db645e0f5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:58.726176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4ac6e-3bd0-4adb-ad5a-8db645e0f5a5 admin admin] PATH_INFO: `/v3/users/d7a8e240ca0d47ddba401b4e90a7d817` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:58.727563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4ac6e-3bd0-4adb-ad5a-8db645e0f5a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a8e240ca0d47ddba401b4e90a7d817)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:58.729676 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4ac6e-3bd0-4adb-ad5a-8db645e0f5a5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:58.754576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:25:58.822087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-37d4ac6e-3bd0-4adb-ad5a-8db645e0f5a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a8e240ca0d47ddba401b4e90a7d817'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:58.834246 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-37d4ac6e-3bd0-4adb-ad5a-8db645e0f5a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a8e240ca0d47ddba401b4e90a7d817'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:58.847917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-37d4ac6e-3bd0-4adb-ad5a-8db645e0f5a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a8e240ca0d47ddba401b4e90a7d817'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:58.848977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-37d4ac6e-3bd0-4adb-ad5a-8db645e0f5a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a8e240ca0d47ddba401b4e90a7d817'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:58.888745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-37d4ac6e-3bd0-4adb-ad5a-8db645e0f5a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a8e240ca0d47ddba401b4e90a7d817'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:58.907487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 823/1656] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:25:58 2022] DELETE /identity/v3/users/d7a8e240ca0d47ddba401b4e90a7d817 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:25:58.910422 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ce3ae-094b-4c3c-8bcb-a222d5503c81 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:58.911120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ce3ae-094b-4c3c-8bcb-a222d5503c81 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:58.911120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ce3ae-094b-4c3c-8bcb-a222d5503c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:58.955984 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d24ce3ae-094b-4c3c-8bcb-a222d5503c81 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:25:58.962544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d24ce3ae-094b-4c3c-8bcb-a222d5503c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:59.189399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 834/1657] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:25:59.302891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4ac6e-3bd0-4adb-ad5a-8db645e0f5a5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:59.304426 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-37d4ac6e-3bd0-4adb-ad5a-8db645e0f5a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:59.499809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4ac6e-3bd0-4adb-ad5a-8db645e0f5a5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:59.513980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f53bb8-cc75-4fb5-a3bc-0b3937033f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:59.514696 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f53bb8-cc75-4fb5-a3bc-0b3937033f0a service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:59.515123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f53bb8-cc75-4fb5-a3bc-0b3937033f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:59.515394 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f53bb8-cc75-4fb5-a3bc-0b3937033f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:59.541696 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f53bb8-cc75-4fb5-a3bc-0b3937033f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:59.543231 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f53bb8-cc75-4fb5-a3bc-0b3937033f0a service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:59.586749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 824/1658] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:25:59.615017 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ce3ae-094b-4c3c-8bcb-a222d5503c81 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:59.617740 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d24ce3ae-094b-4c3c-8bcb-a222d5503c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:59.638359 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f53bb8-cc75-4fb5-a3bc-0b3937033f0a service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:25:59.640611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-58f53bb8-cc75-4fb5-a3bc-0b3937033f0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:25:59.672107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ce3ae-094b-4c3c-8bcb-a222d5503c81 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:59.677540 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f53bb8-cc75-4fb5-a3bc-0b3937033f0a service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:25:59.691048 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc258b2-2e4f-4ebc-a5ed-0d46e1c59fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:59.692709 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d111f-ad12-4a55-85b7-5a2914ee1647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:25:59.695402 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc258b2-2e4f-4ebc-a5ed-0d46e1c59fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:59.695864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc258b2-2e4f-4ebc-a5ed-0d46e1c59fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:59.696568 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d111f-ad12-4a55-85b7-5a2914ee1647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:59.697006 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc258b2-2e4f-4ebc-a5ed-0d46e1c59fa2 admin admin] PATH_INFO: `/v3/projects/cf2fcd3084c748cc89159140769972b8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:59.697433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d111f-ad12-4a55-85b7-5a2914ee1647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:59.698754 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d111f-ad12-4a55-85b7-5a2914ee1647 admin admin] PATH_INFO: `/v3/projects/6e536cf538fd4decb6889b8ee4a0c9a4` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:59.700408 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc258b2-2e4f-4ebc-a5ed-0d46e1c59fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2fcd3084c748cc89159140769972b8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:59.704090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d111f-ad12-4a55-85b7-5a2914ee1647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e536cf538fd4decb6889b8ee4a0c9a4)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:25:59.706849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d111f-ad12-4a55-85b7-5a2914ee1647 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:59.708061 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc258b2-2e4f-4ebc-a5ed-0d46e1c59fa2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:25:59.880814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4dc258b2-2e4f-4ebc-a5ed-0d46e1c59fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2fcd3084c748cc89159140769972b8', 'request_id': 'req-4dc258b2-2e4f-4ebc-a5ed-0d46e1c59fa2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:59.883843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f67d111f-ad12-4a55-85b7-5a2914ee1647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e536cf538fd4decb6889b8ee4a0c9a4', 'request_id': 'req-f67d111f-ad12-4a55-85b7-5a2914ee1647'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:59.892782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4dc258b2-2e4f-4ebc-a5ed-0d46e1c59fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2fcd3084c748cc89159140769972b8', 'request_id': 'req-4dc258b2-2e4f-4ebc-a5ed-0d46e1c59fa2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:59.907559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f67d111f-ad12-4a55-85b7-5a2914ee1647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e536cf538fd4decb6889b8ee4a0c9a4', 'request_id': 'req-f67d111f-ad12-4a55-85b7-5a2914ee1647'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:59.921765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4dc258b2-2e4f-4ebc-a5ed-0d46e1c59fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2fcd3084c748cc89159140769972b8', 'request_id': 'req-4dc258b2-2e4f-4ebc-a5ed-0d46e1c59fa2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:59.934376 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f67d111f-ad12-4a55-85b7-5a2914ee1647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e536cf538fd4decb6889b8ee4a0c9a4', 'request_id': 'req-f67d111f-ad12-4a55-85b7-5a2914ee1647'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:59.951806 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4dc258b2-2e4f-4ebc-a5ed-0d46e1c59fa2 admin admin] The token cache is being invalidate because project cf2fcd3084c748cc89159140769972b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:25:59.953272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4dc258b2-2e4f-4ebc-a5ed-0d46e1c59fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:59.954779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4dc258b2-2e4f-4ebc-a5ed-0d46e1c59fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:59.962342 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 835/1659] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:25:59 2022] DELETE /identity/v3/projects/cf2fcd3084c748cc89159140769972b8 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:59.964845 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f67d111f-ad12-4a55-85b7-5a2914ee1647 admin admin] The token cache is being invalidate because project 6e536cf538fd4decb6889b8ee4a0c9a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:25:59.965143 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f67d111f-ad12-4a55-85b7-5a2914ee1647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:59.967391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faddfba-03ab-4625-ac0e-2b80511b8bd5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:59.968367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f67d111f-ad12-4a55-85b7-5a2914ee1647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:25:59.968823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faddfba-03ab-4625-ac0e-2b80511b8bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:59.969284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faddfba-03ab-4625-ac0e-2b80511b8bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:25:59.970767 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 825/1660] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:25:59 2022] DELETE /identity/v3/projects/6e536cf538fd4decb6889b8ee4a0c9a4 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:25:59.976658 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e0834-e48c-4203-97ad-2b816a572018 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:25:59.976948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e0834-e48c-4203-97ad-2b816a572018 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:25:59.977239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e0834-e48c-4203-97ad-2b816a572018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:00.028111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1faddfba-03ab-4625-ac0e-2b80511b8bd5 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:00.033238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1faddfba-03ab-4625-ac0e-2b80511b8bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:00.049213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-371e0834-e48c-4203-97ad-2b816a572018 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:00.050530 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-371e0834-e48c-4203-97ad-2b816a572018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:00.094877 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:00.168898 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:00.201200 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 836/1661] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:00.213900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09f478-dd99-4249-a7f6-1d5d863b4227 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:00.214781 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09f478-dd99-4249-a7f6-1d5d863b4227 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:00.215158 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09f478-dd99-4249-a7f6-1d5d863b4227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:00.246057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7f09f478-dd99-4249-a7f6-1d5d863b4227 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:00.252264 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7f09f478-dd99-4249-a7f6-1d5d863b4227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:00.262750 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 826/1662] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:00.267314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 837/1663] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:00.267483 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356ddd6-1089-4fa3-a8c6-ac1e700f59b1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:00.267483 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356ddd6-1089-4fa3-a8c6-ac1e700f59b1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:00.267483 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356ddd6-1089-4fa3-a8c6-ac1e700f59b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:00.269831 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09f478-dd99-4249-a7f6-1d5d863b4227 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:00.292504 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09f478-dd99-4249-a7f6-1d5d863b4227 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:00.309252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a356ddd6-1089-4fa3-a8c6-ac1e700f59b1 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:00.311179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a356ddd6-1089-4fa3-a8c6-ac1e700f59b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:00.311442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d8a27-cb30-4100-b703-4f503fc09615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:00.312365 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d8a27-cb30-4100-b703-4f503fc09615 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:00.312574 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d8a27-cb30-4100-b703-4f503fc09615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:00.312834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d8a27-cb30-4100-b703-4f503fc09615 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:00.314477 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d8a27-cb30-4100-b703-4f503fc09615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:26:00.314794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d8a27-cb30-4100-b703-4f503fc09615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:00.316789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d8a27-cb30-4100-b703-4f503fc09615 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:00.326795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 827/1664] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:00.331920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356ddd6-1089-4fa3-a8c6-ac1e700f59b1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:00.348793 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356ddd6-1089-4fa3-a8c6-ac1e700f59b1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:00.357522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb596d21-185a-4afe-9392-869afa677853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:00.358966 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb596d21-185a-4afe-9392-869afa677853 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:00.359367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb596d21-185a-4afe-9392-869afa677853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:00.359657 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb596d21-185a-4afe-9392-869afa677853 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:00.361514 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb596d21-185a-4afe-9392-869afa677853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:26:00.362023 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb596d21-185a-4afe-9392-869afa677853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:00.364648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb596d21-185a-4afe-9392-869afa677853 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:00.379279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 838/1665] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:26:00.383606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d8a27-cb30-4100-b703-4f503fc09615 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:00.394598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 828/1666] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:26:00.399765 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb596d21-185a-4afe-9392-869afa677853 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:00.400695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d8a27-cb30-4100-b703-4f503fc09615 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:00.414214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb596d21-185a-4afe-9392-869afa677853 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:00.419035 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b829ba-98e1-4cfc-a74e-f344b6c9ad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:00.419852 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b829ba-98e1-4cfc-a74e-f344b6c9ad1e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:00.420220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b829ba-98e1-4cfc-a74e-f344b6c9ad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:00.420561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b829ba-98e1-4cfc-a74e-f344b6c9ad1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:00.421244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf79ae-15e6-4072-a37c-3bd39ce81b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:00.421409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b829ba-98e1-4cfc-a74e-f344b6c9ad1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:00.422790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf79ae-15e6-4072-a37c-3bd39ce81b8c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:00.423164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf79ae-15e6-4072-a37c-3bd39ce81b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:00.423511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf79ae-15e6-4072-a37c-3bd39ce81b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:00.424047 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b829ba-98e1-4cfc-a74e-f344b6c9ad1e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:00.425453 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf79ae-15e6-4072-a37c-3bd39ce81b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:00.429166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf79ae-15e6-4072-a37c-3bd39ce81b8c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:00.480386 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 839/1667] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:00 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:26:00.484673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b829ba-98e1-4cfc-a74e-f344b6c9ad1e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:00.486804 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 829/1668] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:00 2022] POST /identity/v3/projects => generated 365 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:26:00.491681 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf79ae-15e6-4072-a37c-3bd39ce81b8c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:00.612657 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf79ae-15e6-4072-a37c-3bd39ce81b8c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:00.623963 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b1cd8-2fa6-44f0-ad16-b1b00732e64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:00.624938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b1cd8-2fa6-44f0-ad16-b1b00732e64c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:00.625369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b1cd8-2fa6-44f0-ad16-b1b00732e64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:00.626112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b1cd8-2fa6-44f0-ad16-b1b00732e64c admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:00.627843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b1cd8-2fa6-44f0-ad16-b1b00732e64c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:00.630400 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b1cd8-2fa6-44f0-ad16-b1b00732e64c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:00.677405 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 830/1669] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:00 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:00.681390 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b1cd8-2fa6-44f0-ad16-b1b00732e64c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:00.770785 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b1cd8-2fa6-44f0-ad16-b1b00732e64c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:00.799816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa596ee1-04e4-4520-ac65-401c285057d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:00.801792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa596ee1-04e4-4520-ac65-401c285057d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:00.802531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa596ee1-04e4-4520-ac65-401c285057d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:00.803909 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa596ee1-04e4-4520-ac65-401c285057d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:00.807729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa596ee1-04e4-4520-ac65-401c285057d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:00.813143 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa596ee1-04e4-4520-ac65-401c285057d7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:00.819900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b829ba-98e1-4cfc-a74e-f344b6c9ad1e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:00.837653 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e072fe-9bba-4c5d-b89c-7b3d7a3d671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:00.840901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e072fe-9bba-4c5d-b89c-7b3d7a3d671c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:00.841672 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e072fe-9bba-4c5d-b89c-7b3d7a3d671c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:00.842419 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e072fe-9bba-4c5d-b89c-7b3d7a3d671c admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:00.845596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e072fe-9bba-4c5d-b89c-7b3d7a3d671c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:00.848584 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 831/1670] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:00.851687 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa596ee1-04e4-4520-ac65-401c285057d7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:00.856098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e072fe-9bba-4c5d-b89c-7b3d7a3d671c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:00.893888 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa596ee1-04e4-4520-ac65-401c285057d7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:00.904426 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ab65a-ea1c-434d-8f34-00f313c98622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:00.905284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ab65a-ea1c-434d-8f34-00f313c98622 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:00.905582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ab65a-ea1c-434d-8f34-00f313c98622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:00.905869 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ab65a-ea1c-434d-8f34-00f313c98622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:00.906666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ab65a-ea1c-434d-8f34-00f313c98622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:00.908348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ab65a-ea1c-434d-8f34-00f313c98622 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:00.921546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 840/1671] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:00 2022] POST /identity/v3/users => generated 294 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:26:00.924745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 832/1672] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:00.928965 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ab65a-ea1c-434d-8f34-00f313c98622 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:00.930029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e072fe-9bba-4c5d-b89c-7b3d7a3d671c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:00.955167 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ab65a-ea1c-434d-8f34-00f313c98622 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:00.972855 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f345fb-5169-46cc-a06a-5b96e37ce25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:00.978102 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f345fb-5169-46cc-a06a-5b96e37ce25b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:00.978617 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f345fb-5169-46cc-a06a-5b96e37ce25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:00.978899 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f345fb-5169-46cc-a06a-5b96e37ce25b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:00.979700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f345fb-5169-46cc-a06a-5b96e37ce25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:00.985846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f345fb-5169-46cc-a06a-5b96e37ce25b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:00.988082 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e072fe-9bba-4c5d-b89c-7b3d7a3d671c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:01.013387 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353bb5f-1e41-48db-9b1f-a5371ecc33e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:01.015886 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353bb5f-1e41-48db-9b1f-a5371ecc33e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:01.016681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353bb5f-1e41-48db-9b1f-a5371ecc33e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:01.017460 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353bb5f-1e41-48db-9b1f-a5371ecc33e0 admin admin] PATH_INFO: `/v3/projects/e3e6912b4bd346c69c71c88dab5605c0/users/21b9d73867fe48a6a64c62c1eec3c22d/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:01.026727 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 833/1673] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:01.027736 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f345fb-5169-46cc-a06a-5b96e37ce25b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:01.054824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f345fb-5169-46cc-a06a-5b96e37ce25b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:01.072189 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7d93b-568b-4be3-af23-df6227c1d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:01.074042 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7d93b-568b-4be3-af23-df6227c1d06f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:01.074180 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7d93b-568b-4be3-af23-df6227c1d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:01.075556 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7d93b-568b-4be3-af23-df6227c1d06f admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:01.076987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7d93b-568b-4be3-af23-df6227c1d06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:01.079663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353bb5f-1e41-48db-9b1f-a5371ecc33e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e6912b4bd346c69c71c88dab5605c0, user_id=21b9d73867fe48a6a64c62c1eec3c22d, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:01.081889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7d93b-568b-4be3-af23-df6227c1d06f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:01.089667 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353bb5f-1e41-48db-9b1f-a5371ecc33e0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:01.107341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 834/1674] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:01.129177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7d93b-568b-4be3-af23-df6227c1d06f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:01.135245 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 841/1675] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:00 2022] PUT /identity/v3/projects/e3e6912b4bd346c69c71c88dab5605c0/users/21b9d73867fe48a6a64c62c1eec3c22d/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:01.146040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f4dba-833e-41e1-b490-b9acaaf5dc79 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:01.146584 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f4dba-833e-41e1-b490-b9acaaf5dc79 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:01.146978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f4dba-833e-41e1-b490-b9acaaf5dc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:01.155579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7d93b-568b-4be3-af23-df6227c1d06f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:01.213375 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:01.215041 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-848f4dba-833e-41e1-b490-b9acaaf5dc79 None None] MFA Rules not processed for user `21b9d73867fe48a6a64c62c1eec3c22d`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:01.216319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-848f4dba-833e-41e1-b490-b9acaaf5dc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:01.332206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c781b-9a11-490a-a323-d2cd86f7466b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:01.337762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c781b-9a11-490a-a323-d2cd86f7466b admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:01.338055 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c781b-9a11-490a-a323-d2cd86f7466b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:01.338430 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c781b-9a11-490a-a323-d2cd86f7466b admin admin] PATH_INFO: `/v3/projects/cdf0be5462984a72917f38353c188447/users/74acd4b9edbe42198cddb0df8ec7332c/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:01.373202 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c781b-9a11-490a-a323-d2cd86f7466b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf0be5462984a72917f38353c188447, user_id=74acd4b9edbe42198cddb0df8ec7332c, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:01.380116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c781b-9a11-490a-a323-d2cd86f7466b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:01.398023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:01.419282 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 842/1676] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:26:01.429735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 835/1677] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:01 2022] PUT /identity/v3/projects/cdf0be5462984a72917f38353c188447/users/74acd4b9edbe42198cddb0df8ec7332c/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:01.431960 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f4dba-833e-41e1-b490-b9acaaf5dc79 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:01.433803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8c1fb-0dda-41a5-92fd-a1f1780ed1a3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:01.434917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8c1fb-0dda-41a5-92fd-a1f1780ed1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:01.435360 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8c1fb-0dda-41a5-92fd-a1f1780ed1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:01.469107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f4dba-833e-41e1-b490-b9acaaf5dc79 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:01.509043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bee8c1fb-0dda-41a5-92fd-a1f1780ed1a3 None None] MFA Rules not processed for user `74acd4b9edbe42198cddb0df8ec7332c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:01.514250 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bee8c1fb-0dda-41a5-92fd-a1f1780ed1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:01.616352 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f067b-0381-4609-b481-1c805d75ddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:01.621203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f067b-0381-4609-b481-1c805d75ddf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:01.621830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f067b-0381-4609-b481-1c805d75ddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:01.622401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f067b-0381-4609-b481-1c805d75ddf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:01.623421 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f067b-0381-4609-b481-1c805d75ddf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:01.631875 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f067b-0381-4609-b481-1c805d75ddf3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:01.742354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 843/1678] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:01 2022] POST /identity/v3/projects => generated 363 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:01.749085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f067b-0381-4609-b481-1c805d75ddf3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:01.783635 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 836/1679] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:01.793397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8c1fb-0dda-41a5-92fd-a1f1780ed1a3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:01.843042 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8c1fb-0dda-41a5-92fd-a1f1780ed1a3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:01.933099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f067b-0381-4609-b481-1c805d75ddf3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:01.956747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59ab94-8035-4ff4-ab2d-4e30ce32fa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:01.957650 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59ab94-8035-4ff4-ab2d-4e30ce32fa91 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:01.958048 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59ab94-8035-4ff4-ab2d-4e30ce32fa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:01.958463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59ab94-8035-4ff4-ab2d-4e30ce32fa91 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:01.959841 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59ab94-8035-4ff4-ab2d-4e30ce32fa91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:01.962357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59ab94-8035-4ff4-ab2d-4e30ce32fa91 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:02.016143 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 844/1680] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:01 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:02.022730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59ab94-8035-4ff4-ab2d-4e30ce32fa91 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:02.052293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59ab94-8035-4ff4-ab2d-4e30ce32fa91 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:02.070311 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9555280-b67a-4e1e-86a1-50e0cc3f55d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:02.074684 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9555280-b67a-4e1e-86a1-50e0cc3f55d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:02.076142 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9555280-b67a-4e1e-86a1-50e0cc3f55d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:02.076537 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9555280-b67a-4e1e-86a1-50e0cc3f55d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:02.077449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9555280-b67a-4e1e-86a1-50e0cc3f55d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:02.083088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9555280-b67a-4e1e-86a1-50e0cc3f55d7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:02.120205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 845/1681] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:26:02.128355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9555280-b67a-4e1e-86a1-50e0cc3f55d7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:02.144111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9555280-b67a-4e1e-86a1-50e0cc3f55d7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:02.151056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326274b4-427b-4bfb-8240-e2c0e56c5f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:02.152243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326274b4-427b-4bfb-8240-e2c0e56c5f1b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:02.152996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326274b4-427b-4bfb-8240-e2c0e56c5f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:02.153256 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326274b4-427b-4bfb-8240-e2c0e56c5f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:02.154576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326274b4-427b-4bfb-8240-e2c0e56c5f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:02.156566 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e741e-9f5f-4fa9-a447-013574c2f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:02.157744 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e741e-9f5f-4fa9-a447-013574c2f03f admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:02.158266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e741e-9f5f-4fa9-a447-013574c2f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:02.158657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e741e-9f5f-4fa9-a447-013574c2f03f admin admin] PATH_INFO: `/v3/projects/ef32fde993dd4c2bafe4d6520952aa01/users/9f3f0ca933224a16b38f3d048788d25e/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:02.164724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326274b4-427b-4bfb-8240-e2c0e56c5f1b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:02.206537 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e741e-9f5f-4fa9-a447-013574c2f03f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef32fde993dd4c2bafe4d6520952aa01, user_id=9f3f0ca933224a16b38f3d048788d25e, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:02.210782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e741e-9f5f-4fa9-a447-013574c2f03f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:02.243699 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 846/1682] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:02 2022] PUT /identity/v3/projects/ef32fde993dd4c2bafe4d6520952aa01/users/9f3f0ca933224a16b38f3d048788d25e/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:02.248759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e741e-9f5f-4fa9-a447-013574c2f03f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:02.271472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 837/1683] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:01 2022] POST /identity/v3/projects => generated 383 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:02.276042 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326274b4-427b-4bfb-8240-e2c0e56c5f1b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:02.305907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:02.334847 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e741e-9f5f-4fa9-a447-013574c2f03f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:02.354213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:02.442195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec584d2-c242-4627-aa46-3e377d86dd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:02.443909 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec584d2-c242-4627-aa46-3e377d86dd60 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:02.444525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec584d2-c242-4627-aa46-3e377d86dd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:02.445008 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec584d2-c242-4627-aa46-3e377d86dd60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:02.446537 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec584d2-c242-4627-aa46-3e377d86dd60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:02.449011 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec584d2-c242-4627-aa46-3e377d86dd60 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:02.472369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 847/1684] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:02.479177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec584d2-c242-4627-aa46-3e377d86dd60 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:02.505371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec584d2-c242-4627-aa46-3e377d86dd60 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:02.514988 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326274b4-427b-4bfb-8240-e2c0e56c5f1b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:02.518009 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9bebc-9717-4247-a459-f2faab01fd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:02.519881 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9bebc-9717-4247-a459-f2faab01fd5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:02.521046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9bebc-9717-4247-a459-f2faab01fd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:02.521169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9bebc-9717-4247-a459-f2faab01fd5d admin admin] PATH_INFO: `/v3/projects/ef32fde993dd4c2bafe4d6520952aa01/users/9f3f0ca933224a16b38f3d048788d25e/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:02.524339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81ab8a-765f-432e-86d3-b77036769ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:02.525625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81ab8a-765f-432e-86d3-b77036769ffc admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:02.526053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81ab8a-765f-432e-86d3-b77036769ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:02.526598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81ab8a-765f-432e-86d3-b77036769ffc admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:02.526705 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9bebc-9717-4247-a459-f2faab01fd5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef32fde993dd4c2bafe4d6520952aa01, user_id=9f3f0ca933224a16b38f3d048788d25e, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:02.527817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81ab8a-765f-432e-86d3-b77036769ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:02.530140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81ab8a-765f-432e-86d3-b77036769ffc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:02.537541 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9bebc-9717-4247-a459-f2faab01fd5d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:02.575386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 838/1685] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:02 2022] POST /identity/v3/users => generated 292 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:02.576881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81ab8a-765f-432e-86d3-b77036769ffc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:02.592364 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81ab8a-765f-432e-86d3-b77036769ffc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:02.603362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 848/1686] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:02 2022] PUT /identity/v3/projects/ef32fde993dd4c2bafe4d6520952aa01/users/9f3f0ca933224a16b38f3d048788d25e/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:02.609520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be6584-1c2c-44e5-bfee-c200eeaa8f94 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:02.609520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be6584-1c2c-44e5-bfee-c200eeaa8f94 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:02.609520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be6584-1c2c-44e5-bfee-c200eeaa8f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:02.696005 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff69a2a-71ba-421b-9fac-7c4343e4982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:02.697911 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff69a2a-71ba-421b-9fac-7c4343e4982c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:02.698394 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff69a2a-71ba-421b-9fac-7c4343e4982c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:02.699177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff69a2a-71ba-421b-9fac-7c4343e4982c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:02.700366 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff69a2a-71ba-421b-9fac-7c4343e4982c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:02.704128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff69a2a-71ba-421b-9fac-7c4343e4982c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:02.723320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 839/1687] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:02.726742 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff69a2a-71ba-421b-9fac-7c4343e4982c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:02.743462 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c1be6584-1c2c-44e5-bfee-c200eeaa8f94 None None] MFA Rules not processed for user `9f3f0ca933224a16b38f3d048788d25e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:02.745846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff69a2a-71ba-421b-9fac-7c4343e4982c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:02.749403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c1be6584-1c2c-44e5-bfee-c200eeaa8f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:02.752484 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b0659-c841-40fb-b63d-5ebaab23c0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:02.753543 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b0659-c841-40fb-b63d-5ebaab23c0cd admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:02.754322 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b0659-c841-40fb-b63d-5ebaab23c0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:02.754769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b0659-c841-40fb-b63d-5ebaab23c0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:02.755786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b0659-c841-40fb-b63d-5ebaab23c0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:02.765224 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b0659-c841-40fb-b63d-5ebaab23c0cd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:02.780835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 840/1688] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:02.786048 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b0659-c841-40fb-b63d-5ebaab23c0cd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:02.807393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b0659-c841-40fb-b63d-5ebaab23c0cd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:02.817912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ab438-ff89-48e8-b844-e4a0ef0dc419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:02.819871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ab438-ff89-48e8-b844-e4a0ef0dc419 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:02.820166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ab438-ff89-48e8-b844-e4a0ef0dc419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:02.820450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ab438-ff89-48e8-b844-e4a0ef0dc419 admin admin] PATH_INFO: `/v3/projects/fe61cdd386ef460d971c8de587a8e6fc/users/25e362597fae47e48e7bb2b9043af892/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:02.850620 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ab438-ff89-48e8-b844-e4a0ef0dc419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe61cdd386ef460d971c8de587a8e6fc, user_id=25e362597fae47e48e7bb2b9043af892, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:02.853623 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ab438-ff89-48e8-b844-e4a0ef0dc419 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:02.888531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 841/1689] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:02 2022] PUT /identity/v3/projects/fe61cdd386ef460d971c8de587a8e6fc/users/25e362597fae47e48e7bb2b9043af892/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:02.890545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aeb2f-dc3d-4df5-8f46-575fe82958e7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:02.890923 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aeb2f-dc3d-4df5-8f46-575fe82958e7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:02.891238 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aeb2f-dc3d-4df5-8f46-575fe82958e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:02.973340 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-770aeb2f-dc3d-4df5-8f46-575fe82958e7 None None] MFA Rules not processed for user `25e362597fae47e48e7bb2b9043af892`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:02.975171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-770aeb2f-dc3d-4df5-8f46-575fe82958e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:03.078993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 849/1690] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:02 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:03.100320 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be6584-1c2c-44e5-bfee-c200eeaa8f94 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:03.107738 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c1be6584-1c2c-44e5-bfee-c200eeaa8f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:03.140605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:03.163788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 842/1691] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:03.164718 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aeb2f-dc3d-4df5-8f46-575fe82958e7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:03.399670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be6584-1c2c-44e5-bfee-c200eeaa8f94 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:03.430570 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:03.476673 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aeb2f-dc3d-4df5-8f46-575fe82958e7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:03.499019 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e5a30-750e-4892-848b-a47a67042417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:03.501793 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e5a30-750e-4892-848b-a47a67042417 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:03.503509 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e5a30-750e-4892-848b-a47a67042417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:03.504108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e5a30-750e-4892-848b-a47a67042417 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:03.507672 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e5a30-750e-4892-848b-a47a67042417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:03.518488 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e5a30-750e-4892-848b-a47a67042417 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:03.627299 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 843/1692] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:03 2022] POST /identity/v3/projects => generated 387 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:03.630413 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d7969-191d-4112-93c9-5400bc1c46c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:03.632359 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d7969-191d-4112-93c9-5400bc1c46c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:03.632871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d7969-191d-4112-93c9-5400bc1c46c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:03.633356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d7969-191d-4112-93c9-5400bc1c46c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:03.634971 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e5a30-750e-4892-848b-a47a67042417 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:03.640376 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c97e5a30-750e-4892-848b-a47a67042417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:03.831347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d7969-191d-4112-93c9-5400bc1c46c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:03.836018 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d7969-191d-4112-93c9-5400bc1c46c2 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:03.862260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e5a30-750e-4892-848b-a47a67042417 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:03.869875 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 850/1693] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:03 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 760 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:03.871517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d7969-191d-4112-93c9-5400bc1c46c2 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:03.873379 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f8c3a-35d7-4851-93e5-2da8efd1247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:03.875382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f8c3a-35d7-4851-93e5-2da8efd1247c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:03.876278 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f8c3a-35d7-4851-93e5-2da8efd1247c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:03.876994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f8c3a-35d7-4851-93e5-2da8efd1247c admin admin] PATH_INFO: `/v3/projects/9fd02570608d4ec2b2c92250c1f6fec7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:03.881165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f8c3a-35d7-4851-93e5-2da8efd1247c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd02570608d4ec2b2c92250c1f6fec7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:03.885883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f8c3a-35d7-4851-93e5-2da8efd1247c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:03.917045 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d7969-191d-4112-93c9-5400bc1c46c2 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:03.947953 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db412f0-4818-4eea-aa71-44f8a02375a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:03.950474 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db412f0-4818-4eea-aa71-44f8a02375a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:03.950972 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db412f0-4818-4eea-aa71-44f8a02375a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:03.952634 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db412f0-4818-4eea-aa71-44f8a02375a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:03.959626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db412f0-4818-4eea-aa71-44f8a02375a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:03.969145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db412f0-4818-4eea-aa71-44f8a02375a6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:04.059649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 851/1694] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:03 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:04.063471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db412f0-4818-4eea-aa71-44f8a02375a6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:04.090368 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-436f8c3a-35d7-4851-93e5-2da8efd1247c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd02570608d4ec2b2c92250c1f6fec7', 'request_id': 'req-436f8c3a-35d7-4851-93e5-2da8efd1247c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:04.119279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-436f8c3a-35d7-4851-93e5-2da8efd1247c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd02570608d4ec2b2c92250c1f6fec7', 'request_id': 'req-436f8c3a-35d7-4851-93e5-2da8efd1247c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:04.127023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db412f0-4818-4eea-aa71-44f8a02375a6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:04.139526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-436f8c3a-35d7-4851-93e5-2da8efd1247c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd02570608d4ec2b2c92250c1f6fec7', 'request_id': 'req-436f8c3a-35d7-4851-93e5-2da8efd1247c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:04.168478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-436f8c3a-35d7-4851-93e5-2da8efd1247c admin admin] The token cache is being invalidate because project 9fd02570608d4ec2b2c92250c1f6fec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:04.169345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-436f8c3a-35d7-4851-93e5-2da8efd1247c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:04.170307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-436f8c3a-35d7-4851-93e5-2da8efd1247c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:04.177673 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 844/1695] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:03 2022] DELETE /identity/v3/projects/9fd02570608d4ec2b2c92250c1f6fec7 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:04.180724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5aa6d-6c4f-47ad-b4cb-bc5a6ec669c2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:04.183539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5aa6d-6c4f-47ad-b4cb-bc5a6ec669c2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:04.183539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5aa6d-6c4f-47ad-b4cb-bc5a6ec669c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:04.245593 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-32e5aa6d-6c4f-47ad-b4cb-bc5a6ec669c2 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:04.251865 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-32e5aa6d-6c4f-47ad-b4cb-bc5a6ec669c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:04.286556 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:04.288557 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecdb28-9c3e-46b9-9e7b-4cfbce5966df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:04.289912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecdb28-9c3e-46b9-9e7b-4cfbce5966df admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:04.290621 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecdb28-9c3e-46b9-9e7b-4cfbce5966df admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:04.290887 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecdb28-9c3e-46b9-9e7b-4cfbce5966df admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:04.292931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecdb28-9c3e-46b9-9e7b-4cfbce5966df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:04.294796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecdb28-9c3e-46b9-9e7b-4cfbce5966df admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:04.326479 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 852/1696] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:04.327687 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecdb28-9c3e-46b9-9e7b-4cfbce5966df admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:04.340492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-69ecdb28-9c3e-46b9-9e7b-4cfbce5966df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:04.369581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecdb28-9c3e-46b9-9e7b-4cfbce5966df admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:04.385516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6279f-cbb2-4125-aa36-9c775ba028a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:04.389096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6279f-cbb2-4125-aa36-9c775ba028a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:04.389544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6279f-cbb2-4125-aa36-9c775ba028a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:04.389676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6279f-cbb2-4125-aa36-9c775ba028a6 admin admin] PATH_INFO: `/v3/projects/77a2075311454b5f9f7a6226770771cd/users/310166446b8f4db2a9156b3edc9f3246/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:04.441830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6279f-cbb2-4125-aa36-9c775ba028a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a2075311454b5f9f7a6226770771cd, user_id=310166446b8f4db2a9156b3edc9f3246, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:04.459802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6279f-cbb2-4125-aa36-9c775ba028a6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:04.472468 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 845/1697] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:04.475469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650783cb-162a-4237-9d34-06e82d2f55bc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:04.475884 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650783cb-162a-4237-9d34-06e82d2f55bc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:04.476270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650783cb-162a-4237-9d34-06e82d2f55bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:04.497691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 853/1698] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:04 2022] PUT /identity/v3/projects/77a2075311454b5f9f7a6226770771cd/users/310166446b8f4db2a9156b3edc9f3246/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:04.503609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6279f-cbb2-4125-aa36-9c775ba028a6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:04.515168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-650783cb-162a-4237-9d34-06e82d2f55bc None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:04.522980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-650783cb-162a-4237-9d34-06e82d2f55bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:04.561251 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:04.710771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6279f-cbb2-4125-aa36-9c775ba028a6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:04.713465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 846/1699] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:04.716223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f16c0-a9ce-4843-bdb3-c0077655cf40 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:04.717792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f16c0-a9ce-4843-bdb3-c0077655cf40 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:04.719529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f16c0-a9ce-4843-bdb3-c0077655cf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:04.730113 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8992830-9c42-482b-bf9a-69636a91e42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:04.731263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8992830-9c42-482b-bf9a-69636a91e42f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:04.731400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8992830-9c42-482b-bf9a-69636a91e42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:04.731832 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8992830-9c42-482b-bf9a-69636a91e42f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:04.732735 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8992830-9c42-482b-bf9a-69636a91e42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:04.736222 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8992830-9c42-482b-bf9a-69636a91e42f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:04.760626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 854/1700] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:04.761722 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8992830-9c42-482b-bf9a-69636a91e42f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:04.786276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8992830-9c42-482b-bf9a-69636a91e42f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:04.794399 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-220f16c0-a9ce-4843-bdb3-c0077655cf40 None None] MFA Rules not processed for user `0b9e52d16695470dbbf42a45dae4271b`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:04.797117 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-220f16c0-a9ce-4843-bdb3-c0077655cf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:04.799655 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be988b08-ae40-4f1c-8a49-d193a638a2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:04.800603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be988b08-ae40-4f1c-8a49-d193a638a2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:04.800987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be988b08-ae40-4f1c-8a49-d193a638a2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:04.801360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be988b08-ae40-4f1c-8a49-d193a638a2e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:04.803813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be988b08-ae40-4f1c-8a49-d193a638a2e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:26:04.806591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be988b08-ae40-4f1c-8a49-d193a638a2e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:04.808484 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be988b08-ae40-4f1c-8a49-d193a638a2e0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:04.853908 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 855/1701] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:26:04.855352 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be988b08-ae40-4f1c-8a49-d193a638a2e0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:04.884727 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be988b08-ae40-4f1c-8a49-d193a638a2e0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:04.911108 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e0eb2-2b59-4545-ad12-48ec9206a72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:04.912559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e0eb2-2b59-4545-ad12-48ec9206a72f admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:04.913629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e0eb2-2b59-4545-ad12-48ec9206a72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:04.913629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e0eb2-2b59-4545-ad12-48ec9206a72f admin admin] PATH_INFO: `/v3/projects/77a2075311454b5f9f7a6226770771cd/users/310166446b8f4db2a9156b3edc9f3246/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:04.930276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e0eb2-2b59-4545-ad12-48ec9206a72f admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a2075311454b5f9f7a6226770771cd, user_id=310166446b8f4db2a9156b3edc9f3246, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:04.933520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e0eb2-2b59-4545-ad12-48ec9206a72f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:04.958334 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 856/1702] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:04 2022] PUT /identity/v3/projects/77a2075311454b5f9f7a6226770771cd/users/310166446b8f4db2a9156b3edc9f3246/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:04.959967 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e0eb2-2b59-4545-ad12-48ec9206a72f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:05.050672 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 847/1703] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:05.050672 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2568e9-47d7-4571-a176-8287d5aa8531 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:05.050672 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2568e9-47d7-4571-a176-8287d5aa8531 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:05.050672 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2568e9-47d7-4571-a176-8287d5aa8531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:05.132615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6d2568e9-47d7-4571-a176-8287d5aa8531 None None] MFA Rules not processed for user `310166446b8f4db2a9156b3edc9f3246`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:05.140692 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6d2568e9-47d7-4571-a176-8287d5aa8531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:05.186450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e0eb2-2b59-4545-ad12-48ec9206a72f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:05.203004 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4f40a-842f-435a-8dec-492c051e4009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:05.203888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4f40a-842f-435a-8dec-492c051e4009 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:05.204432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4f40a-842f-435a-8dec-492c051e4009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:05.204815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4f40a-842f-435a-8dec-492c051e4009 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:05.205641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4f40a-842f-435a-8dec-492c051e4009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:05.207728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4f40a-842f-435a-8dec-492c051e4009 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:05.277052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 857/1704] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:04 2022] POST /identity/v3/projects => generated 363 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:05.279045 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5812b8-8f41-42a7-b8ac-c86320834a8e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:05.279595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5812b8-8f41-42a7-b8ac-c86320834a8e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:05.280087 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5812b8-8f41-42a7-b8ac-c86320834a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:05.292035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:05.335356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5a5812b8-8f41-42a7-b8ac-c86320834a8e None None] MFA Rules not processed for user `0b9e52d16695470dbbf42a45dae4271b`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:05.336729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5a5812b8-8f41-42a7-b8ac-c86320834a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:05.380170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 848/1705] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:05.382605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2568e9-47d7-4571-a176-8287d5aa8531 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:05.418582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2568e9-47d7-4571-a176-8287d5aa8531 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:05.535623 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef264ba-c779-4783-bf5d-76e7f9bc299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:05.536350 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef264ba-c779-4783-bf5d-76e7f9bc299a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:05.536641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef264ba-c779-4783-bf5d-76e7f9bc299a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:05.537411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef264ba-c779-4783-bf5d-76e7f9bc299a admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:05.539532 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef264ba-c779-4783-bf5d-76e7f9bc299a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:05.543761 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef264ba-c779-4783-bf5d-76e7f9bc299a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:05.556464 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 858/1706] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:05.556464 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5812b8-8f41-42a7-b8ac-c86320834a8e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:05.564152 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5a5812b8-8f41-42a7-b8ac-c86320834a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:05.597502 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 849/1707] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:05 2022] POST /identity/v3/users => generated 282 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:05.598704 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef264ba-c779-4783-bf5d-76e7f9bc299a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:05.602265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3ef264ba-c779-4783-bf5d-76e7f9bc299a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:05.606718 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:05.677687 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5812b8-8f41-42a7-b8ac-c86320834a8e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:05.683963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbcbbc-dd94-4db1-832c-b6cc22395c29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:05.684985 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbcbbc-dd94-4db1-832c-b6cc22395c29 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:05.685531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbcbbc-dd94-4db1-832c-b6cc22395c29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:05.686004 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbcbbc-dd94-4db1-832c-b6cc22395c29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:05.736034 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef264ba-c779-4783-bf5d-76e7f9bc299a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:05.746260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0239d68-360e-4a87-befd-fbcdbdccbf6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:05.748927 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0239d68-360e-4a87-befd-fbcdbdccbf6a service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:05.749403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0239d68-360e-4a87-befd-fbcdbdccbf6a service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:05.749785 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0239d68-360e-4a87-befd-fbcdbdccbf6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:05.770415 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbcbbc-dd94-4db1-832c-b6cc22395c29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:05.771511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0239d68-360e-4a87-befd-fbcdbdccbf6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:05.772663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbcbbc-dd94-4db1-832c-b6cc22395c29 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:05.774194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0239d68-360e-4a87-befd-fbcdbdccbf6a service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:05.787294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 859/1708] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:05.788687 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbcbbc-dd94-4db1-832c-b6cc22395c29 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:05.794046 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 850/1709] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:05.822651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbcbbc-dd94-4db1-832c-b6cc22395c29 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:05.841497 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6c34c-c725-4bb7-a7d3-78ae5216a7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:05.842400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6c34c-c725-4bb7-a7d3-78ae5216a7ec admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:05.842791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6c34c-c725-4bb7-a7d3-78ae5216a7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:05.843185 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6c34c-c725-4bb7-a7d3-78ae5216a7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:05.844272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6c34c-c725-4bb7-a7d3-78ae5216a7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:05.846135 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6c34c-c725-4bb7-a7d3-78ae5216a7ec admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:05.877221 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 860/1710] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:05.878540 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0239d68-360e-4a87-befd-fbcdbdccbf6a service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:05.917082 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0239d68-360e-4a87-befd-fbcdbdccbf6a service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:05.930003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312230d-fd09-4afe-af38-5ac5616b5c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:05.932458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312230d-fd09-4afe-af38-5ac5616b5c05 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:05.932927 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312230d-fd09-4afe-af38-5ac5616b5c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:05.933952 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312230d-fd09-4afe-af38-5ac5616b5c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:05.936750 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312230d-fd09-4afe-af38-5ac5616b5c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:05.942643 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312230d-fd09-4afe-af38-5ac5616b5c05 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:05.986414 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 851/1711] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:26:05.987239 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6c34c-c725-4bb7-a7d3-78ae5216a7ec admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:06.023652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6c34c-c725-4bb7-a7d3-78ae5216a7ec admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:06.046434 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38aa3a-b1c9-4866-a690-5d1d9c15ec91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:06.053816 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38aa3a-b1c9-4866-a690-5d1d9c15ec91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:06.054123 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38aa3a-b1c9-4866-a690-5d1d9c15ec91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:06.054449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38aa3a-b1c9-4866-a690-5d1d9c15ec91 admin admin] PATH_INFO: `/v3/projects/9ecbbff57c04458db8bb60d4f4a0cc10/users/94ab0183683b40289f8ef07c4b032b19/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:06.121120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38aa3a-b1c9-4866-a690-5d1d9c15ec91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ecbbff57c04458db8bb60d4f4a0cc10, user_id=94ab0183683b40289f8ef07c4b032b19, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:06.123878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38aa3a-b1c9-4866-a690-5d1d9c15ec91 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:06.169609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 861/1712] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:05 2022] PUT /identity/v3/projects/9ecbbff57c04458db8bb60d4f4a0cc10/users/94ab0183683b40289f8ef07c4b032b19/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:06.183302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551d924-016a-4729-b272-ba35959ce0a9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:06.184572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551d924-016a-4729-b272-ba35959ce0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:06.185533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551d924-016a-4729-b272-ba35959ce0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:06.275814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b551d924-016a-4729-b272-ba35959ce0a9 None None] MFA Rules not processed for user `94ab0183683b40289f8ef07c4b032b19`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:06.286698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b551d924-016a-4729-b272-ba35959ce0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:06.373763 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:06.517016 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 852/1713] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:06.521677 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38aa3a-b1c9-4866-a690-5d1d9c15ec91 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:06.734668 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38aa3a-b1c9-4866-a690-5d1d9c15ec91 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:06.749157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe65e6b-053c-4b11-ab59-9f09618a6bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:06.749968 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe65e6b-053c-4b11-ab59-9f09618a6bdd admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:06.750081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe65e6b-053c-4b11-ab59-9f09618a6bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:06.750308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe65e6b-053c-4b11-ab59-9f09618a6bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:06.751067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe65e6b-053c-4b11-ab59-9f09618a6bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:06.761488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe65e6b-053c-4b11-ab59-9f09618a6bdd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:06.852912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 862/1714] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:06 2022] POST /identity/v3/projects => generated 365 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:06.858008 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551d924-016a-4729-b272-ba35959ce0a9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:06.868278 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27255e53-a95c-4baa-9fca-273f377267ec None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:06.869244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27255e53-a95c-4baa-9fca-273f377267ec None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:06.869794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27255e53-a95c-4baa-9fca-273f377267ec None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:06.877269 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 863/1715] 10.222.0.33 () {54 vars in 912 bytes} [Mon Jun 27 15:26:06 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:26:06.879906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ea59d-34c6-4202-8ffb-8ccbb50b6514 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:06.882165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ea59d-34c6-4202-8ffb-8ccbb50b6514 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:06.882648 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ea59d-34c6-4202-8ffb-8ccbb50b6514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:06.891444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551d924-016a-4729-b272-ba35959ce0a9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:07.010648 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:07.058320 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1b8ea59d-34c6-4202-8ffb-8ccbb50b6514 None None] MFA Rules not processed for user `67dbb53f47ca406c96377408e9f893f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:07.059614 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1b8ea59d-34c6-4202-8ffb-8ccbb50b6514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:07.163171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75cbe2-4820-4d0a-aee4-6c37748f36b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:07.163938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75cbe2-4820-4d0a-aee4-6c37748f36b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:07.164228 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75cbe2-4820-4d0a-aee4-6c37748f36b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:07.165747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75cbe2-4820-4d0a-aee4-6c37748f36b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:07.166180 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75cbe2-4820-4d0a-aee4-6c37748f36b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:07.175472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75cbe2-4820-4d0a-aee4-6c37748f36b4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:07.259951 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 853/1716] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:06 2022] POST /identity/v3/users => generated 289 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:07.260651 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75cbe2-4820-4d0a-aee4-6c37748f36b4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:07.322884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 864/1717] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 27 15:26:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:07.323406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75cbe2-4820-4d0a-aee4-6c37748f36b4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:07.348240 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8effe9-2a58-44d2-841c-45605e176c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:07.349626 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8effe9-2a58-44d2-841c-45605e176c3e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:07.350046 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8effe9-2a58-44d2-841c-45605e176c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:07.350572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8effe9-2a58-44d2-841c-45605e176c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:07.351985 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8effe9-2a58-44d2-841c-45605e176c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:07.363853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ea59d-34c6-4202-8ffb-8ccbb50b6514 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:07.366772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1b8ea59d-34c6-4202-8ffb-8ccbb50b6514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:07.375090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8effe9-2a58-44d2-841c-45605e176c3e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:07.410875 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 854/1718] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:07.414991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8effe9-2a58-44d2-841c-45605e176c3e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:07.439244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ea59d-34c6-4202-8ffb-8ccbb50b6514 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:07.440121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8effe9-2a58-44d2-841c-45605e176c3e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:07.455221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5820e4-9aa9-42d2-8a94-e15f66427715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:07.458326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5820e4-9aa9-42d2-8a94-e15f66427715 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:07.458623 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5820e4-9aa9-42d2-8a94-e15f66427715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:07.460604 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5820e4-9aa9-42d2-8a94-e15f66427715 admin admin] PATH_INFO: `/v3/projects/ad2812d642fe40eb85a9db7a5e28eaaa/users/775aaa149b7943cc94f914e8461c2ce1/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:07.462876 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02caef1-591d-4b46-9cb5-a98da4cc0802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:07.463954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02caef1-591d-4b46-9cb5-a98da4cc0802 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:07.464408 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02caef1-591d-4b46-9cb5-a98da4cc0802 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:07.464885 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02caef1-591d-4b46-9cb5-a98da4cc0802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:07.509733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5820e4-9aa9-42d2-8a94-e15f66427715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2812d642fe40eb85a9db7a5e28eaaa, user_id=775aaa149b7943cc94f914e8461c2ce1, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:07.519222 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02caef1-591d-4b46-9cb5-a98da4cc0802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:07.521666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5820e4-9aa9-42d2-8a94-e15f66427715 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:07.522145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02caef1-591d-4b46-9cb5-a98da4cc0802 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:07.572775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 855/1719] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:07 2022] PUT /identity/v3/projects/ad2812d642fe40eb85a9db7a5e28eaaa/users/775aaa149b7943cc94f914e8461c2ce1/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:07.577989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5820e4-9aa9-42d2-8a94-e15f66427715 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:07.598163 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 865/1720] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:07.684571 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02caef1-591d-4b46-9cb5-a98da4cc0802 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:07.783180 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5820e4-9aa9-42d2-8a94-e15f66427715 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:07.800811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a1e56-f6af-491e-ae2c-92d55e9174cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:07.801538 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a1e56-f6af-491e-ae2c-92d55e9174cc admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:07.801833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a1e56-f6af-491e-ae2c-92d55e9174cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:07.802172 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a1e56-f6af-491e-ae2c-92d55e9174cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:07.803343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a1e56-f6af-491e-ae2c-92d55e9174cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:07.807030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a1e56-f6af-491e-ae2c-92d55e9174cc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:07.848160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 856/1721] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:26:07.849202 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a1e56-f6af-491e-ae2c-92d55e9174cc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:07.879323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a1e56-f6af-491e-ae2c-92d55e9174cc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:07.907161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45f249-04a1-49ec-bfdb-11e2a2435526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:07.909814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45f249-04a1-49ec-bfdb-11e2a2435526 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:07.911777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45f249-04a1-49ec-bfdb-11e2a2435526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:07.914520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45f249-04a1-49ec-bfdb-11e2a2435526 admin admin] PATH_INFO: `/v3/projects/ad2812d642fe40eb85a9db7a5e28eaaa/users/775aaa149b7943cc94f914e8461c2ce1/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:07.921450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45f249-04a1-49ec-bfdb-11e2a2435526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2812d642fe40eb85a9db7a5e28eaaa, user_id=775aaa149b7943cc94f914e8461c2ce1, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:07.929553 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45f249-04a1-49ec-bfdb-11e2a2435526 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:07.950428 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:07.975366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02caef1-591d-4b46-9cb5-a98da4cc0802 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:07.976920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 857/1722] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:07 2022] PUT /identity/v3/projects/ad2812d642fe40eb85a9db7a5e28eaaa/users/775aaa149b7943cc94f914e8461c2ce1/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:07.982338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523af28-e274-4886-a5dc-714571df04fc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:07.983496 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523af28-e274-4886-a5dc-714571df04fc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:07.984300 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523af28-e274-4886-a5dc-714571df04fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:08.063301 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c523af28-e274-4886-a5dc-714571df04fc None None] MFA Rules not processed for user `775aaa149b7943cc94f914e8461c2ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:08.068228 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c523af28-e274-4886-a5dc-714571df04fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:08.143830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b070dc-824f-4763-b108-a36b8ea9a721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:08.145241 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b070dc-824f-4763-b108-a36b8ea9a721 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:08.145663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b070dc-824f-4763-b108-a36b8ea9a721 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:08.146131 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b070dc-824f-4763-b108-a36b8ea9a721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:08.151689 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d3b070dc-824f-4763-b108-a36b8ea9a721 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:08.289569 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b070dc-824f-4763-b108-a36b8ea9a721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:08.291620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b070dc-824f-4763-b108-a36b8ea9a721 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:08.303617 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 866/1723] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:26:08.304852 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b070dc-824f-4763-b108-a36b8ea9a721 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:08.306514 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d3b070dc-824f-4763-b108-a36b8ea9a721 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:08.320030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:08.337678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 858/1724] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:08.360144 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523af28-e274-4886-a5dc-714571df04fc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:08.361793 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c523af28-e274-4886-a5dc-714571df04fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:08.383333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523af28-e274-4886-a5dc-714571df04fc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:08.395186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b53ac-6c14-46e3-b831-08422ff182ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:08.396006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b53ac-6c14-46e3-b831-08422ff182ff service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:08.396467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b53ac-6c14-46e3-b831-08422ff182ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:08.396857 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b53ac-6c14-46e3-b831-08422ff182ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:08.420387 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b53ac-6c14-46e3-b831-08422ff182ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:08.422604 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b53ac-6c14-46e3-b831-08422ff182ff service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:08.439117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b070dc-824f-4763-b108-a36b8ea9a721 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:08.447532 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 859/1725] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:08.449795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca891a2a-fb57-4e02-a72b-da9073926419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:08.450956 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca891a2a-fb57-4e02-a72b-da9073926419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:08.451378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca891a2a-fb57-4e02-a72b-da9073926419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:08.451749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca891a2a-fb57-4e02-a72b-da9073926419 admin admin] PATH_INFO: `/v3/users/21b9d73867fe48a6a64c62c1eec3c22d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:08.453357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca891a2a-fb57-4e02-a72b-da9073926419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b9d73867fe48a6a64c62c1eec3c22d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:08.455479 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca891a2a-fb57-4e02-a72b-da9073926419 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:08.586347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ca891a2a-fb57-4e02-a72b-da9073926419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b9d73867fe48a6a64c62c1eec3c22d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:08.622541 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ca891a2a-fb57-4e02-a72b-da9073926419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b9d73867fe48a6a64c62c1eec3c22d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:08.623378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ca891a2a-fb57-4e02-a72b-da9073926419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b9d73867fe48a6a64c62c1eec3c22d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:08.626759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ca891a2a-fb57-4e02-a72b-da9073926419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b9d73867fe48a6a64c62c1eec3c22d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:08.697749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ca891a2a-fb57-4e02-a72b-da9073926419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b9d73867fe48a6a64c62c1eec3c22d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:08.706725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b53ac-6c14-46e3-b831-08422ff182ff service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:08.720473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b53ac-6c14-46e3-b831-08422ff182ff service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:08.733851 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94ce98-8df4-4086-9278-97e71971b5ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:08.736650 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 867/1726] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:26:08 2022] DELETE /identity/v3/users/21b9d73867fe48a6a64c62c1eec3c22d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:08.737629 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94ce98-8df4-4086-9278-97e71971b5ad service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:08.738210 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94ce98-8df4-4086-9278-97e71971b5ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:08.738797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94ce98-8df4-4086-9278-97e71971b5ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:08.740879 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabe0d8-cd05-4384-9dd7-eac4896c5bda None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:08.741209 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabe0d8-cd05-4384-9dd7-eac4896c5bda None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:08.741502 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabe0d8-cd05-4384-9dd7-eac4896c5bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:08.745716 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ea94ce98-8df4-4086-9278-97e71971b5ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:08.828796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6cabe0d8-cd05-4384-9dd7-eac4896c5bda None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:08.830948 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6cabe0d8-cd05-4384-9dd7-eac4896c5bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:08.912213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94ce98-8df4-4086-9278-97e71971b5ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:08.916758 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94ce98-8df4-4086-9278-97e71971b5ad service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:08.945086 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 860/1727] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:08 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:09.162365 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb3d1d-f7a4-4ea8-820d-5d0d78344940 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:09.162365 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb3d1d-f7a4-4ea8-820d-5d0d78344940 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:09.163768 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb3d1d-f7a4-4ea8-820d-5d0d78344940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:09.237408 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 868/1728] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:09.279548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-00bb3d1d-f7a4-4ea8-820d-5d0d78344940 None None] MFA Rules not processed for user `c5ebe5c2142f49ab8f2455bf1ae952d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:09.280971 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-00bb3d1d-f7a4-4ea8-820d-5d0d78344940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:09.342694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabe0d8-cd05-4384-9dd7-eac4896c5bda None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:09.344306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6cabe0d8-cd05-4384-9dd7-eac4896c5bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:09.522165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:09.614465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:09.630006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 861/1729] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:26:09.650129 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d003161-34da-47ec-baf5-21423a61784b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:09.650457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d003161-34da-47ec-baf5-21423a61784b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:09.650747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d003161-34da-47ec-baf5-21423a61784b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:09.660820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabe0d8-cd05-4384-9dd7-eac4896c5bda None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:09.685332 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62ec2b-a711-4af6-88f4-4005c831fcf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:09.686103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62ec2b-a711-4af6-88f4-4005c831fcf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:09.686363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62ec2b-a711-4af6-88f4-4005c831fcf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:09.686643 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62ec2b-a711-4af6-88f4-4005c831fcf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:09.718026 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3d003161-34da-47ec-baf5-21423a61784b None None] MFA Rules not processed for user `c5ebe5c2142f49ab8f2455bf1ae952d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:09.721137 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62ec2b-a711-4af6-88f4-4005c831fcf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:09.722720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62ec2b-a711-4af6-88f4-4005c831fcf0 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:09.724097 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3d003161-34da-47ec-baf5-21423a61784b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:09.746514 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 862/1730] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:09.757030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 869/1731] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:26:09.759835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d003161-34da-47ec-baf5-21423a61784b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:09.762124 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3d003161-34da-47ec-baf5-21423a61784b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:10.035804 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d003161-34da-47ec-baf5-21423a61784b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:10.055887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdc722-8e7a-4577-8f74-e41bfc4a2b4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:10.070100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc722-8e7a-4577-8f74-e41bfc4a2b4c service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:10.070486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc722-8e7a-4577-8f74-e41bfc4a2b4c service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:10.070713 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc722-8e7a-4577-8f74-e41bfc4a2b4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:10.121060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdc722-8e7a-4577-8f74-e41bfc4a2b4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:10.124080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdc722-8e7a-4577-8f74-e41bfc4a2b4c service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:10.177144 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 863/1732] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:10.208505 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24664d-8d2c-4dae-a52c-35446b344a8b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:10.209150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24664d-8d2c-4dae-a52c-35446b344a8b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:10.209578 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24664d-8d2c-4dae-a52c-35446b344a8b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:10.211907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 870/1733] 10.222.0.33 () {54 vars in 960 bytes} [Mon Jun 27 15:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:26:10.232639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f376a-ddb7-4164-bffa-677c5ced848a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:10.233117 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f376a-ddb7-4164-bffa-677c5ced848a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:10.233606 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f376a-ddb7-4164-bffa-677c5ced848a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:10.335662 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe6627-e469-49ed-a02a-89e6afd4ceab None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:10.336417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe6627-e469-49ed-a02a-89e6afd4ceab None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:10.338188 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe6627-e469-49ed-a02a-89e6afd4ceab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:10.353094 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9e3f376a-ddb7-4164-bffa-677c5ced848a None None] MFA Rules not processed for user `b471b5b4ede845c7a9dfbf2a90544591`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:10.369923 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9e3f376a-ddb7-4164-bffa-677c5ced848a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:10.398956 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-eabe6627-e469-49ed-a02a-89e6afd4ceab None None] MFA Rules not processed for user `69c9809662bc441f8e95bfe2e4d069f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:10.401820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-eabe6627-e469-49ed-a02a-89e6afd4ceab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:10.623616 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 871/1734] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:10.663736 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 864/1735] 10.222.0.33 () {58 vars in 1057 bytes} [Mon Jun 27 15:26:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:10.673083 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe6627-e469-49ed-a02a-89e6afd4ceab None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:10.695591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe6627-e469-49ed-a02a-89e6afd4ceab None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:10.702819 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5ee5e-5aab-4a8d-b1eb-1d63a4dcd91e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b471b5b4ede845c7a9dfbf2a90544591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:10.703556 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5ee5e-5aab-4a8d-b1eb-1d63a4dcd91e service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:10.703848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5ee5e-5aab-4a8d-b1eb-1d63a4dcd91e service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:10.704146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5ee5e-5aab-4a8d-b1eb-1d63a4dcd91e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:10.710020 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-60c5ee5e-5aab-4a8d-b1eb-1d63a4dcd91e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:10.742609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5ee5e-5aab-4a8d-b1eb-1d63a4dcd91e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:10.748765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5ee5e-5aab-4a8d-b1eb-1d63a4dcd91e service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:10.809258 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 872/1736] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:26:11.608024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a492cf-b8b1-4905-9c0f-480d89cba492 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:11.608563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a492cf-b8b1-4905-9c0f-480d89cba492 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:11.609105 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a492cf-b8b1-4905-9c0f-480d89cba492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:11.687325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-47a492cf-b8b1-4905-9c0f-480d89cba492 None None] MFA Rules not processed for user `202e415e386e4abe8c70a9889448eb02`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:11.689051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-47a492cf-b8b1-4905-9c0f-480d89cba492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:11.884667 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53d050-faba-4546-acff-384306a161b6 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:11.885921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53d050-faba-4546-acff-384306a161b6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:11.886409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53d050-faba-4546-acff-384306a161b6 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:11.888324 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 873/1737] 10.222.0.33 () {54 vars in 912 bytes} [Mon Jun 27 15:26:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:26:11.902173 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bad246-90db-49b9-9fe7-506c33cdc0b1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:11.902874 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bad246-90db-49b9-9fe7-506c33cdc0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:11.903354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bad246-90db-49b9-9fe7-506c33cdc0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:11.970012 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-25bad246-90db-49b9-9fe7-506c33cdc0b1 None None] MFA Rules not processed for user `67dbb53f47ca406c96377408e9f893f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:11.981619 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-25bad246-90db-49b9-9fe7-506c33cdc0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:12.013990 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 874/1738] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 27 15:26:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:26:12.085359 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bad246-90db-49b9-9fe7-506c33cdc0b1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:12.086982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-25bad246-90db-49b9-9fe7-506c33cdc0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:12.128357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bad246-90db-49b9-9fe7-506c33cdc0b1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:12.136907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8d7b1-dfb0-4136-8c20-c54d23f6cf9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:12.137605 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8d7b1-dfb0-4136-8c20-c54d23f6cf9a service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:12.137885 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8d7b1-dfb0-4136-8c20-c54d23f6cf9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:12.138410 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8d7b1-dfb0-4136-8c20-c54d23f6cf9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:12.172054 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8d7b1-dfb0-4136-8c20-c54d23f6cf9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:12.174066 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8d7b1-dfb0-4136-8c20-c54d23f6cf9a service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:12.203378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 875/1739] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:26:12.227436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 865/1740] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 621 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:12.887694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8d7b1-dfb0-4136-8c20-c54d23f6cf9a service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:12.895300 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e9c8d7b1-dfb0-4136-8c20-c54d23f6cf9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:12.957482 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8d7b1-dfb0-4136-8c20-c54d23f6cf9a service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:12.968131 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29347633-786c-4cdd-b3d8-34819969f495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:12.983039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29347633-786c-4cdd-b3d8-34819969f495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:12.987324 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29347633-786c-4cdd-b3d8-34819969f495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:12.988593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29347633-786c-4cdd-b3d8-34819969f495 admin admin] PATH_INFO: `/v3/projects/e3e6912b4bd346c69c71c88dab5605c0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:12.993088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29347633-786c-4cdd-b3d8-34819969f495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3e6912b4bd346c69c71c88dab5605c0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:12.996212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29347633-786c-4cdd-b3d8-34819969f495 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:13.170000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-29347633-786c-4cdd-b3d8-34819969f495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3e6912b4bd346c69c71c88dab5605c0', 'request_id': 'req-29347633-786c-4cdd-b3d8-34819969f495'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:13.190751 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-29347633-786c-4cdd-b3d8-34819969f495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3e6912b4bd346c69c71c88dab5605c0', 'request_id': 'req-29347633-786c-4cdd-b3d8-34819969f495'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:13.242716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-29347633-786c-4cdd-b3d8-34819969f495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3e6912b4bd346c69c71c88dab5605c0', 'request_id': 'req-29347633-786c-4cdd-b3d8-34819969f495'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:13.286640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-29347633-786c-4cdd-b3d8-34819969f495 admin admin] The token cache is being invalidate because project e3e6912b4bd346c69c71c88dab5605c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:13.287653 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-29347633-786c-4cdd-b3d8-34819969f495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:13.290404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-29347633-786c-4cdd-b3d8-34819969f495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:13.296890 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 876/1741] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:12 2022] DELETE /identity/v3/projects/e3e6912b4bd346c69c71c88dab5605c0 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:13.305864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a492cf-b8b1-4905-9c0f-480d89cba492 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:13.317628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:13.337837 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a492cf-b8b1-4905-9c0f-480d89cba492 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:13.574397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29347633-786c-4cdd-b3d8-34819969f495 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:13.575945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-29347633-786c-4cdd-b3d8-34819969f495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:13.651136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1784f-b024-42ff-8159-e939d14fa131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:13.653924 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:13.664907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1784f-b024-42ff-8159-e939d14fa131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:13.665404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1784f-b024-42ff-8159-e939d14fa131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:13.665916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1784f-b024-42ff-8159-e939d14fa131 admin admin] PATH_INFO: `/v3/users/9f3f0ca933224a16b38f3d048788d25e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:13.676682 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1784f-b024-42ff-8159-e939d14fa131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3f0ca933224a16b38f3d048788d25e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:13.684507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1784f-b024-42ff-8159-e939d14fa131 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:13.932328 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-59b1784f-b024-42ff-8159-e939d14fa131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3f0ca933224a16b38f3d048788d25e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:13.979414 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-59b1784f-b024-42ff-8159-e939d14fa131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3f0ca933224a16b38f3d048788d25e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:13.997071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29347633-786c-4cdd-b3d8-34819969f495 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:14.003721 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-59b1784f-b024-42ff-8159-e939d14fa131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3f0ca933224a16b38f3d048788d25e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:14.004541 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-59b1784f-b024-42ff-8159-e939d14fa131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3f0ca933224a16b38f3d048788d25e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:14.044756 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec61ce3-59c0-4bd8-91a3-8b399403807d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:14.045513 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec61ce3-59c0-4bd8-91a3-8b399403807d service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:14.054749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec61ce3-59c0-4bd8-91a3-8b399403807d service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:14.056787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec61ce3-59c0-4bd8-91a3-8b399403807d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:14.068531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3ec61ce3-59c0-4bd8-91a3-8b399403807d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:14.073253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-59b1784f-b024-42ff-8159-e939d14fa131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3f0ca933224a16b38f3d048788d25e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:14.116640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 866/1742] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:26:13 2022] DELETE /identity/v3/users/9f3f0ca933224a16b38f3d048788d25e => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:14.149697 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1784f-b024-42ff-8159-e939d14fa131 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:14.153173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-59b1784f-b024-42ff-8159-e939d14fa131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:14.411820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec61ce3-59c0-4bd8-91a3-8b399403807d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:14.414429 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec61ce3-59c0-4bd8-91a3-8b399403807d service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:14.432387 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 877/1743] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 859 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:14.435644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a97528-bc16-46d5-b2af-8782bbcb18d1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:14.436313 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a97528-bc16-46d5-b2af-8782bbcb18d1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:14.436740 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a97528-bc16-46d5-b2af-8782bbcb18d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:14.517033 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-64a97528-bc16-46d5-b2af-8782bbcb18d1 None None] MFA Rules not processed for user `38077d8c653b4752814a0c200eb2a713`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:14.522199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-64a97528-bc16-46d5-b2af-8782bbcb18d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:14.745538 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1784f-b024-42ff-8159-e939d14fa131 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:14.807578 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48372734-ee67-4312-ac3b-bb20a5d5de9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:14.811911 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48372734-ee67-4312-ac3b-bb20a5d5de9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:14.812339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48372734-ee67-4312-ac3b-bb20a5d5de9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:14.829644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48372734-ee67-4312-ac3b-bb20a5d5de9e admin admin] PATH_INFO: `/v3/users/94ab0183683b40289f8ef07c4b032b19` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:14.833855 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48372734-ee67-4312-ac3b-bb20a5d5de9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ab0183683b40289f8ef07c4b032b19)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:14.847710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48372734-ee67-4312-ac3b-bb20a5d5de9e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:14.918956 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 878/1744] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:14.924430 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fa28c-90a6-49d5-a4dd-2695ed940e0a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:14.927877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fa28c-90a6-49d5-a4dd-2695ed940e0a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:14.928284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fa28c-90a6-49d5-a4dd-2695ed940e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:15.016748 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-434fa28c-90a6-49d5-a4dd-2695ed940e0a None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:15.022400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-434fa28c-90a6-49d5-a4dd-2695ed940e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:15.033096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:15.155800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-48372734-ee67-4312-ac3b-bb20a5d5de9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ab0183683b40289f8ef07c4b032b19'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:15.203142 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-48372734-ee67-4312-ac3b-bb20a5d5de9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ab0183683b40289f8ef07c4b032b19'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:15.252070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-48372734-ee67-4312-ac3b-bb20a5d5de9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ab0183683b40289f8ef07c4b032b19'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:15.257641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-48372734-ee67-4312-ac3b-bb20a5d5de9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ab0183683b40289f8ef07c4b032b19'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:15.327887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-48372734-ee67-4312-ac3b-bb20a5d5de9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ab0183683b40289f8ef07c4b032b19'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:15.329836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:15.370599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 867/1745] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:26:14 2022] DELETE /identity/v3/users/94ab0183683b40289f8ef07c4b032b19 => generated 0 bytes in 1221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:15.374291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48372734-ee67-4312-ac3b-bb20a5d5de9e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:15.381976 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 879/1746] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 27 15:26:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:15.387882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-48372734-ee67-4312-ac3b-bb20a5d5de9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:15.388425 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f69af-61a8-47f1-a329-5ef9b66b236b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:15.391076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f69af-61a8-47f1-a329-5ef9b66b236b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:15.391659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f69af-61a8-47f1-a329-5ef9b66b236b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:15.477551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3a4f69af-61a8-47f1-a329-5ef9b66b236b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:15.479387 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3a4f69af-61a8-47f1-a329-5ef9b66b236b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:15.734473 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 880/1747] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:15.865051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f69af-61a8-47f1-a329-5ef9b66b236b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:15.867427 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3a4f69af-61a8-47f1-a329-5ef9b66b236b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:15.868294 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48372734-ee67-4312-ac3b-bb20a5d5de9e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:15.921486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b60098-2641-4d31-a8fb-d7b4083ee53b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:15.922965 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b60098-2641-4d31-a8fb-d7b4083ee53b service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:15.923655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b60098-2641-4d31-a8fb-d7b4083ee53b service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:15.924052 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b60098-2641-4d31-a8fb-d7b4083ee53b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:15.926505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-10b60098-2641-4d31-a8fb-d7b4083ee53b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:16.062664 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b60098-2641-4d31-a8fb-d7b4083ee53b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:16.065187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b60098-2641-4d31-a8fb-d7b4083ee53b service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:16.150552 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 868/1748] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 779 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:16.152025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b60098-2641-4d31-a8fb-d7b4083ee53b service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:16.156230 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-10b60098-2641-4d31-a8fb-d7b4083ee53b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:16.160220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f69af-61a8-47f1-a329-5ef9b66b236b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:16.178715 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebaff5-e1cd-4303-9a90-0e4efa6dc3e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:16.181100 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebaff5-e1cd-4303-9a90-0e4efa6dc3e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:16.183352 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebaff5-e1cd-4303-9a90-0e4efa6dc3e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:16.184821 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebaff5-e1cd-4303-9a90-0e4efa6dc3e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:16.216252 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebaff5-e1cd-4303-9a90-0e4efa6dc3e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:16.219011 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebaff5-e1cd-4303-9a90-0e4efa6dc3e5 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:16.275920 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 881/1749] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:26:16.276839 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebaff5-e1cd-4303-9a90-0e4efa6dc3e5 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:16.279529 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-26ebaff5-e1cd-4303-9a90-0e4efa6dc3e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:16.322889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:16.423713 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b60098-2641-4d31-a8fb-d7b4083ee53b service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:16.436606 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f5f90-e258-4e14-bf7b-2bb2011e7ac8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:16.437474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f5f90-e258-4e14-bf7b-2bb2011e7ac8 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:16.437902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f5f90-e258-4e14-bf7b-2bb2011e7ac8 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:16.438376 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f5f90-e258-4e14-bf7b-2bb2011e7ac8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:16.596159 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f5f90-e258-4e14-bf7b-2bb2011e7ac8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:16.606309 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f5f90-e258-4e14-bf7b-2bb2011e7ac8 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:16.621444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 869/1750] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:26:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:26:16.643882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca305b0-14d8-49d1-a4aa-5eed0d5bf6e8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:16.648543 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca305b0-14d8-49d1-a4aa-5eed0d5bf6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:16.649235 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca305b0-14d8-49d1-a4aa-5eed0d5bf6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:16.782271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1ca305b0-14d8-49d1-a4aa-5eed0d5bf6e8 None None] MFA Rules not processed for user `c5ebe5c2142f49ab8f2455bf1ae952d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:16.787412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1ca305b0-14d8-49d1-a4aa-5eed0d5bf6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:16.801075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebaff5-e1cd-4303-9a90-0e4efa6dc3e5 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:16.833976 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed094e-fbb3-4abf-9489-0cff151ae406 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:16.838715 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed094e-fbb3-4abf-9489-0cff151ae406 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:16.839672 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed094e-fbb3-4abf-9489-0cff151ae406 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:16.844241 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed094e-fbb3-4abf-9489-0cff151ae406 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:16.874606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-39ed094e-fbb3-4abf-9489-0cff151ae406 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:17.205182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:17.239448 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed094e-fbb3-4abf-9489-0cff151ae406 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:17.251389 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed094e-fbb3-4abf-9489-0cff151ae406 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:17.271059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 870/1751] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 649 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:17.331489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 882/1752] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 1055 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:20.278473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca305b0-14d8-49d1-a4aa-5eed0d5bf6e8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:20.289240 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1ca305b0-14d8-49d1-a4aa-5eed0d5bf6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:20.352053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca305b0-14d8-49d1-a4aa-5eed0d5bf6e8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:20.379822 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:20.384723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:20.385742 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:20.386551 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7 admin admin] PATH_INFO: `/v3/projects/9ecbbff57c04458db8bb60d4f4a0cc10` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:20.390002 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ecbbff57c04458db8bb60d4f4a0cc10)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:20.400809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:20.619969 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ecbbff57c04458db8bb60d4f4a0cc10', 'request_id': 'req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:20.646425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ecbbff57c04458db8bb60d4f4a0cc10', 'request_id': 'req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:20.675005 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ecbbff57c04458db8bb60d4f4a0cc10', 'request_id': 'req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:20.742061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7 admin admin] The token cache is being invalidate because project 9ecbbff57c04458db8bb60d4f4a0cc10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:20.742600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:20.743755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:20.748574 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 871/1753] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:20 2022] DELETE /identity/v3/projects/9ecbbff57c04458db8bb60d4f4a0cc10 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:20.758888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed094e-fbb3-4abf-9489-0cff151ae406 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:20.827639 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed094e-fbb3-4abf-9489-0cff151ae406 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:21.165786 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04c469-a4f6-481c-8c87-3e589a9693ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:21.170722 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04c469-a4f6-481c-8c87-3e589a9693ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:21.172322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04c469-a4f6-481c-8c87-3e589a9693ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:21.173282 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04c469-a4f6-481c-8c87-3e589a9693ae admin admin] PATH_INFO: `/v3/users/775aaa149b7943cc94f914e8461c2ce1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:21.182694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04c469-a4f6-481c-8c87-3e589a9693ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=775aaa149b7943cc94f914e8461c2ce1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:21.194414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04c469-a4f6-481c-8c87-3e589a9693ae admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:21.321695 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:21.330759 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:21.384069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae43e3f-4050-4371-bbb8-a5c31a8451e7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:21.410397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19be0d-8143-4a7f-9d41-b39b2b8c850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:21.414985 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19be0d-8143-4a7f-9d41-b39b2b8c850e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:21.416381 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19be0d-8143-4a7f-9d41-b39b2b8c850e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:21.417393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19be0d-8143-4a7f-9d41-b39b2b8c850e admin admin] PATH_INFO: `/v3/projects/ef32fde993dd4c2bafe4d6520952aa01` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:21.420889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19be0d-8143-4a7f-9d41-b39b2b8c850e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef32fde993dd4c2bafe4d6520952aa01)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:21.432593 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19be0d-8143-4a7f-9d41-b39b2b8c850e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:21.440693 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9a04c469-a4f6-481c-8c87-3e589a9693ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '775aaa149b7943cc94f914e8461c2ce1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:21.441968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:21.483869 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9a04c469-a4f6-481c-8c87-3e589a9693ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '775aaa149b7943cc94f914e8461c2ce1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:21.483869 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9a04c469-a4f6-481c-8c87-3e589a9693ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '775aaa149b7943cc94f914e8461c2ce1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:21.483869 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9a04c469-a4f6-481c-8c87-3e589a9693ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '775aaa149b7943cc94f914e8461c2ce1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:21.543316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9a04c469-a4f6-481c-8c87-3e589a9693ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '775aaa149b7943cc94f914e8461c2ce1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:21.601125 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 883/1754] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:26:20 2022] DELETE /identity/v3/users/775aaa149b7943cc94f914e8461c2ce1 => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:21.647835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7e19be0d-8143-4a7f-9d41-b39b2b8c850e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef32fde993dd4c2bafe4d6520952aa01', 'request_id': 'req-7e19be0d-8143-4a7f-9d41-b39b2b8c850e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:21.670817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7e19be0d-8143-4a7f-9d41-b39b2b8c850e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef32fde993dd4c2bafe4d6520952aa01', 'request_id': 'req-7e19be0d-8143-4a7f-9d41-b39b2b8c850e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:21.690982 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7e19be0d-8143-4a7f-9d41-b39b2b8c850e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef32fde993dd4c2bafe4d6520952aa01', 'request_id': 'req-7e19be0d-8143-4a7f-9d41-b39b2b8c850e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:21.703354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04c469-a4f6-481c-8c87-3e589a9693ae admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:21.705040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9a04c469-a4f6-481c-8c87-3e589a9693ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:21.726933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7e19be0d-8143-4a7f-9d41-b39b2b8c850e admin admin] The token cache is being invalidate because project ef32fde993dd4c2bafe4d6520952aa01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:21.727930 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7e19be0d-8143-4a7f-9d41-b39b2b8c850e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:21.737377 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7e19be0d-8143-4a7f-9d41-b39b2b8c850e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:21.740327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 872/1755] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:21 2022] DELETE /identity/v3/projects/ef32fde993dd4c2bafe4d6520952aa01 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:21.747311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a506-ef4a-4b3b-9230-02d6694fac13 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:21.747981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a506-ef4a-4b3b-9230-02d6694fac13 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:21.748677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a506-ef4a-4b3b-9230-02d6694fac13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:21.791541 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-21e8a506-ef4a-4b3b-9230-02d6694fac13 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:21.793261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-21e8a506-ef4a-4b3b-9230-02d6694fac13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:21.902498 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04c469-a4f6-481c-8c87-3e589a9693ae admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:21.927768 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6648d-efb1-457d-891e-e5987b877d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:21.928625 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6648d-efb1-457d-891e-e5987b877d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:21.928918 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6648d-efb1-457d-891e-e5987b877d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:21.929358 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6648d-efb1-457d-891e-e5987b877d1a admin admin] PATH_INFO: `/v3/users/74acd4b9edbe42198cddb0df8ec7332c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:21.934633 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6648d-efb1-457d-891e-e5987b877d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=74acd4b9edbe42198cddb0df8ec7332c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:21.937053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6648d-efb1-457d-891e-e5987b877d1a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:21.967474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 873/1756] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:26:21.979073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:21.984363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd250e-3265-42be-93ae-dc79c873f3d5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:21.984652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd250e-3265-42be-93ae-dc79c873f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:21.985018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd250e-3265-42be-93ae-dc79c873f3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:22.051261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1bfd250e-3265-42be-93ae-dc79c873f3d5 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:22.065029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1bfd250e-3265-42be-93ae-dc79c873f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:22.089200 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-18b6648d-efb1-457d-891e-e5987b877d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74acd4b9edbe42198cddb0df8ec7332c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:22.123872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-18b6648d-efb1-457d-891e-e5987b877d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74acd4b9edbe42198cddb0df8ec7332c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:22.126411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-18b6648d-efb1-457d-891e-e5987b877d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74acd4b9edbe42198cddb0df8ec7332c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:22.130759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-18b6648d-efb1-457d-891e-e5987b877d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74acd4b9edbe42198cddb0df8ec7332c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:22.172455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-18b6648d-efb1-457d-891e-e5987b877d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74acd4b9edbe42198cddb0df8ec7332c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:22.184137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 874/1757] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:22.203307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd250e-3265-42be-93ae-dc79c873f3d5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:22.207825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 884/1758] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:26:21 2022] DELETE /identity/v3/users/74acd4b9edbe42198cddb0df8ec7332c => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:22.214672 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52cb15-7fec-46d9-b9a8-a95e28fe293b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:22.214943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52cb15-7fec-46d9-b9a8-a95e28fe293b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:22.215309 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52cb15-7fec-46d9-b9a8-a95e28fe293b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:22.256819 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd250e-3265-42be-93ae-dc79c873f3d5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:22.264145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fb52cb15-7fec-46d9-b9a8-a95e28fe293b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:22.265475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fb52cb15-7fec-46d9-b9a8-a95e28fe293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:22.444548 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 885/1759] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:22.556301 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52cb15-7fec-46d9-b9a8-a95e28fe293b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:22.558126 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fb52cb15-7fec-46d9-b9a8-a95e28fe293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:22.664185 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc1ecb-e5a5-4f37-94e8-0cb2d40587a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:22.665326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc1ecb-e5a5-4f37-94e8-0cb2d40587a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:22.665777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc1ecb-e5a5-4f37-94e8-0cb2d40587a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:22.673211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc1ecb-e5a5-4f37-94e8-0cb2d40587a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:22.674761 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc1ecb-e5a5-4f37-94e8-0cb2d40587a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:26:22.675279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc1ecb-e5a5-4f37-94e8-0cb2d40587a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:22.691352 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc1ecb-e5a5-4f37-94e8-0cb2d40587a9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:22.743612 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 875/1760] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 541 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:26:22.744710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc1ecb-e5a5-4f37-94e8-0cb2d40587a9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:22.751723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-24bc1ecb-e5a5-4f37-94e8-0cb2d40587a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:22.758672 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52cb15-7fec-46d9-b9a8-a95e28fe293b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:22.778444 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19c5fc-bfbe-490b-bd64-d64a02ffe1b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:22.783135 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19c5fc-bfbe-490b-bd64-d64a02ffe1b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:22.783135 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19c5fc-bfbe-490b-bd64-d64a02ffe1b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:22.783135 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19c5fc-bfbe-490b-bd64-d64a02ffe1b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:22.803489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc1ecb-e5a5-4f37-94e8-0cb2d40587a9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:22.815972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86227b2b-5c8d-472a-b72c-66a723ec0f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:22.820239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86227b2b-5c8d-472a-b72c-66a723ec0f94 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:22.821608 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86227b2b-5c8d-472a-b72c-66a723ec0f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:22.822630 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86227b2b-5c8d-472a-b72c-66a723ec0f94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:22.824089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19c5fc-bfbe-490b-bd64-d64a02ffe1b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:22.824669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86227b2b-5c8d-472a-b72c-66a723ec0f94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:22.830301 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19c5fc-bfbe-490b-bd64-d64a02ffe1b9 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:22.832828 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86227b2b-5c8d-472a-b72c-66a723ec0f94 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:22.873174 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 886/1761] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:26:22.938912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:23.034337 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19c5fc-bfbe-490b-bd64-d64a02ffe1b9 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:23.035104 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 876/1762] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:22 2022] POST /identity/v3/projects => generated 367 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:23.072993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19c5fc-bfbe-490b-bd64-d64a02ffe1b9 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:23.216276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:23.324863 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3667af-fa6d-4a8a-8490-2618f28c4593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:23.334067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3667af-fa6d-4a8a-8490-2618f28c4593 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:23.336808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3667af-fa6d-4a8a-8490-2618f28c4593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:23.337589 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3667af-fa6d-4a8a-8490-2618f28c4593 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:23.338630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3667af-fa6d-4a8a-8490-2618f28c4593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:23.342440 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3667af-fa6d-4a8a-8490-2618f28c4593 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:23.389395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 887/1763] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:23 2022] POST /identity/v3/users => generated 284 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:23.395415 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86227b2b-5c8d-472a-b72c-66a723ec0f94 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:23.433116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86227b2b-5c8d-472a-b72c-66a723ec0f94 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:23.460324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca4000-576a-4a4a-9839-faa57a008902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:23.463358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4000-576a-4a4a-9839-faa57a008902 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:23.463655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4000-576a-4a4a-9839-faa57a008902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:23.469573 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4000-576a-4a4a-9839-faa57a008902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:23.476270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca4000-576a-4a4a-9839-faa57a008902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:23.489535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca4000-576a-4a4a-9839-faa57a008902 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:23.518263 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 877/1764] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:23.519542 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3667af-fa6d-4a8a-8490-2618f28c4593 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:23.538783 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3667af-fa6d-4a8a-8490-2618f28c4593 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:23.550860 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343a1b2-f537-4bfa-834f-2d9a4c80394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:23.551729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343a1b2-f537-4bfa-834f-2d9a4c80394d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:23.552123 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343a1b2-f537-4bfa-834f-2d9a4c80394d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:23.552632 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343a1b2-f537-4bfa-834f-2d9a4c80394d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:23.553977 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343a1b2-f537-4bfa-834f-2d9a4c80394d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:23.563440 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343a1b2-f537-4bfa-834f-2d9a4c80394d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:23.591326 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 888/1765] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:26:23.592732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca4000-576a-4a4a-9839-faa57a008902 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:23.608170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca4000-576a-4a4a-9839-faa57a008902 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:23.626875 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd8543-6f2a-4840-8a7e-f0099382cfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:23.628158 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd8543-6f2a-4840-8a7e-f0099382cfbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:23.628582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd8543-6f2a-4840-8a7e-f0099382cfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:23.629018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd8543-6f2a-4840-8a7e-f0099382cfbf admin admin] PATH_INFO: `/v3/projects/29f0b23345204e3c9457ca80bee5c153/users/fd90cad1038a469ca4d7ece0fb252fdd/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:23.676397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd8543-6f2a-4840-8a7e-f0099382cfbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f0b23345204e3c9457ca80bee5c153, user_id=fd90cad1038a469ca4d7ece0fb252fdd, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:23.680107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd8543-6f2a-4840-8a7e-f0099382cfbf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:23.714978 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 878/1766] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:23 2022] PUT /identity/v3/projects/29f0b23345204e3c9457ca80bee5c153/users/fd90cad1038a469ca4d7ece0fb252fdd/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:23.736165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e4ae7-44f6-4b13-92a6-6e95c5a458a3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:23.736914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e4ae7-44f6-4b13-92a6-6e95c5a458a3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:23.737488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e4ae7-44f6-4b13-92a6-6e95c5a458a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:23.807780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-707e4ae7-44f6-4b13-92a6-6e95c5a458a3 None None] MFA Rules not processed for user `fd90cad1038a469ca4d7ece0fb252fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:23.811219 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-707e4ae7-44f6-4b13-92a6-6e95c5a458a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:23.863637 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bd4af-3daf-4771-8934-8d4acff2e79f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:23.864307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bd4af-3daf-4771-8934-8d4acff2e79f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:23.864856 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bd4af-3daf-4771-8934-8d4acff2e79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:23.925627 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-756bd4af-3daf-4771-8934-8d4acff2e79f None None] MFA Rules not processed for user `67dbb53f47ca406c96377408e9f893f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:23.937655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-756bd4af-3daf-4771-8934-8d4acff2e79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:24.171184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 889/1767] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:24.173895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e4ae7-44f6-4b13-92a6-6e95c5a458a3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:24.272990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 879/1768] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Jun 27 15:26:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:24.347108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bd4af-3daf-4771-8934-8d4acff2e79f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:24.349740 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-756bd4af-3daf-4771-8934-8d4acff2e79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:24.427321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bd4af-3daf-4771-8934-8d4acff2e79f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:24.468282 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f82e93-db99-415c-a488-b8fe8e244e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:24.469570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f82e93-db99-415c-a488-b8fe8e244e2d service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:24.470092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f82e93-db99-415c-a488-b8fe8e244e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:24.470615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f82e93-db99-415c-a488-b8fe8e244e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:24.539243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f82e93-db99-415c-a488-b8fe8e244e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:24.542172 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f82e93-db99-415c-a488-b8fe8e244e2d service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:24.609498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 880/1769] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:24.729042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e4ae7-44f6-4b13-92a6-6e95c5a458a3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:24.759796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed9554-a85f-4c62-84ff-b18f5cd93b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:24.760943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed9554-a85f-4c62-84ff-b18f5cd93b8d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:24.761346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed9554-a85f-4c62-84ff-b18f5cd93b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:24.761813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed9554-a85f-4c62-84ff-b18f5cd93b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:24.763131 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed9554-a85f-4c62-84ff-b18f5cd93b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:24.783207 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed9554-a85f-4c62-84ff-b18f5cd93b8d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:24.908195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 890/1770] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:24 2022] POST /identity/v3/projects => generated 369 bytes in 737 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:26:24.916082 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f82e93-db99-415c-a488-b8fe8e244e2d service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:24.980114 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f82e93-db99-415c-a488-b8fe8e244e2d service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:25.302060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a01d6-6b28-4117-96a1-3cc48d8834b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:25.306266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a01d6-6b28-4117-96a1-3cc48d8834b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:25.317641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a01d6-6b28-4117-96a1-3cc48d8834b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:25.318253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a01d6-6b28-4117-96a1-3cc48d8834b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:25.321611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a01d6-6b28-4117-96a1-3cc48d8834b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:25.337536 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a01d6-6b28-4117-96a1-3cc48d8834b2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:25.535844 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 881/1771] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:24 2022] POST /identity/v3/users => generated 291 bytes in 618 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:26:25.537910 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed9554-a85f-4c62-84ff-b18f5cd93b8d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:25.608466 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a01d6-6b28-4117-96a1-3cc48d8834b2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:25.612227 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ae9a01d6-6b28-4117-96a1-3cc48d8834b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:25.624186 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed9554-a85f-4c62-84ff-b18f5cd93b8d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:25.692412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc782a3-9432-4975-9a23-637e5b243c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:25.705401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc782a3-9432-4975-9a23-637e5b243c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:25.712718 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc782a3-9432-4975-9a23-637e5b243c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:25.716991 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc782a3-9432-4975-9a23-637e5b243c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:25.725209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a01d6-6b28-4117-96a1-3cc48d8834b2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:25.727649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc782a3-9432-4975-9a23-637e5b243c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:25.744779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc782a3-9432-4975-9a23-637e5b243c9d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:25.759503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d57d32-9d04-493e-9d8f-2ab8700ba4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:25.791897 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d57d32-9d04-493e-9d8f-2ab8700ba4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:25.792393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d57d32-9d04-493e-9d8f-2ab8700ba4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:25.792882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d57d32-9d04-493e-9d8f-2ab8700ba4f5 admin admin] PATH_INFO: `/v3/projects/ad2812d642fe40eb85a9db7a5e28eaaa` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:25.801957 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 891/1772] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:25.810618 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d57d32-9d04-493e-9d8f-2ab8700ba4f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2812d642fe40eb85a9db7a5e28eaaa)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:25.814080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc782a3-9432-4975-9a23-637e5b243c9d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:25.814994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d57d32-9d04-493e-9d8f-2ab8700ba4f5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:25.887038 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc782a3-9432-4975-9a23-637e5b243c9d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:25.928176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa7478-162a-4dc3-ae8c-559fcab93f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:25.935647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa7478-162a-4dc3-ae8c-559fcab93f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:25.937237 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa7478-162a-4dc3-ae8c-559fcab93f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:25.939022 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa7478-162a-4dc3-ae8c-559fcab93f4f admin admin] PATH_INFO: `/v3/projects/64d3542c014847049f92a37df79c77b4/users/28c2edf7730240f882e4d8594670aabc/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:26.082186 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa7478-162a-4dc3-ae8c-559fcab93f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d3542c014847049f92a37df79c77b4, user_id=28c2edf7730240f882e4d8594670aabc, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:26.087810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa7478-162a-4dc3-ae8c-559fcab93f4f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:26.100413 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:26.128627 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:26.162632 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-75d57d32-9d04-493e-9d8f-2ab8700ba4f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2812d642fe40eb85a9db7a5e28eaaa', 'request_id': 'req-75d57d32-9d04-493e-9d8f-2ab8700ba4f5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:26.186497 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 892/1773] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:25 2022] PUT /identity/v3/projects/64d3542c014847049f92a37df79c77b4/users/28c2edf7730240f882e4d8594670aabc/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:26.186755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-75d57d32-9d04-493e-9d8f-2ab8700ba4f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2812d642fe40eb85a9db7a5e28eaaa', 'request_id': 'req-75d57d32-9d04-493e-9d8f-2ab8700ba4f5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:26.195395 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-75d57d32-9d04-493e-9d8f-2ab8700ba4f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2812d642fe40eb85a9db7a5e28eaaa', 'request_id': 'req-75d57d32-9d04-493e-9d8f-2ab8700ba4f5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:26.195726 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa7478-162a-4dc3-ae8c-559fcab93f4f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:26.241206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-75d57d32-9d04-493e-9d8f-2ab8700ba4f5 admin admin] The token cache is being invalidate because project ad2812d642fe40eb85a9db7a5e28eaaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:26.241972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-75d57d32-9d04-493e-9d8f-2ab8700ba4f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:26.244236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-75d57d32-9d04-493e-9d8f-2ab8700ba4f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:26.251816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 882/1774] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:25 2022] DELETE /identity/v3/projects/ad2812d642fe40eb85a9db7a5e28eaaa => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:26:26.261625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bc843-501a-4af0-8cfe-18837bf2f82d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:26.262548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bc843-501a-4af0-8cfe-18837bf2f82d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:26.264265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bc843-501a-4af0-8cfe-18837bf2f82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:26.353962 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ff7bc843-501a-4af0-8cfe-18837bf2f82d None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:26.355716 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ff7bc843-501a-4af0-8cfe-18837bf2f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:26.807370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 883/1775] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 547 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:26.831242 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a774af4-b85f-4b1d-9cf1-0a176d3a7ff6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:26.831583 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a774af4-b85f-4b1d-9cf1-0a176d3a7ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:26.831868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a774af4-b85f-4b1d-9cf1-0a176d3a7ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:26.901424 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa7478-162a-4dc3-ae8c-559fcab93f4f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:26.910283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6a774af4-b85f-4b1d-9cf1-0a176d3a7ff6 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:26.919119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6a774af4-b85f-4b1d-9cf1-0a176d3a7ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:26.927427 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38842005-5c1f-4fda-8d5b-b1497b59a234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:26.931622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38842005-5c1f-4fda-8d5b-b1497b59a234 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:26.936127 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38842005-5c1f-4fda-8d5b-b1497b59a234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:26.938177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38842005-5c1f-4fda-8d5b-b1497b59a234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:26.940894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38842005-5c1f-4fda-8d5b-b1497b59a234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:26.950530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38842005-5c1f-4fda-8d5b-b1497b59a234 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:26.964687 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 884/1776] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:26:26.970383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a774af4-b85f-4b1d-9cf1-0a176d3a7ff6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:26.998459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a774af4-b85f-4b1d-9cf1-0a176d3a7ff6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:27.006605 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 893/1777] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 819 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:27.008056 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38842005-5c1f-4fda-8d5b-b1497b59a234 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:27.017932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-38842005-5c1f-4fda-8d5b-b1497b59a234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:27.023044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d70729-a90b-47cb-a159-b9420a867b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:27.024496 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d70729-a90b-47cb-a159-b9420a867b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:27.024496 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d70729-a90b-47cb-a159-b9420a867b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:27.024496 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d70729-a90b-47cb-a159-b9420a867b37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:27.025228 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d70729-a90b-47cb-a159-b9420a867b37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:26:27.025562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d70729-a90b-47cb-a159-b9420a867b37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:27.032358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d70729-a90b-47cb-a159-b9420a867b37 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:27.070323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38842005-5c1f-4fda-8d5b-b1497b59a234 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:27.076855 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 885/1778] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:26:27.081728 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d70729-a90b-47cb-a159-b9420a867b37 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:27.097339 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5a1ef-51ac-4336-bc8d-ed335e23707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:27.098423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5a1ef-51ac-4336-bc8d-ed335e23707b admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:27.098723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5a1ef-51ac-4336-bc8d-ed335e23707b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:27.098992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5a1ef-51ac-4336-bc8d-ed335e23707b admin admin] PATH_INFO: `/v3/projects/64d3542c014847049f92a37df79c77b4/users/28c2edf7730240f882e4d8594670aabc/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:27.120690 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d70729-a90b-47cb-a159-b9420a867b37 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:27.135025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5a1ef-51ac-4336-bc8d-ed335e23707b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d3542c014847049f92a37df79c77b4, user_id=28c2edf7730240f882e4d8594670aabc, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:27.147663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5a1ef-51ac-4336-bc8d-ed335e23707b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:27.166261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf308e-f478-4254-ac21-133da763e79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:27.182381 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf308e-f478-4254-ac21-133da763e79b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:27.183457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf308e-f478-4254-ac21-133da763e79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:27.184234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf308e-f478-4254-ac21-133da763e79b admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:27.189175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf308e-f478-4254-ac21-133da763e79b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:27.193926 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf308e-f478-4254-ac21-133da763e79b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:27.200332 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 894/1779] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:27 2022] PUT /identity/v3/projects/64d3542c014847049f92a37df79c77b4/users/28c2edf7730240f882e4d8594670aabc/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:27.220375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1884e-ec7f-4635-b6b1-ea9ed0800633 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:27.221349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1884e-ec7f-4635-b6b1-ea9ed0800633 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:27.223572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1884e-ec7f-4635-b6b1-ea9ed0800633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:27.332432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 886/1780] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:27 2022] POST /identity/v3/projects => generated 387 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:26:27.336089 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf308e-f478-4254-ac21-133da763e79b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:27.392541 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2fd1884e-ec7f-4635-b6b1-ea9ed0800633 None None] MFA Rules not processed for user `28c2edf7730240f882e4d8594670aabc`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:27.394728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2fd1884e-ec7f-4635-b6b1-ea9ed0800633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:27.704333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf308e-f478-4254-ac21-133da763e79b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:27.722689 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce9f13-d13b-4797-bf81-db455db3f6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:27.724772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce9f13-d13b-4797-bf81-db455db3f6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:27.728321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce9f13-d13b-4797-bf81-db455db3f6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:27.731589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce9f13-d13b-4797-bf81-db455db3f6e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:27.735463 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce9f13-d13b-4797-bf81-db455db3f6e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:27.738873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce9f13-d13b-4797-bf81-db455db3f6e0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:27.774403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 895/1781] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:27 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 561 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:27.814509 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1884e-ec7f-4635-b6b1-ea9ed0800633 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:27.819416 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2fd1884e-ec7f-4635-b6b1-ea9ed0800633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:27.860640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 887/1782] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:27 2022] POST /identity/v3/users => generated 294 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:27.882263 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce9f13-d13b-4797-bf81-db455db3f6e0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:27.956044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce9f13-d13b-4797-bf81-db455db3f6e0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:27.979479 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b5fce-1b80-48b2-9baa-8c665e6917a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:27.980960 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b5fce-1b80-48b2-9baa-8c665e6917a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:27.981752 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b5fce-1b80-48b2-9baa-8c665e6917a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:27.982499 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b5fce-1b80-48b2-9baa-8c665e6917a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:27.986926 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b5fce-1b80-48b2-9baa-8c665e6917a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:27.992379 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b5fce-1b80-48b2-9baa-8c665e6917a2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:28.186412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 888/1783] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:28.188038 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b5fce-1b80-48b2-9baa-8c665e6917a2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:28.226921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1884e-ec7f-4635-b6b1-ea9ed0800633 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:28.254524 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059269a0-120f-4aa8-86da-b50ffae547dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:28.255991 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059269a0-120f-4aa8-86da-b50ffae547dd service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:28.256579 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059269a0-120f-4aa8-86da-b50ffae547dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:28.257202 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059269a0-120f-4aa8-86da-b50ffae547dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:28.304541 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059269a0-120f-4aa8-86da-b50ffae547dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:28.315109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059269a0-120f-4aa8-86da-b50ffae547dd service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:28.347670 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b5fce-1b80-48b2-9baa-8c665e6917a2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:28.391339 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 896/1784] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:27 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:26:28.408539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c9a03-48b7-4126-bc20-123872039536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:28.417987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9a03-48b7-4126-bc20-123872039536 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:28.422941 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9a03-48b7-4126-bc20-123872039536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:28.423595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9a03-48b7-4126-bc20-123872039536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:28.435477 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c9a03-48b7-4126-bc20-123872039536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:28.457215 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c9a03-48b7-4126-bc20-123872039536 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:28.502447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:28.516065 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00285b-6f09-4c51-b5b1-eace571eb851 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:28.517150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00285b-6f09-4c51-b5b1-eace571eb851 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:28.517839 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00285b-6f09-4c51-b5b1-eace571eb851 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:28.521040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 897/1785] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 27 15:26:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:26:28.584953 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00285b-6f09-4c51-b5b1-eace571eb851 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:28.588844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ad00285b-6f09-4c51-b5b1-eace571eb851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:28.605958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 889/1786] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:28.611658 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c9a03-48b7-4126-bc20-123872039536 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:28.694090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c9a03-48b7-4126-bc20-123872039536 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:28.695956 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00285b-6f09-4c51-b5b1-eace571eb851 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:28.717874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47db62d-e18b-44f9-a728-bbc8c5213433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:28.725467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47db62d-e18b-44f9-a728-bbc8c5213433 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:28.726983 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47db62d-e18b-44f9-a728-bbc8c5213433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:28.727528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47db62d-e18b-44f9-a728-bbc8c5213433 admin admin] PATH_INFO: `/v3/projects/5bcc3d0c20bf43f28edbeb526d63b479/users/267314e5cb6348be80a9dd8ba0b1fa4d/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:28.735994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8117cc-5aed-4be2-b911-11efca7a5836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:28.738261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8117cc-5aed-4be2-b911-11efca7a5836 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:28.741241 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8117cc-5aed-4be2-b911-11efca7a5836 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:28.742176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8117cc-5aed-4be2-b911-11efca7a5836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:28.752613 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8e8117cc-5aed-4be2-b911-11efca7a5836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:28.789644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:28.800144 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47db62d-e18b-44f9-a728-bbc8c5213433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bcc3d0c20bf43f28edbeb526d63b479, user_id=267314e5cb6348be80a9dd8ba0b1fa4d, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:28.808613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47db62d-e18b-44f9-a728-bbc8c5213433 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:28.851143 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 890/1787] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:28 2022] PUT /identity/v3/projects/5bcc3d0c20bf43f28edbeb526d63b479/users/267314e5cb6348be80a9dd8ba0b1fa4d/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:28.852872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d304574-1a01-47ec-92d5-363bbb6f6640 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:28.857024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d304574-1a01-47ec-92d5-363bbb6f6640 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:28.857448 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d304574-1a01-47ec-92d5-363bbb6f6640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:28.935339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9d304574-1a01-47ec-92d5-363bbb6f6640 None None] MFA Rules not processed for user `267314e5cb6348be80a9dd8ba0b1fa4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:28.937121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9d304574-1a01-47ec-92d5-363bbb6f6640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:29.069407 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8117cc-5aed-4be2-b911-11efca7a5836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:29.081433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8117cc-5aed-4be2-b911-11efca7a5836 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:29.136769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 891/1788] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:29.145200 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcb8f9-8e3f-4791-96c4-669731b8a06c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:29.145521 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcb8f9-8e3f-4791-96c4-669731b8a06c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:29.145767 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcb8f9-8e3f-4791-96c4-669731b8a06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:29.205455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 898/1789] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:29.211074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8117cc-5aed-4be2-b911-11efca7a5836 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:29.218452 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e2dcb8f9-8e3f-4791-96c4-669731b8a06c None None] MFA Rules not processed for user `37a36c30e9dc472d97d762d236dd865a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:29.232395 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e2dcb8f9-8e3f-4791-96c4-669731b8a06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:29.275812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8117cc-5aed-4be2-b911-11efca7a5836 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:29.513670 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 892/1790] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 27 15:26:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:29.549876 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094734d4-6cea-4ec6-b0e2-28dfc35cea5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:29.550622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094734d4-6cea-4ec6-b0e2-28dfc35cea5b admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:29.550915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094734d4-6cea-4ec6-b0e2-28dfc35cea5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:29.551201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094734d4-6cea-4ec6-b0e2-28dfc35cea5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:29.551930 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094734d4-6cea-4ec6-b0e2-28dfc35cea5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:29.554653 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094734d4-6cea-4ec6-b0e2-28dfc35cea5b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:29.685748 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 899/1791] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:29 2022] POST /identity/v3/projects => generated 385 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:29.690793 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcb8f9-8e3f-4791-96c4-669731b8a06c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:29.712364 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcb8f9-8e3f-4791-96c4-669731b8a06c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:29.935066 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:29.964166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc8fbf-692e-483b-9ffc-18cdd3b50dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:29.967506 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc8fbf-692e-483b-9ffc-18cdd3b50dfa admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:29.968487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc8fbf-692e-483b-9ffc-18cdd3b50dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:29.969271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc8fbf-692e-483b-9ffc-18cdd3b50dfa admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:29.972777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc8fbf-692e-483b-9ffc-18cdd3b50dfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:29.979783 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc8fbf-692e-483b-9ffc-18cdd3b50dfa admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:30.115533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 893/1792] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:29 2022] POST /identity/v3/users => generated 299 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:30.117424 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094734d4-6cea-4ec6-b0e2-28dfc35cea5b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:30.176959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094734d4-6cea-4ec6-b0e2-28dfc35cea5b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:30.200447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41d5f2-1417-4f56-a75d-92bbc6762fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:30.201598 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41d5f2-1417-4f56-a75d-92bbc6762fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:30.202103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41d5f2-1417-4f56-a75d-92bbc6762fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:30.202636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41d5f2-1417-4f56-a75d-92bbc6762fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:30.205369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41d5f2-1417-4f56-a75d-92bbc6762fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:30.207643 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41d5f2-1417-4f56-a75d-92bbc6762fe7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:30.256673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 900/1793] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:30.258711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc8fbf-692e-483b-9ffc-18cdd3b50dfa admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:30.281639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc8fbf-692e-483b-9ffc-18cdd3b50dfa admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:30.309464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6b6cc-5eca-4caf-a0d7-616c35487303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:30.312281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6b6cc-5eca-4caf-a0d7-616c35487303 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:30.313242 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6b6cc-5eca-4caf-a0d7-616c35487303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:30.320367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6b6cc-5eca-4caf-a0d7-616c35487303 admin admin] PATH_INFO: `/v3/projects/72c3829852ae491fa7a8f2c0b8459d69/users/931042f37f414ec3a2f8de1ca3552aff/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:30.394471 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6b6cc-5eca-4caf-a0d7-616c35487303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c3829852ae491fa7a8f2c0b8459d69, user_id=931042f37f414ec3a2f8de1ca3552aff, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:30.409739 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6b6cc-5eca-4caf-a0d7-616c35487303 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:30.466892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 894/1794] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:30 2022] PUT /identity/v3/projects/72c3829852ae491fa7a8f2c0b8459d69/users/931042f37f414ec3a2f8de1ca3552aff/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:30.473178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41d5f2-1417-4f56-a75d-92bbc6762fe7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:30.507053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41d5f2-1417-4f56-a75d-92bbc6762fe7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:30.735001 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40b70b-431a-4ac0-bee8-7fb03a743d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:30.736209 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40b70b-431a-4ac0-bee8-7fb03a743d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:30.746385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40b70b-431a-4ac0-bee8-7fb03a743d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:30.746385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40b70b-431a-4ac0-bee8-7fb03a743d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:30.746385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40b70b-431a-4ac0-bee8-7fb03a743d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:30.746385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40b70b-431a-4ac0-bee8-7fb03a743d9a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:30.765421 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 901/1795] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:30.770724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6b6cc-5eca-4caf-a0d7-616c35487303 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:30.814976 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6b6cc-5eca-4caf-a0d7-616c35487303 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:30.839665 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091eb5b-1569-4f54-abdf-dc986d4e0840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:30.844997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091eb5b-1569-4f54-abdf-dc986d4e0840 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:30.847645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091eb5b-1569-4f54-abdf-dc986d4e0840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:30.848848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091eb5b-1569-4f54-abdf-dc986d4e0840 admin admin] PATH_INFO: `/v3/projects/72c3829852ae491fa7a8f2c0b8459d69/users/931042f37f414ec3a2f8de1ca3552aff/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:30.865889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091eb5b-1569-4f54-abdf-dc986d4e0840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c3829852ae491fa7a8f2c0b8459d69, user_id=931042f37f414ec3a2f8de1ca3552aff, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:30.879169 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091eb5b-1569-4f54-abdf-dc986d4e0840 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:30.929495 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 895/1796] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:30 2022] PUT /identity/v3/projects/72c3829852ae491fa7a8f2c0b8459d69/users/931042f37f414ec3a2f8de1ca3552aff/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:30.931306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39700bd9-7a3e-4afc-b786-e6776a1f8e5a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:30.931606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39700bd9-7a3e-4afc-b786-e6776a1f8e5a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:30.932566 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39700bd9-7a3e-4afc-b786-e6776a1f8e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:31.001362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-39700bd9-7a3e-4afc-b786-e6776a1f8e5a None None] MFA Rules not processed for user `931042f37f414ec3a2f8de1ca3552aff`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:31.007663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-39700bd9-7a3e-4afc-b786-e6776a1f8e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:31.017219 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:31.179153 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 902/1797] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:31.195212 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091eb5b-1569-4f54-abdf-dc986d4e0840 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:31.590590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091eb5b-1569-4f54-abdf-dc986d4e0840 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:31.604516 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6528c-3070-4727-ba61-3e214cffe49e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:31.605219 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6528c-3070-4727-ba61-3e214cffe49e service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:31.605501 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6528c-3070-4727-ba61-3e214cffe49e service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:31.605779 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6528c-3070-4727-ba61-3e214cffe49e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:31.633556 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6528c-3070-4727-ba61-3e214cffe49e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:31.633556 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6528c-3070-4727-ba61-3e214cffe49e service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:31.658433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 896/1798] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:26:32.863912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39700bd9-7a3e-4afc-b786-e6776a1f8e5a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:32.866884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-39700bd9-7a3e-4afc-b786-e6776a1f8e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:32.872146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6528c-3070-4727-ba61-3e214cffe49e service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:32.875139 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8ed6528c-3070-4727-ba61-3e214cffe49e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:33.087740 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6528c-3070-4727-ba61-3e214cffe49e service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:33.109095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080802f-0fc1-4f66-9583-04568c36cae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:33.110143 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080802f-0fc1-4f66-9583-04568c36cae4 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:33.110717 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080802f-0fc1-4f66-9583-04568c36cae4 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:33.111202 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080802f-0fc1-4f66-9583-04568c36cae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:33.137034 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080802f-0fc1-4f66-9583-04568c36cae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:33.139753 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080802f-0fc1-4f66-9583-04568c36cae4 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:33.200026 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 897/1799] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:33.200783 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39700bd9-7a3e-4afc-b786-e6776a1f8e5a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:33.233340 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:33.237205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:33.237529 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:33.237824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2 admin admin] PATH_INFO: `/v3/projects/cdf0be5462984a72917f38353c188447` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:33.250345 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf0be5462984a72917f38353c188447)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:33.261306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:33.545372 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf0be5462984a72917f38353c188447', 'request_id': 'req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:33.563552 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf0be5462984a72917f38353c188447', 'request_id': 'req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:33.576562 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf0be5462984a72917f38353c188447', 'request_id': 'req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:33.609638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2 admin admin] The token cache is being invalidate because project cdf0be5462984a72917f38353c188447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:33.610378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:33.611901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:33.616417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 903/1800] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:32 2022] DELETE /identity/v3/projects/cdf0be5462984a72917f38353c188447 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:33.620783 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080802f-0fc1-4f66-9583-04568c36cae4 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:33.650456 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080802f-0fc1-4f66-9583-04568c36cae4 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:33.779477 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:33.804532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:33.806404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:33.865223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b101f95-9301-466b-ade3-ab2d1c1cd0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:33.867564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b101f95-9301-466b-ade3-ab2d1c1cd0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:33.868074 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b101f95-9301-466b-ade3-ab2d1c1cd0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:33.868633 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b101f95-9301-466b-ade3-ab2d1c1cd0f0 admin admin] PATH_INFO: `/v3/users/25e362597fae47e48e7bb2b9043af892` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:33.871758 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b101f95-9301-466b-ade3-ab2d1c1cd0f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e362597fae47e48e7bb2b9043af892)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:33.881688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b101f95-9301-466b-ade3-ab2d1c1cd0f0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:33.910600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:33.984153 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef81089-f85e-49fd-8be4-8e2a3dba6df2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:34.017329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e219c67-c401-428d-8f93-ba6f419852a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:34.021165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e219c67-c401-428d-8f93-ba6f419852a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:34.023107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e219c67-c401-428d-8f93-ba6f419852a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:34.024733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e219c67-c401-428d-8f93-ba6f419852a3 admin admin] PATH_INFO: `/v3/users/267314e5cb6348be80a9dd8ba0b1fa4d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:34.027204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e219c67-c401-428d-8f93-ba6f419852a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=267314e5cb6348be80a9dd8ba0b1fa4d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:34.030305 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e219c67-c401-428d-8f93-ba6f419852a3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:34.035777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2b101f95-9301-466b-ade3-ab2d1c1cd0f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e362597fae47e48e7bb2b9043af892'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:34.050792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2b101f95-9301-466b-ade3-ab2d1c1cd0f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e362597fae47e48e7bb2b9043af892'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:34.068193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2b101f95-9301-466b-ade3-ab2d1c1cd0f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e362597fae47e48e7bb2b9043af892'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:34.069989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2b101f95-9301-466b-ade3-ab2d1c1cd0f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e362597fae47e48e7bb2b9043af892'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:34.105965 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2b101f95-9301-466b-ade3-ab2d1c1cd0f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e362597fae47e48e7bb2b9043af892'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:34.145578 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 898/1801] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:26:33 2022] DELETE /identity/v3/users/25e362597fae47e48e7bb2b9043af892 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:34.169204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8e219c67-c401-428d-8f93-ba6f419852a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267314e5cb6348be80a9dd8ba0b1fa4d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:34.226959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8e219c67-c401-428d-8f93-ba6f419852a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267314e5cb6348be80a9dd8ba0b1fa4d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:34.230571 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8e219c67-c401-428d-8f93-ba6f419852a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267314e5cb6348be80a9dd8ba0b1fa4d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:34.232928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8e219c67-c401-428d-8f93-ba6f419852a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267314e5cb6348be80a9dd8ba0b1fa4d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:34.304166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8e219c67-c401-428d-8f93-ba6f419852a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267314e5cb6348be80a9dd8ba0b1fa4d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:34.351543 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 904/1802] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:26:33 2022] DELETE /identity/v3/users/267314e5cb6348be80a9dd8ba0b1fa4d => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:26:34.353838 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f42389-629c-4066-8234-b7e91181e8c7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:34.354138 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f42389-629c-4066-8234-b7e91181e8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:34.354467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f42389-629c-4066-8234-b7e91181e8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:34.476041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-16f42389-629c-4066-8234-b7e91181e8c7 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:34.479969 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-16f42389-629c-4066-8234-b7e91181e8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:34.647292 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea6c5b-9997-4c63-839d-2a573559eb07 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:34.647710 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea6c5b-9997-4c63-839d-2a573559eb07 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:34.648194 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea6c5b-9997-4c63-839d-2a573559eb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:34.764438 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-88ea6c5b-9997-4c63-839d-2a573559eb07 None None] MFA Rules not processed for user `38077d8c653b4752814a0c200eb2a713`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:34.773259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-88ea6c5b-9997-4c63-839d-2a573559eb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:34.978744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 899/1803] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 626 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:35.188516 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f42389-629c-4066-8234-b7e91181e8c7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:35.196337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-16f42389-629c-4066-8234-b7e91181e8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:35.277630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 905/1804] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 632 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:26:35.564795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f42389-629c-4066-8234-b7e91181e8c7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:35.591678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41ff0c-9bd4-4a00-b3f6-42782d89e276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:35.597711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41ff0c-9bd4-4a00-b3f6-42782d89e276 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:35.599219 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41ff0c-9bd4-4a00-b3f6-42782d89e276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:35.602346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41ff0c-9bd4-4a00-b3f6-42782d89e276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:35.681602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41ff0c-9bd4-4a00-b3f6-42782d89e276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:35.687346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41ff0c-9bd4-4a00-b3f6-42782d89e276 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:35.729857 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:35.788994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba721831-2bc3-4c62-8f2d-78f0c3e47d6c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:35.789763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba721831-2bc3-4c62-8f2d-78f0c3e47d6c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:35.791282 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba721831-2bc3-4c62-8f2d-78f0c3e47d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:35.807836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 900/1805] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:35.870019 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ba721831-2bc3-4c62-8f2d-78f0c3e47d6c None None] MFA Rules not processed for user `202e415e386e4abe8c70a9889448eb02`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:35.876380 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ba721831-2bc3-4c62-8f2d-78f0c3e47d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:36.011393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:36.032103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 906/1806] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:36.386700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41ff0c-9bd4-4a00-b3f6-42782d89e276 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:36.389722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0d41ff0c-9bd4-4a00-b3f6-42782d89e276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:36.476986 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41ff0c-9bd4-4a00-b3f6-42782d89e276 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:36.511190 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5f97c-4785-4399-8f70-5ec3d2040ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:36.513733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5f97c-4785-4399-8f70-5ec3d2040ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:36.517638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5f97c-4785-4399-8f70-5ec3d2040ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:36.518564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5f97c-4785-4399-8f70-5ec3d2040ec8 admin admin] PATH_INFO: `/v3/users/fd90cad1038a469ca4d7ece0fb252fdd` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:36.521478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5f97c-4785-4399-8f70-5ec3d2040ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd90cad1038a469ca4d7ece0fb252fdd)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:36.528324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5f97c-4785-4399-8f70-5ec3d2040ec8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:36.597307 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba721831-2bc3-4c62-8f2d-78f0c3e47d6c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:36.601409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ba721831-2bc3-4c62-8f2d-78f0c3e47d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:36.621539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba721831-2bc3-4c62-8f2d-78f0c3e47d6c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:36.635848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c617a-b2ff-4f89-a480-e1a6018e22b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:36.637402 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c617a-b2ff-4f89-a480-e1a6018e22b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:36.637983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c617a-b2ff-4f89-a480-e1a6018e22b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:36.638396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c617a-b2ff-4f89-a480-e1a6018e22b2 admin admin] PATH_INFO: `/v3/projects/fe61cdd386ef460d971c8de587a8e6fc` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:36.640100 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c617a-b2ff-4f89-a480-e1a6018e22b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe61cdd386ef460d971c8de587a8e6fc)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:36.642758 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c617a-b2ff-4f89-a480-e1a6018e22b2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:36.715937 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-20d5f97c-4785-4399-8f70-5ec3d2040ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd90cad1038a469ca4d7ece0fb252fdd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:36.742869 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-20d5f97c-4785-4399-8f70-5ec3d2040ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd90cad1038a469ca4d7ece0fb252fdd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:36.770948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-20d5f97c-4785-4399-8f70-5ec3d2040ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd90cad1038a469ca4d7ece0fb252fdd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:36.772648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-20d5f97c-4785-4399-8f70-5ec3d2040ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd90cad1038a469ca4d7ece0fb252fdd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:36.784772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-455c617a-b2ff-4f89-a480-e1a6018e22b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe61cdd386ef460d971c8de587a8e6fc', 'request_id': 'req-455c617a-b2ff-4f89-a480-e1a6018e22b2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:36.804235 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-455c617a-b2ff-4f89-a480-e1a6018e22b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe61cdd386ef460d971c8de587a8e6fc', 'request_id': 'req-455c617a-b2ff-4f89-a480-e1a6018e22b2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:36.807440 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-20d5f97c-4785-4399-8f70-5ec3d2040ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd90cad1038a469ca4d7ece0fb252fdd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:36.812603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-455c617a-b2ff-4f89-a480-e1a6018e22b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe61cdd386ef460d971c8de587a8e6fc', 'request_id': 'req-455c617a-b2ff-4f89-a480-e1a6018e22b2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:36.824579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 901/1807] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:26:36 2022] DELETE /identity/v3/users/fd90cad1038a469ca4d7ece0fb252fdd => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:36.833753 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e170eed-e000-4b20-a3fd-3f8ad8530957 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:36.834320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e170eed-e000-4b20-a3fd-3f8ad8530957 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:36.834852 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e170eed-e000-4b20-a3fd-3f8ad8530957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:36.862802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-455c617a-b2ff-4f89-a480-e1a6018e22b2 admin admin] The token cache is being invalidate because project fe61cdd386ef460d971c8de587a8e6fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:36.863146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-455c617a-b2ff-4f89-a480-e1a6018e22b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:36.863866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-455c617a-b2ff-4f89-a480-e1a6018e22b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:36.866650 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 907/1808] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:36 2022] DELETE /identity/v3/projects/fe61cdd386ef460d971c8de587a8e6fc => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:26:36.872024 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c617a-b2ff-4f89-a480-e1a6018e22b2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:36.873415 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4e170eed-e000-4b20-a3fd-3f8ad8530957 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:36.873593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-455c617a-b2ff-4f89-a480-e1a6018e22b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:36.877649 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4e170eed-e000-4b20-a3fd-3f8ad8530957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:37.030192 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c617a-b2ff-4f89-a480-e1a6018e22b2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:37.144039 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 902/1809] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:37.146747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfa8fd-3af0-4aa3-a9d9-b50bcfdda131 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:37.147310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfa8fd-3af0-4aa3-a9d9-b50bcfdda131 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:37.147793 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfa8fd-3af0-4aa3-a9d9-b50bcfdda131 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:37.154352 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 903/1810] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 27 15:26:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:26:37.193203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d9cc7-eb20-4415-a147-bdcdcbb69310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:37.195164 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d9cc7-eb20-4415-a147-bdcdcbb69310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:37.195939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d9cc7-eb20-4415-a147-bdcdcbb69310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:37.196636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d9cc7-eb20-4415-a147-bdcdcbb69310 admin admin] PATH_INFO: `/v3/users/310166446b8f4db2a9156b3edc9f3246` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:37.198971 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfa8fd-3af0-4aa3-a9d9-b50bcfdda131 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:37.199712 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d9cc7-eb20-4415-a147-bdcdcbb69310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=310166446b8f4db2a9156b3edc9f3246)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:37.201463 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6bcfa8fd-3af0-4aa3-a9d9-b50bcfdda131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:37.204961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d9cc7-eb20-4415-a147-bdcdcbb69310 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:37.302633 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:37.346895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7f4d9cc7-eb20-4415-a147-bdcdcbb69310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '310166446b8f4db2a9156b3edc9f3246'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:37.374991 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7f4d9cc7-eb20-4415-a147-bdcdcbb69310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '310166446b8f4db2a9156b3edc9f3246'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:37.376262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7f4d9cc7-eb20-4415-a147-bdcdcbb69310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '310166446b8f4db2a9156b3edc9f3246'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:37.377285 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7f4d9cc7-eb20-4415-a147-bdcdcbb69310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '310166446b8f4db2a9156b3edc9f3246'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:37.438863 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7f4d9cc7-eb20-4415-a147-bdcdcbb69310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '310166446b8f4db2a9156b3edc9f3246'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:37.482240 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfa8fd-3af0-4aa3-a9d9-b50bcfdda131 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:37.499921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 908/1811] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:26:36 2022] DELETE /identity/v3/users/310166446b8f4db2a9156b3edc9f3246 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:26:37.503763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf6110-f34d-40e5-bd2d-9d5b383657ad None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:37.504091 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf6110-f34d-40e5-bd2d-9d5b383657ad None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:37.504346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf6110-f34d-40e5-bd2d-9d5b383657ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:37.505310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e3391-84fd-4127-90d4-403cc86ad1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:37.507847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e3391-84fd-4127-90d4-403cc86ad1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:37.508756 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e3391-84fd-4127-90d4-403cc86ad1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:37.509643 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e3391-84fd-4127-90d4-403cc86ad1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:37.513306 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fc1e3391-84fd-4127-90d4-403cc86ad1c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:37.542666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e3391-84fd-4127-90d4-403cc86ad1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:37.545933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e3391-84fd-4127-90d4-403cc86ad1c9 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:37.571190 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 904/1812] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:26:37.572932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e3391-84fd-4127-90d4-403cc86ad1c9 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:37.578654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fc1e3391-84fd-4127-90d4-403cc86ad1c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:37.606337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e3391-84fd-4127-90d4-403cc86ad1c9 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:37.627232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:37.648176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-41bf6110-f34d-40e5-bd2d-9d5b383657ad None None] MFA Rules not processed for user `37a36c30e9dc472d97d762d236dd865a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:37.656655 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-41bf6110-f34d-40e5-bd2d-9d5b383657ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:37.793664 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145acdf-0b0f-4d63-bf57-da29f6f83709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:37.800693 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145acdf-0b0f-4d63-bf57-da29f6f83709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:37.801539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145acdf-0b0f-4d63-bf57-da29f6f83709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:37.801692 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145acdf-0b0f-4d63-bf57-da29f6f83709 admin admin] PATH_INFO: `/v3/projects/5bcc3d0c20bf43f28edbeb526d63b479` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:37.806894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145acdf-0b0f-4d63-bf57-da29f6f83709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bcc3d0c20bf43f28edbeb526d63b479)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:37.814389 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145acdf-0b0f-4d63-bf57-da29f6f83709 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:38.029148 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 909/1813] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 27 15:26:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:38.045379 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f145acdf-0b0f-4d63-bf57-da29f6f83709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bcc3d0c20bf43f28edbeb526d63b479', 'request_id': 'req-f145acdf-0b0f-4d63-bf57-da29f6f83709'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:38.069485 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f145acdf-0b0f-4d63-bf57-da29f6f83709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bcc3d0c20bf43f28edbeb526d63b479', 'request_id': 'req-f145acdf-0b0f-4d63-bf57-da29f6f83709'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:38.084635 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f145acdf-0b0f-4d63-bf57-da29f6f83709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bcc3d0c20bf43f28edbeb526d63b479', 'request_id': 'req-f145acdf-0b0f-4d63-bf57-da29f6f83709'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:38.118096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f145acdf-0b0f-4d63-bf57-da29f6f83709 admin admin] The token cache is being invalidate because project 5bcc3d0c20bf43f28edbeb526d63b479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:38.118485 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f145acdf-0b0f-4d63-bf57-da29f6f83709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:38.120920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f145acdf-0b0f-4d63-bf57-da29f6f83709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:38.130856 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 905/1814] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:37 2022] DELETE /identity/v3/projects/5bcc3d0c20bf43f28edbeb526d63b479 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:38.131039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf6110-f34d-40e5-bd2d-9d5b383657ad None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:38.162769 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf6110-f34d-40e5-bd2d-9d5b383657ad None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:38.323540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bd948-c15f-4c1a-834b-4d17bf45cf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:38.325123 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bd948-c15f-4c1a-834b-4d17bf45cf36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:38.325606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bd948-c15f-4c1a-834b-4d17bf45cf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:38.326124 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bd948-c15f-4c1a-834b-4d17bf45cf36 admin admin] PATH_INFO: `/v3/users/931042f37f414ec3a2f8de1ca3552aff` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:38.328862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bd948-c15f-4c1a-834b-4d17bf45cf36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=931042f37f414ec3a2f8de1ca3552aff)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:38.333960 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bd948-c15f-4c1a-834b-4d17bf45cf36 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:38.451115 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:38.457278 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fc3bd948-c15f-4c1a-834b-4d17bf45cf36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931042f37f414ec3a2f8de1ca3552aff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:38.481686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fc3bd948-c15f-4c1a-834b-4d17bf45cf36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931042f37f414ec3a2f8de1ca3552aff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:38.483649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fc3bd948-c15f-4c1a-834b-4d17bf45cf36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931042f37f414ec3a2f8de1ca3552aff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:38.485808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fc3bd948-c15f-4c1a-834b-4d17bf45cf36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931042f37f414ec3a2f8de1ca3552aff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:38.521501 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fc3bd948-c15f-4c1a-834b-4d17bf45cf36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931042f37f414ec3a2f8de1ca3552aff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:38.561499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 910/1815] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:26:38 2022] DELETE /identity/v3/users/931042f37f414ec3a2f8de1ca3552aff => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:39.274246 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145acdf-0b0f-4d63-bf57-da29f6f83709 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:39.276964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f145acdf-0b0f-4d63-bf57-da29f6f83709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:39.305356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145acdf-0b0f-4d63-bf57-da29f6f83709 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:39.339661 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bd948-c15f-4c1a-834b-4d17bf45cf36 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:39.350335 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fc3bd948-c15f-4c1a-834b-4d17bf45cf36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:39.466066 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bd948-c15f-4c1a-834b-4d17bf45cf36 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:39.472971 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f7c05-4272-403a-a0fe-e71459fbd7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:39.475928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f7c05-4272-403a-a0fe-e71459fbd7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:39.478715 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f7c05-4272-403a-a0fe-e71459fbd7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:39.479197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f7c05-4272-403a-a0fe-e71459fbd7dc admin admin] PATH_INFO: `/v3/projects/29f0b23345204e3c9457ca80bee5c153` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:39.481561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f7c05-4272-403a-a0fe-e71459fbd7dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f0b23345204e3c9457ca80bee5c153)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:39.484669 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f7c05-4272-403a-a0fe-e71459fbd7dc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:39.607773 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-be3f7c05-4272-403a-a0fe-e71459fbd7dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f0b23345204e3c9457ca80bee5c153', 'request_id': 'req-be3f7c05-4272-403a-a0fe-e71459fbd7dc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:39.620432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dfa78-2e07-45fb-8141-db3197e47d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:39.625536 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dfa78-2e07-45fb-8141-db3197e47d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:39.625829 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dfa78-2e07-45fb-8141-db3197e47d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:39.630619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dfa78-2e07-45fb-8141-db3197e47d15 admin admin] PATH_INFO: `/v3/projects/77a2075311454b5f9f7a6226770771cd` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:39.636169 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135dfa78-2e07-45fb-8141-db3197e47d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a2075311454b5f9f7a6226770771cd)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:39.638250 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135dfa78-2e07-45fb-8141-db3197e47d15 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:39.640575 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-be3f7c05-4272-403a-a0fe-e71459fbd7dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f0b23345204e3c9457ca80bee5c153', 'request_id': 'req-be3f7c05-4272-403a-a0fe-e71459fbd7dc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:39.661909 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-be3f7c05-4272-403a-a0fe-e71459fbd7dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f0b23345204e3c9457ca80bee5c153', 'request_id': 'req-be3f7c05-4272-403a-a0fe-e71459fbd7dc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:39.684773 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-be3f7c05-4272-403a-a0fe-e71459fbd7dc admin admin] The token cache is being invalidate because project 29f0b23345204e3c9457ca80bee5c153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:39.685149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-be3f7c05-4272-403a-a0fe-e71459fbd7dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:39.686255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-be3f7c05-4272-403a-a0fe-e71459fbd7dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:39.693181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 911/1816] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:39 2022] DELETE /identity/v3/projects/29f0b23345204e3c9457ca80bee5c153 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:39.696244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f7c05-4272-403a-a0fe-e71459fbd7dc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:39.703577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-be3f7c05-4272-403a-a0fe-e71459fbd7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:39.766040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:39.772160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-135dfa78-2e07-45fb-8141-db3197e47d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a2075311454b5f9f7a6226770771cd', 'request_id': 'req-135dfa78-2e07-45fb-8141-db3197e47d15'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:39.800076 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-135dfa78-2e07-45fb-8141-db3197e47d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a2075311454b5f9f7a6226770771cd', 'request_id': 'req-135dfa78-2e07-45fb-8141-db3197e47d15'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:39.809265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-135dfa78-2e07-45fb-8141-db3197e47d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a2075311454b5f9f7a6226770771cd', 'request_id': 'req-135dfa78-2e07-45fb-8141-db3197e47d15'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:39.854871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-135dfa78-2e07-45fb-8141-db3197e47d15 admin admin] The token cache is being invalidate because project 77a2075311454b5f9f7a6226770771cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:39.854871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-135dfa78-2e07-45fb-8141-db3197e47d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:39.857586 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-135dfa78-2e07-45fb-8141-db3197e47d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:39.861436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 906/1817] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:39 2022] DELETE /identity/v3/projects/77a2075311454b5f9f7a6226770771cd => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:39.862457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dfa78-2e07-45fb-8141-db3197e47d15 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:39.863981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-135dfa78-2e07-45fb-8141-db3197e47d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:39.872102 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:39.910734 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f7c05-4272-403a-a0fe-e71459fbd7dc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:40.124826 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dfa78-2e07-45fb-8141-db3197e47d15 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:40.149274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e7310-1041-4368-b57f-8709e4eed569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:40.153512 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e7310-1041-4368-b57f-8709e4eed569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:40.155921 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e7310-1041-4368-b57f-8709e4eed569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:40.156634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e7310-1041-4368-b57f-8709e4eed569 admin admin] PATH_INFO: `/v3/users/28c2edf7730240f882e4d8594670aabc` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:40.159644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e7310-1041-4368-b57f-8709e4eed569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c2edf7730240f882e4d8594670aabc)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:40.167080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e7310-1041-4368-b57f-8709e4eed569 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:40.240528 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a14387-a197-4231-8465-3ca37645576f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:40.241647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a14387-a197-4231-8465-3ca37645576f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:40.241939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a14387-a197-4231-8465-3ca37645576f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:40.242271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a14387-a197-4231-8465-3ca37645576f admin admin] PATH_INFO: `/v3/projects/72c3829852ae491fa7a8f2c0b8459d69` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:40.247686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a14387-a197-4231-8465-3ca37645576f admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c3829852ae491fa7a8f2c0b8459d69)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:40.249791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a14387-a197-4231-8465-3ca37645576f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:40.374932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-21a14387-a197-4231-8465-3ca37645576f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c3829852ae491fa7a8f2c0b8459d69', 'request_id': 'req-21a14387-a197-4231-8465-3ca37645576f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:40.377281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-694e7310-1041-4368-b57f-8709e4eed569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c2edf7730240f882e4d8594670aabc'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:40.390358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-694e7310-1041-4368-b57f-8709e4eed569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c2edf7730240f882e4d8594670aabc'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:40.402264 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-21a14387-a197-4231-8465-3ca37645576f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c3829852ae491fa7a8f2c0b8459d69', 'request_id': 'req-21a14387-a197-4231-8465-3ca37645576f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:40.413395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-21a14387-a197-4231-8465-3ca37645576f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c3829852ae491fa7a8f2c0b8459d69', 'request_id': 'req-21a14387-a197-4231-8465-3ca37645576f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:40.415067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-694e7310-1041-4368-b57f-8709e4eed569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c2edf7730240f882e4d8594670aabc'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:40.415901 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-694e7310-1041-4368-b57f-8709e4eed569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c2edf7730240f882e4d8594670aabc'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:40.446451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-21a14387-a197-4231-8465-3ca37645576f admin admin] The token cache is being invalidate because project 72c3829852ae491fa7a8f2c0b8459d69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:40.446954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-21a14387-a197-4231-8465-3ca37645576f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:40.449581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-21a14387-a197-4231-8465-3ca37645576f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:40.453241 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 912/1818] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:39 2022] DELETE /identity/v3/projects/72c3829852ae491fa7a8f2c0b8459d69 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:40.455629 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-694e7310-1041-4368-b57f-8709e4eed569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c2edf7730240f882e4d8594670aabc'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:40.456780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c858a3-565a-4907-8331-2af1cca0fc04 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:40.457437 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c858a3-565a-4907-8331-2af1cca0fc04 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:40.457794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c858a3-565a-4907-8331-2af1cca0fc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:40.498928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 907/1819] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:26:39 2022] DELETE /identity/v3/users/28c2edf7730240f882e4d8594670aabc => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:40.507679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e4c858a3-565a-4907-8331-2af1cca0fc04 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:40.509670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e4c858a3-565a-4907-8331-2af1cca0fc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:40.521348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac64484-6048-488e-8997-df9b81b8894c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:40.525045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac64484-6048-488e-8997-df9b81b8894c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:40.525939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac64484-6048-488e-8997-df9b81b8894c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:40.672354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2ac64484-6048-488e-8997-df9b81b8894c None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:40.678020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2ac64484-6048-488e-8997-df9b81b8894c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:40.862938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:40.886851 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 908/1820] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:40.894964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbeb8d7-5f51-4e80-940d-813f34f0d42f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:40.895261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbeb8d7-5f51-4e80-940d-813f34f0d42f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:40.895644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbeb8d7-5f51-4e80-940d-813f34f0d42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:40.956124 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-edbeb8d7-5f51-4e80-940d-813f34f0d42f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:40.960887 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 913/1821] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:40.962080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a53328-b190-4660-916f-177ed6e47936 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:40.962421 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a53328-b190-4660-916f-177ed6e47936 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:40.962682 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a53328-b190-4660-916f-177ed6e47936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:40.973821 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-edbeb8d7-5f51-4e80-940d-813f34f0d42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:41.004528 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c4a53328-b190-4660-916f-177ed6e47936 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:41.006026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c4a53328-b190-4660-916f-177ed6e47936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:41.012135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 909/1822] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:26:41.014976 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbeb8d7-5f51-4e80-940d-813f34f0d42f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:41.027886 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 914/1823] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:41.032342 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a53328-b190-4660-916f-177ed6e47936 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:41.041848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbeb8d7-5f51-4e80-940d-813f34f0d42f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:41.048333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba482ba7-3751-44aa-a6f1-8809ee20b273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:41.049991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba482ba7-3751-44aa-a6f1-8809ee20b273 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:41.050129 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba482ba7-3751-44aa-a6f1-8809ee20b273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:41.050425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba482ba7-3751-44aa-a6f1-8809ee20b273 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:41.051695 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba482ba7-3751-44aa-a6f1-8809ee20b273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:26:41.052599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba482ba7-3751-44aa-a6f1-8809ee20b273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:41.054898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba482ba7-3751-44aa-a6f1-8809ee20b273 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:41.058311 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a53328-b190-4660-916f-177ed6e47936 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:41.086125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 910/1824] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:26:41.087520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cafcf-241d-4584-ab9e-50916629d4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:41.087676 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba482ba7-3751-44aa-a6f1-8809ee20b273 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:41.088240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cafcf-241d-4584-ab9e-50916629d4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:41.088530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cafcf-241d-4584-ab9e-50916629d4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:41.088812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cafcf-241d-4584-ab9e-50916629d4c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:41.089580 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cafcf-241d-4584-ab9e-50916629d4c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:26:41.089895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cafcf-241d-4584-ab9e-50916629d4c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:41.091615 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cafcf-241d-4584-ab9e-50916629d4c8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:41.105194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba482ba7-3751-44aa-a6f1-8809ee20b273 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:41.121658 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684c00c-336f-4605-89a4-f0b50c58eede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:41.124544 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684c00c-336f-4605-89a4-f0b50c58eede admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:41.126356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684c00c-336f-4605-89a4-f0b50c58eede admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:41.127327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684c00c-336f-4605-89a4-f0b50c58eede admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:41.128440 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684c00c-336f-4605-89a4-f0b50c58eede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:41.131551 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684c00c-336f-4605-89a4-f0b50c58eede admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:41.141673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 915/1825] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:26:41.142638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cafcf-241d-4584-ab9e-50916629d4c8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:41.173018 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cafcf-241d-4584-ab9e-50916629d4c8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:41.184997 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bcc81-4b41-4ef2-a9e5-a8d4c80db7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:41.185811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bcc81-4b41-4ef2-a9e5-a8d4c80db7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:41.186102 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bcc81-4b41-4ef2-a9e5-a8d4c80db7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:41.186416 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bcc81-4b41-4ef2-a9e5-a8d4c80db7c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:41.187896 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bcc81-4b41-4ef2-a9e5-a8d4c80db7c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:41.189191 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bcc81-4b41-4ef2-a9e5-a8d4c80db7c4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:41.205173 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:41.241799 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 911/1826] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:41 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:41.251891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684c00c-336f-4605-89a4-f0b50c58eede admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:41.284961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 916/1827] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:41 2022] POST /identity/v3/projects => generated 393 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:41.294487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bcc81-4b41-4ef2-a9e5-a8d4c80db7c4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:41.484763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bcc81-4b41-4ef2-a9e5-a8d4c80db7c4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:41.520206 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab709b3-ee11-41e2-859a-4fe03c643ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:41.521121 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab709b3-ee11-41e2-859a-4fe03c643ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:41.521413 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab709b3-ee11-41e2-859a-4fe03c643ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:41.521697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab709b3-ee11-41e2-859a-4fe03c643ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:41.522471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab709b3-ee11-41e2-859a-4fe03c643ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:41.531690 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab709b3-ee11-41e2-859a-4fe03c643ce4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:41.578168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684c00c-336f-4605-89a4-f0b50c58eede admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:41.596543 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8400050-4578-4ab6-9257-cf2c080a4da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:41.597709 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8400050-4578-4ab6-9257-cf2c080a4da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:41.598164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8400050-4578-4ab6-9257-cf2c080a4da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:41.598639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8400050-4578-4ab6-9257-cf2c080a4da4 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:41.599941 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8400050-4578-4ab6-9257-cf2c080a4da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:41.602277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8400050-4578-4ab6-9257-cf2c080a4da4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:41.665166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 917/1828] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:41 2022] POST /identity/v3/users => generated 297 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:41.672840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab709b3-ee11-41e2-859a-4fe03c643ce4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:41.684867 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cab709b3-ee11-41e2-859a-4fe03c643ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:41.691238 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 912/1829] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:41 2022] POST /identity/v3/users => generated 292 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:41.699783 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8400050-4578-4ab6-9257-cf2c080a4da4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:41.709087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e8400050-4578-4ab6-9257-cf2c080a4da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:41.732694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab709b3-ee11-41e2-859a-4fe03c643ce4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:41.745721 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef5c0f-058a-41b6-bdba-1e1861c12e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:41.746761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef5c0f-058a-41b6-bdba-1e1861c12e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:41.747051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef5c0f-058a-41b6-bdba-1e1861c12e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:41.747409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef5c0f-058a-41b6-bdba-1e1861c12e49 admin admin] PATH_INFO: `/v3/projects/64d3542c014847049f92a37df79c77b4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:41.749591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef5c0f-058a-41b6-bdba-1e1861c12e49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d3542c014847049f92a37df79c77b4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:41.763306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef5c0f-058a-41b6-bdba-1e1861c12e49 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:41.847906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbef5c0f-058a-41b6-bdba-1e1861c12e49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d3542c014847049f92a37df79c77b4', 'request_id': 'req-bbef5c0f-058a-41b6-bdba-1e1861c12e49'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:41.866614 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbef5c0f-058a-41b6-bdba-1e1861c12e49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d3542c014847049f92a37df79c77b4', 'request_id': 'req-bbef5c0f-058a-41b6-bdba-1e1861c12e49'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:41.898583 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbef5c0f-058a-41b6-bdba-1e1861c12e49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d3542c014847049f92a37df79c77b4', 'request_id': 'req-bbef5c0f-058a-41b6-bdba-1e1861c12e49'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:41.921393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8400050-4578-4ab6-9257-cf2c080a4da4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:41.968044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbef5c0f-058a-41b6-bdba-1e1861c12e49 admin admin] The token cache is being invalidate because project 64d3542c014847049f92a37df79c77b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:41.969013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbef5c0f-058a-41b6-bdba-1e1861c12e49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:41.972639 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbef5c0f-058a-41b6-bdba-1e1861c12e49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:41.979809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 918/1830] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:41 2022] DELETE /identity/v3/projects/64d3542c014847049f92a37df79c77b4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:41.983337 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef5c0f-058a-41b6-bdba-1e1861c12e49 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:41.992517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bbef5c0f-058a-41b6-bdba-1e1861c12e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:42.107714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:42.201261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef5c0f-058a-41b6-bdba-1e1861c12e49 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:42.213103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7eb38-b66e-4995-b1ba-ce1d22135bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:42.216945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82f686-c890-4a7a-9549-c150b6452b03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:42.218152 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82f686-c890-4a7a-9549-c150b6452b03 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:42.219153 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82f686-c890-4a7a-9549-c150b6452b03 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:42.219316 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82f686-c890-4a7a-9549-c150b6452b03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:42.222664 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0a82f686-c890-4a7a-9549-c150b6452b03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:42.224777 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7eb38-b66e-4995-b1ba-ce1d22135bfe admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:42.225111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7eb38-b66e-4995-b1ba-ce1d22135bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:42.228919 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7eb38-b66e-4995-b1ba-ce1d22135bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:42.229858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7eb38-b66e-4995-b1ba-ce1d22135bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:42.240144 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7eb38-b66e-4995-b1ba-ce1d22135bfe admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:42.249381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:42.255132 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82f686-c890-4a7a-9549-c150b6452b03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:42.261044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82f686-c890-4a7a-9549-c150b6452b03 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:42.298139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 919/1831] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:42.298139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7eb38-b66e-4995-b1ba-ce1d22135bfe admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:42.301421 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 913/1832] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:42.302372 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-35b7eb38-b66e-4995-b1ba-ce1d22135bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:42.329444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9848a9-7df4-4dcd-8ec7-a90d7afdb01c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:42.330406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9848a9-7df4-4dcd-8ec7-a90d7afdb01c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:42.331072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9848a9-7df4-4dcd-8ec7-a90d7afdb01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:42.331748 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7eb38-b66e-4995-b1ba-ce1d22135bfe admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:42.350446 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32ae81-8de2-4cd3-9671-9a3dee1c1d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:42.355189 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32ae81-8de2-4cd3-9671-9a3dee1c1d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:42.355480 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32ae81-8de2-4cd3-9671-9a3dee1c1d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:42.355825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32ae81-8de2-4cd3-9671-9a3dee1c1d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:42.356518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32ae81-8de2-4cd3-9671-9a3dee1c1d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:42.370287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32ae81-8de2-4cd3-9671-9a3dee1c1d04 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:42.371461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3d9848a9-7df4-4dcd-8ec7-a90d7afdb01c None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:42.378736 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3d9848a9-7df4-4dcd-8ec7-a90d7afdb01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:42.414639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 914/1833] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:42.414841 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 920/1834] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:42.414951 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9848a9-7df4-4dcd-8ec7-a90d7afdb01c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:42.421041 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d0b96-05a3-4191-8fb1-9ee444d65e18 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:42.421485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d0b96-05a3-4191-8fb1-9ee444d65e18 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:42.425746 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d0b96-05a3-4191-8fb1-9ee444d65e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:42.456639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9848a9-7df4-4dcd-8ec7-a90d7afdb01c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:42.479041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f65ce-6fc3-48e8-947d-3f76a9720875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:42.482939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f65ce-6fc3-48e8-947d-3f76a9720875 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:42.484681 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f65ce-6fc3-48e8-947d-3f76a9720875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:42.486938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f65ce-6fc3-48e8-947d-3f76a9720875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:42.490099 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f65ce-6fc3-48e8-947d-3f76a9720875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:42.493018 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-097d0b96-05a3-4191-8fb1-9ee444d65e18 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:42.495368 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f65ce-6fc3-48e8-947d-3f76a9720875 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:42.501763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-097d0b96-05a3-4191-8fb1-9ee444d65e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:42.534294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 921/1835] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:42.538988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d0b96-05a3-4191-8fb1-9ee444d65e18 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:42.558270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 915/1836] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:42.565543 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d0b96-05a3-4191-8fb1-9ee444d65e18 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:42.574626 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f65ce-6fc3-48e8-947d-3f76a9720875 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:42.608656 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21d12c-5750-4c8f-8ec7-ae3566b31e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:42.609935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21d12c-5750-4c8f-8ec7-ae3566b31e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:42.610894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21d12c-5750-4c8f-8ec7-ae3566b31e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:42.611407 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21d12c-5750-4c8f-8ec7-ae3566b31e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:42.612438 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21d12c-5750-4c8f-8ec7-ae3566b31e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:42.615195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21d12c-5750-4c8f-8ec7-ae3566b31e10 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:42.655362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f65ce-6fc3-48e8-947d-3f76a9720875 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:42.656935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 922/1837] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:42.658143 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21d12c-5750-4c8f-8ec7-ae3566b31e10 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:42.677426 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21d12c-5750-4c8f-8ec7-ae3566b31e10 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:42.683867 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3218e4b-f63f-44d9-ac9a-5ae555ef59be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:42.684754 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3218e4b-f63f-44d9-ac9a-5ae555ef59be admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:42.685032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3218e4b-f63f-44d9-ac9a-5ae555ef59be admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:42.685313 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3218e4b-f63f-44d9-ac9a-5ae555ef59be admin admin] PATH_INFO: `/v3/projects/e6415ec32ba048d69bbb82216d27d149/users/dbd66cf5fe1e4d52bbcbd1cc7d7765a1/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:42.690171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a4fb1-aecd-4fc5-934e-2715769fa4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:42.696992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a4fb1-aecd-4fc5-934e-2715769fa4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:42.696992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a4fb1-aecd-4fc5-934e-2715769fa4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:42.696992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a4fb1-aecd-4fc5-934e-2715769fa4c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:42.702550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a4fb1-aecd-4fc5-934e-2715769fa4c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:26:42.707340 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3218e4b-f63f-44d9-ac9a-5ae555ef59be admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6415ec32ba048d69bbb82216d27d149, user_id=dbd66cf5fe1e4d52bbcbd1cc7d7765a1, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:42.708570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a4fb1-aecd-4fc5-934e-2715769fa4c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:42.711414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3218e4b-f63f-44d9-ac9a-5ae555ef59be admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:42.724700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a4fb1-aecd-4fc5-934e-2715769fa4c0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:42.738092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 923/1838] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:42 2022] PUT /identity/v3/projects/e6415ec32ba048d69bbb82216d27d149/users/dbd66cf5fe1e4d52bbcbd1cc7d7765a1/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:42.741158 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3218e4b-f63f-44d9-ac9a-5ae555ef59be admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:42.800178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 916/1839] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:26:42.801777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae7a76-d4a9-4fb2-8a0a-e6ce87e9c5bd None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:42.804297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae7a76-d4a9-4fb2-8a0a-e6ce87e9c5bd None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:42.804850 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae7a76-d4a9-4fb2-8a0a-e6ce87e9c5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:42.892437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e7ae7a76-d4a9-4fb2-8a0a-e6ce87e9c5bd None None] MFA Rules not processed for user `dbd66cf5fe1e4d52bbcbd1cc7d7765a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:42.894623 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e7ae7a76-d4a9-4fb2-8a0a-e6ce87e9c5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:42.967056 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3218e4b-f63f-44d9-ac9a-5ae555ef59be admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:42.973001 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210f560-dccd-4fe0-879c-5070986cb612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:42.973353 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210f560-dccd-4fe0-879c-5070986cb612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:42.973547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210f560-dccd-4fe0-879c-5070986cb612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:42.974160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210f560-dccd-4fe0-879c-5070986cb612 admin admin] PATH_INFO: `/v3/projects/ab30cdac5c5647ed82acf512092423ae/users/58c01000cdb54c3c9ae7541e77d6b715/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:42.994414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210f560-dccd-4fe0-879c-5070986cb612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab30cdac5c5647ed82acf512092423ae, user_id=58c01000cdb54c3c9ae7541e77d6b715, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:43.000544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210f560-dccd-4fe0-879c-5070986cb612 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:43.054588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 924/1840] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:42 2022] PUT /identity/v3/projects/ab30cdac5c5647ed82acf512092423ae/users/58c01000cdb54c3c9ae7541e77d6b715/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:43.055710 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210f560-dccd-4fe0-879c-5070986cb612 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:43.106257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 917/1841] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:43.106257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038728-c61d-4708-b43c-de9f967800a1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:43.106257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038728-c61d-4708-b43c-de9f967800a1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:43.106257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038728-c61d-4708-b43c-de9f967800a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:43.180340 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-40038728-c61d-4708-b43c-de9f967800a1 None None] MFA Rules not processed for user `58c01000cdb54c3c9ae7541e77d6b715`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:43.181784 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-40038728-c61d-4708-b43c-de9f967800a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:43.217739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210f560-dccd-4fe0-879c-5070986cb612 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:43.223577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7ee01-f4a9-4ab8-a04e-dcfb41fef729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:43.224964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7ee01-f4a9-4ab8-a04e-dcfb41fef729 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:43.225255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7ee01-f4a9-4ab8-a04e-dcfb41fef729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:43.225535 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7ee01-f4a9-4ab8-a04e-dcfb41fef729 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:43.226315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7ee01-f4a9-4ab8-a04e-dcfb41fef729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:43.228411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7ee01-f4a9-4ab8-a04e-dcfb41fef729 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:43.300129 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 925/1842] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:43 2022] POST /identity/v3/projects => generated 379 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:43.302017 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7ee01-f4a9-4ab8-a04e-dcfb41fef729 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:43.345887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 918/1843] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:43.347284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038728-c61d-4708-b43c-de9f967800a1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:43.350363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:43.374308 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038728-c61d-4708-b43c-de9f967800a1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:43.387903 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:43.477786 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7ee01-f4a9-4ab8-a04e-dcfb41fef729 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:43.495436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44a83e-e46b-432a-850a-9f035796065c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:43.496339 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44a83e-e46b-432a-850a-9f035796065c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:43.496443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44a83e-e46b-432a-850a-9f035796065c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:43.496722 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44a83e-e46b-432a-850a-9f035796065c admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:43.497459 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44a83e-e46b-432a-850a-9f035796065c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:43.499807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44a83e-e46b-432a-850a-9f035796065c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:43.502949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a83ce-bb90-4275-b5f0-b198de3677a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:43.504026 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a83ce-bb90-4275-b5f0-b198de3677a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:43.504508 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a83ce-bb90-4275-b5f0-b198de3677a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:43.504988 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a83ce-bb90-4275-b5f0-b198de3677a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:43.507817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a83ce-bb90-4275-b5f0-b198de3677a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:43.511639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a83ce-bb90-4275-b5f0-b198de3677a6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:43.565731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 926/1844] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:43 2022] POST /identity/v3/projects => generated 391 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:43.565731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44a83e-e46b-432a-850a-9f035796065c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:43.565731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3a44a83e-e46b-432a-850a-9f035796065c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:43.580777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 919/1845] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:43 2022] POST /identity/v3/users => generated 290 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:43.580777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a83ce-bb90-4275-b5f0-b198de3677a6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:43.602568 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a83ce-bb90-4275-b5f0-b198de3677a6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:43.695686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44a83e-e46b-432a-850a-9f035796065c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:43.701294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833cac3-78d4-4b58-8a06-20bf0ac94b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:43.701992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833cac3-78d4-4b58-8a06-20bf0ac94b8c service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:43.702364 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833cac3-78d4-4b58-8a06-20bf0ac94b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:43.702584 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833cac3-78d4-4b58-8a06-20bf0ac94b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:43.704144 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d0607-b212-4330-b7d9-5899df5142a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:43.705032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d0607-b212-4330-b7d9-5899df5142a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:43.705371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d0607-b212-4330-b7d9-5899df5142a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:43.705604 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d0607-b212-4330-b7d9-5899df5142a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:43.710000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d0607-b212-4330-b7d9-5899df5142a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:43.712434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d0607-b212-4330-b7d9-5899df5142a0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:43.752714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 920/1846] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:43 2022] POST /identity/v3/users => generated 302 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:43.752714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d0607-b212-4330-b7d9-5899df5142a0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:43.761464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d0607-b212-4330-b7d9-5899df5142a0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:43.767018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987098a-c3f0-439b-9b29-e9160dfff577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:43.767732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987098a-c3f0-439b-9b29-e9160dfff577 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:43.768025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987098a-c3f0-439b-9b29-e9160dfff577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:43.768309 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987098a-c3f0-439b-9b29-e9160dfff577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:43.769297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987098a-c3f0-439b-9b29-e9160dfff577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:43.773006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987098a-c3f0-439b-9b29-e9160dfff577 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:43.790296 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 921/1847] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:43.790296 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987098a-c3f0-439b-9b29-e9160dfff577 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:43.806735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987098a-c3f0-439b-9b29-e9160dfff577 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:43.809463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833cac3-78d4-4b58-8a06-20bf0ac94b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:43.813053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833cac3-78d4-4b58-8a06-20bf0ac94b8c service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:43.813711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030de0f1-5d86-4f59-bfe6-249cd3bbe240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:43.814682 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030de0f1-5d86-4f59-bfe6-249cd3bbe240 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:43.815161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030de0f1-5d86-4f59-bfe6-249cd3bbe240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:43.815441 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030de0f1-5d86-4f59-bfe6-249cd3bbe240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:43.816240 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030de0f1-5d86-4f59-bfe6-249cd3bbe240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:43.819147 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030de0f1-5d86-4f59-bfe6-249cd3bbe240 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:43.833554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 927/1848] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:43.835608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833cac3-78d4-4b58-8a06-20bf0ac94b8c service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:43.837032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 922/1849] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:43.840177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030de0f1-5d86-4f59-bfe6-249cd3bbe240 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:43.852018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030de0f1-5d86-4f59-bfe6-249cd3bbe240 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:43.858627 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0ceeb-aa51-487c-97c4-d15b6daa36bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:43.862782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0ceeb-aa51-487c-97c4-d15b6daa36bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:43.863074 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0ceeb-aa51-487c-97c4-d15b6daa36bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:43.863359 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0ceeb-aa51-487c-97c4-d15b6daa36bc admin admin] PATH_INFO: `/v3/projects/85d50ae799904467ac678384b1052053/users/0ba2132cc0824e469bbf8511ddd5a22d/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:43.885218 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833cac3-78d4-4b58-8a06-20bf0ac94b8c service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:43.910600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0ceeb-aa51-487c-97c4-d15b6daa36bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d50ae799904467ac678384b1052053, user_id=0ba2132cc0824e469bbf8511ddd5a22d, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:43.911180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d979f-5b3b-4d06-a8ce-5d5e55dd42c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:43.912918 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d979f-5b3b-4d06-a8ce-5d5e55dd42c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:43.913601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d979f-5b3b-4d06-a8ce-5d5e55dd42c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:43.913906 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0ceeb-aa51-487c-97c4-d15b6daa36bc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:43.930745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d979f-5b3b-4d06-a8ce-5d5e55dd42c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:43.938598 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d979f-5b3b-4d06-a8ce-5d5e55dd42c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:43.945359 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d979f-5b3b-4d06-a8ce-5d5e55dd42c3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:43.950411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 923/1850] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:43 2022] PUT /identity/v3/projects/85d50ae799904467ac678384b1052053/users/0ba2132cc0824e469bbf8511ddd5a22d/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:43.952079 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0ceeb-aa51-487c-97c4-d15b6daa36bc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:43.973196 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 928/1851] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:43.974826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d979f-5b3b-4d06-a8ce-5d5e55dd42c3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:43.996068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d979f-5b3b-4d06-a8ce-5d5e55dd42c3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:44.082175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:44.102430 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:44.136499 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0ceeb-aa51-487c-97c4-d15b6daa36bc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:44.137136 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb8efd-29d2-4983-9021-5a306358a47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:44.150813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb8efd-29d2-4983-9021-5a306358a47e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:44.151367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb8efd-29d2-4983-9021-5a306358a47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:44.152579 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb8efd-29d2-4983-9021-5a306358a47e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:44.154603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb8efd-29d2-4983-9021-5a306358a47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:44.157921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb8efd-29d2-4983-9021-5a306358a47e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:44.174485 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7e886-e8ef-4d7e-939b-29854bc8b3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:44.175886 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 929/1852] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:44.176635 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7e886-e8ef-4d7e-939b-29854bc8b3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:44.177395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb8efd-29d2-4983-9021-5a306358a47e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:44.177825 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7e886-e8ef-4d7e-939b-29854bc8b3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:44.178303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7e886-e8ef-4d7e-939b-29854bc8b3b7 admin admin] PATH_INFO: `/v3/users/58c01000cdb54c3c9ae7541e77d6b715` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:44.181632 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7e886-e8ef-4d7e-939b-29854bc8b3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c01000cdb54c3c9ae7541e77d6b715)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:44.189391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb8efd-29d2-4983-9021-5a306358a47e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:44.194141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7e886-e8ef-4d7e-939b-29854bc8b3b7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:44.195455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d6604-204d-4ffc-904a-f4d6fa85ee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:44.196575 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d6604-204d-4ffc-904a-f4d6fa85ee00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:44.196865 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d6604-204d-4ffc-904a-f4d6fa85ee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:44.197174 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d6604-204d-4ffc-904a-f4d6fa85ee00 admin admin] PATH_INFO: `/v3/projects/cde57c8ff35c46b2a6f29c581955881e/users/4aa93d54d70345b8838007f39aa19379/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:44.222913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d6604-204d-4ffc-904a-f4d6fa85ee00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde57c8ff35c46b2a6f29c581955881e, user_id=4aa93d54d70345b8838007f39aa19379, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:44.227506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d6604-204d-4ffc-904a-f4d6fa85ee00 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:44.251059 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 930/1853] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:44 2022] PUT /identity/v3/projects/cde57c8ff35c46b2a6f29c581955881e/users/4aa93d54d70345b8838007f39aa19379/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:44.253385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e1815-ea13-44c0-a512-3ed2c88ad98e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:44.253896 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e1815-ea13-44c0-a512-3ed2c88ad98e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:44.255828 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e1815-ea13-44c0-a512-3ed2c88ad98e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:44.258808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 931/1854] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 27 15:26:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:26:44.259856 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e1815-ea13-44c0-a512-3ed2c88ad98e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:44.382866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7da7e886-e8ef-4d7e-939b-29854bc8b3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c01000cdb54c3c9ae7541e77d6b715'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:44.394161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7da7e886-e8ef-4d7e-939b-29854bc8b3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c01000cdb54c3c9ae7541e77d6b715'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:44.408473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7da7e886-e8ef-4d7e-939b-29854bc8b3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c01000cdb54c3c9ae7541e77d6b715'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:44.410088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7da7e886-e8ef-4d7e-939b-29854bc8b3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c01000cdb54c3c9ae7541e77d6b715'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:44.475901 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7da7e886-e8ef-4d7e-939b-29854bc8b3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c01000cdb54c3c9ae7541e77d6b715'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:44.498379 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 924/1855] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:26:43 2022] DELETE /identity/v3/users/58c01000cdb54c3c9ae7541e77d6b715 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:44.499542 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e1815-ea13-44c0-a512-3ed2c88ad98e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:44.500280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b52c3-14d9-4d38-8fa9-26208aaad992 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:44.500944 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b52c3-14d9-4d38-8fa9-26208aaad992 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:44.501733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b52c3-14d9-4d38-8fa9-26208aaad992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:44.560702 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d40b52c3-14d9-4d38-8fa9-26208aaad992 None None] MFA Rules not processed for user `4aa93d54d70345b8838007f39aa19379`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:44.562648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d40b52c3-14d9-4d38-8fa9-26208aaad992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:44.717615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 925/1856] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:44.725401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042df5c4-d472-40dd-997f-0bcd373bf232 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:44.725788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042df5c4-d472-40dd-997f-0bcd373bf232 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:44.725986 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042df5c4-d472-40dd-997f-0bcd373bf232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:44.740484 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440c0dd-32e9-418b-83cb-e89d14bcac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:44.742164 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440c0dd-32e9-418b-83cb-e89d14bcac88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:44.742164 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440c0dd-32e9-418b-83cb-e89d14bcac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:44.742164 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440c0dd-32e9-418b-83cb-e89d14bcac88 admin admin] PATH_INFO: `/v3/projects/85d50ae799904467ac678384b1052053/users/0ba2132cc0824e469bbf8511ddd5a22d/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:44.749234 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440c0dd-32e9-418b-83cb-e89d14bcac88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d50ae799904467ac678384b1052053, user_id=0ba2132cc0824e469bbf8511ddd5a22d, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:44.752600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440c0dd-32e9-418b-83cb-e89d14bcac88 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:44.777111 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-042df5c4-d472-40dd-997f-0bcd373bf232 None None] MFA Rules not processed for user `37a36c30e9dc472d97d762d236dd865a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:44.779253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-042df5c4-d472-40dd-997f-0bcd373bf232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:44.792171 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 932/1857] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:44 2022] PUT /identity/v3/projects/85d50ae799904467ac678384b1052053/users/0ba2132cc0824e469bbf8511ddd5a22d/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:44.805466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a643e44-b702-4f88-ac8b-280ff99740d7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:44.805939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a643e44-b702-4f88-ac8b-280ff99740d7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:44.810867 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a643e44-b702-4f88-ac8b-280ff99740d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:44.885363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1a643e44-b702-4f88-ac8b-280ff99740d7 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:44.888877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1a643e44-b702-4f88-ac8b-280ff99740d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:44.929329 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:44.978711 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:44.986781 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 926/1858] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 27 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:44.989193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042df5c4-d472-40dd-997f-0bcd373bf232 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:44.992256 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-042df5c4-d472-40dd-997f-0bcd373bf232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:45.003789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 933/1859] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:45.006727 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fde10e-04e0-4253-920b-8bd25e697719 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:45.007295 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fde10e-04e0-4253-920b-8bd25e697719 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:45.007792 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fde10e-04e0-4253-920b-8bd25e697719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:45.020073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042df5c4-d472-40dd-997f-0bcd373bf232 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:45.026653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e66d20-32eb-491a-9685-fc0b7ea9bfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:45.027721 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e66d20-32eb-491a-9685-fc0b7ea9bfec admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:45.028148 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e66d20-32eb-491a-9685-fc0b7ea9bfec admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:45.028432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e66d20-32eb-491a-9685-fc0b7ea9bfec admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:45.029214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e66d20-32eb-491a-9685-fc0b7ea9bfec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:45.031257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e66d20-32eb-491a-9685-fc0b7ea9bfec admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:45.065176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-04fde10e-04e0-4253-920b-8bd25e697719 None None] MFA Rules not processed for user `0ba2132cc0824e469bbf8511ddd5a22d`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:45.067616 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-04fde10e-04e0-4253-920b-8bd25e697719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:45.075924 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 927/1860] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:44 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:45.075924 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e66d20-32eb-491a-9685-fc0b7ea9bfec admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:45.078352 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f3e66d20-32eb-491a-9685-fc0b7ea9bfec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:45.182344 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e66d20-32eb-491a-9685-fc0b7ea9bfec admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:45.187515 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b0255-7614-49fc-809c-fd2d6adec60d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:45.188331 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b0255-7614-49fc-809c-fd2d6adec60d service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:45.188606 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b0255-7614-49fc-809c-fd2d6adec60d service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:45.188890 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b0255-7614-49fc-809c-fd2d6adec60d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:45.241765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 934/1861] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:45.243308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fde10e-04e0-4253-920b-8bd25e697719 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:45.291040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b0255-7614-49fc-809c-fd2d6adec60d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:45.292445 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b0255-7614-49fc-809c-fd2d6adec60d service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:45.304331 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 928/1862] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:45.305478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b0255-7614-49fc-809c-fd2d6adec60d service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:45.306811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1b9b0255-7614-49fc-809c-fd2d6adec60d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:45.377337 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fde10e-04e0-4253-920b-8bd25e697719 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:45.390265 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56894cd-c758-46fd-a465-95e6f0aa2c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:45.392106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56894cd-c758-46fd-a465-95e6f0aa2c20 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:45.392834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56894cd-c758-46fd-a465-95e6f0aa2c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:45.393387 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56894cd-c758-46fd-a465-95e6f0aa2c20 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:45.395364 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56894cd-c758-46fd-a465-95e6f0aa2c20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:45.400549 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56894cd-c758-46fd-a465-95e6f0aa2c20 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:45.409082 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b0255-7614-49fc-809c-fd2d6adec60d service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:45.417305 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f00175-b4a2-4f99-bd8f-a8af49b0b2a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:45.419595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f00175-b4a2-4f99-bd8f-a8af49b0b2a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:45.420199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f00175-b4a2-4f99-bd8f-a8af49b0b2a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:45.420699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f00175-b4a2-4f99-bd8f-a8af49b0b2a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:45.435329 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f00175-b4a2-4f99-bd8f-a8af49b0b2a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:45.437509 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f00175-b4a2-4f99-bd8f-a8af49b0b2a9 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:45.462469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 935/1863] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:45 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:45.464616 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56894cd-c758-46fd-a465-95e6f0aa2c20 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:45.465156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 929/1864] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:45.495860 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56894cd-c758-46fd-a465-95e6f0aa2c20 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:45.506078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e44de-1728-4191-95c9-603c6d6de24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:45.507128 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e44de-1728-4191-95c9-603c6d6de24e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:45.507522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e44de-1728-4191-95c9-603c6d6de24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:45.507990 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e44de-1728-4191-95c9-603c6d6de24e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:45.509725 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e44de-1728-4191-95c9-603c6d6de24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:45.512894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e44de-1728-4191-95c9-603c6d6de24e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:45.533164 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 936/1865] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:45.537994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f00175-b4a2-4f99-bd8f-a8af49b0b2a9 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:45.560272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e44de-1728-4191-95c9-603c6d6de24e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:45.569444 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3a6e44de-1728-4191-95c9-603c6d6de24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:45.583029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f00175-b4a2-4f99-bd8f-a8af49b0b2a9 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:45.602127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666333e-1cb2-48c3-9996-6699ac623e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:45.604416 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666333e-1cb2-48c3-9996-6699ac623e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:45.606863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666333e-1cb2-48c3-9996-6699ac623e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:45.607945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666333e-1cb2-48c3-9996-6699ac623e9b admin admin] PATH_INFO: `/v3/projects/4569748183824751904e400af5a93095/users/4d0360844c72411f9b15e3527281d2e3/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:45.617906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e44de-1728-4191-95c9-603c6d6de24e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:45.644911 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7749907-a6eb-4ccd-95de-ffb0e9568bcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:45.646175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7749907-a6eb-4ccd-95de-ffb0e9568bcb service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:45.647898 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7749907-a6eb-4ccd-95de-ffb0e9568bcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:45.648467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7749907-a6eb-4ccd-95de-ffb0e9568bcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:45.660106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a7749907-a6eb-4ccd-95de-ffb0e9568bcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:45.667490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666333e-1cb2-48c3-9996-6699ac623e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4569748183824751904e400af5a93095, user_id=4d0360844c72411f9b15e3527281d2e3, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:45.673741 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666333e-1cb2-48c3-9996-6699ac623e9b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:45.678377 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:45.711822 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 930/1866] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:45 2022] PUT /identity/v3/projects/4569748183824751904e400af5a93095/users/4d0360844c72411f9b15e3527281d2e3/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:45.714354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666333e-1cb2-48c3-9996-6699ac623e9b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:45.720547 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2666333e-1cb2-48c3-9996-6699ac623e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:45.739162 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:45.743669 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7749907-a6eb-4ccd-95de-ffb0e9568bcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:45.746413 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7749907-a6eb-4ccd-95de-ffb0e9568bcb service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:45.776802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 937/1867] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:45.778728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7749907-a6eb-4ccd-95de-ffb0e9568bcb service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:45.812932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7749907-a6eb-4ccd-95de-ffb0e9568bcb service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:45.952868 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f616a82-02f0-4190-a741-f64c334b06b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:45.953598 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f616a82-02f0-4190-a741-f64c334b06b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:45.954624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f616a82-02f0-4190-a741-f64c334b06b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:45.954954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f616a82-02f0-4190-a741-f64c334b06b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:45.959843 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f616a82-02f0-4190-a741-f64c334b06b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:45.961843 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f616a82-02f0-4190-a741-f64c334b06b5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:45.979522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 938/1868] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:45.980744 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f616a82-02f0-4190-a741-f64c334b06b5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:45.995622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f616a82-02f0-4190-a741-f64c334b06b5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:46.001716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55abf1-d28e-48ac-a719-e59fd31117b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:46.002716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55abf1-d28e-48ac-a719-e59fd31117b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:46.003005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55abf1-d28e-48ac-a719-e59fd31117b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:46.003290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55abf1-d28e-48ac-a719-e59fd31117b7 admin admin] PATH_INFO: `/v3/projects/4569748183824751904e400af5a93095/users/4d0360844c72411f9b15e3527281d2e3/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:46.006040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55abf1-d28e-48ac-a719-e59fd31117b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4569748183824751904e400af5a93095, user_id=4d0360844c72411f9b15e3527281d2e3, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:46.010906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55abf1-d28e-48ac-a719-e59fd31117b7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:46.046470 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 939/1869] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:45 2022] PUT /identity/v3/projects/4569748183824751904e400af5a93095/users/4d0360844c72411f9b15e3527281d2e3/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:46.053333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16b83c-7222-4566-b23f-5f0d3d4c5581 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:46.053717 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16b83c-7222-4566-b23f-5f0d3d4c5581 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:46.054146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16b83c-7222-4566-b23f-5f0d3d4c5581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:46.135928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-eb16b83c-7222-4566-b23f-5f0d3d4c5581 None None] MFA Rules not processed for user `4d0360844c72411f9b15e3527281d2e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:46.137976 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-eb16b83c-7222-4566-b23f-5f0d3d4c5581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:46.292218 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666333e-1cb2-48c3-9996-6699ac623e9b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:46.387336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 940/1870] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:46.442842 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16b83c-7222-4566-b23f-5f0d3d4c5581 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:46.508595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45560cdc-8d7c-4104-a991-adf14f0b1aaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:46.509277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45560cdc-8d7c-4104-a991-adf14f0b1aaf service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:46.509567 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45560cdc-8d7c-4104-a991-adf14f0b1aaf service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:46.509859 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45560cdc-8d7c-4104-a991-adf14f0b1aaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:46.521259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45560cdc-8d7c-4104-a991-adf14f0b1aaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:46.523441 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45560cdc-8d7c-4104-a991-adf14f0b1aaf service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:46.553595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 931/1871] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 841 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:46.557817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45560cdc-8d7c-4104-a991-adf14f0b1aaf service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:46.574991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-45560cdc-8d7c-4104-a991-adf14f0b1aaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:46.757826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16b83c-7222-4566-b23f-5f0d3d4c5581 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:46.787128 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c47ce-a7ed-444f-8d5e-e84c160190e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:46.792916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c47ce-a7ed-444f-8d5e-e84c160190e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:46.793165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c47ce-a7ed-444f-8d5e-e84c160190e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:46.794284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c47ce-a7ed-444f-8d5e-e84c160190e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:46.858489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c47ce-a7ed-444f-8d5e-e84c160190e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:46.864982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c47ce-a7ed-444f-8d5e-e84c160190e1 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:46.914308 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45560cdc-8d7c-4104-a991-adf14f0b1aaf service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:46.921253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 941/1872] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:46.926056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f361cef-7f2e-458f-9333-5c58c6c54b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:46.929595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f361cef-7f2e-458f-9333-5c58c6c54b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:46.930078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f361cef-7f2e-458f-9333-5c58c6c54b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:46.930813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f361cef-7f2e-458f-9333-5c58c6c54b66 admin admin] PATH_INFO: `/v3/projects/ab30cdac5c5647ed82acf512092423ae` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:46.934197 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f361cef-7f2e-458f-9333-5c58c6c54b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab30cdac5c5647ed82acf512092423ae)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:46.940085 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f361cef-7f2e-458f-9333-5c58c6c54b66 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:46.990812 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:47.119782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1f361cef-7f2e-458f-9333-5c58c6c54b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab30cdac5c5647ed82acf512092423ae', 'request_id': 'req-1f361cef-7f2e-458f-9333-5c58c6c54b66'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:47.144704 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1f361cef-7f2e-458f-9333-5c58c6c54b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab30cdac5c5647ed82acf512092423ae', 'request_id': 'req-1f361cef-7f2e-458f-9333-5c58c6c54b66'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:47.160294 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1f361cef-7f2e-458f-9333-5c58c6c54b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab30cdac5c5647ed82acf512092423ae', 'request_id': 'req-1f361cef-7f2e-458f-9333-5c58c6c54b66'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:47.209809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1f361cef-7f2e-458f-9333-5c58c6c54b66 admin admin] The token cache is being invalidate because project ab30cdac5c5647ed82acf512092423ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:47.210200 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1f361cef-7f2e-458f-9333-5c58c6c54b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:47.214345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1f361cef-7f2e-458f-9333-5c58c6c54b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:47.219944 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 932/1873] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:46 2022] DELETE /identity/v3/projects/ab30cdac5c5647ed82acf512092423ae => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:47.232363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f9244-cc4f-4c64-9936-9ede830a26e4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:47.233057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f9244-cc4f-4c64-9936-9ede830a26e4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:47.233630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f9244-cc4f-4c64-9936-9ede830a26e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:47.269765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:47.291577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-079f9244-cc4f-4c64-9936-9ede830a26e4 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:47.306684 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-079f9244-cc4f-4c64-9936-9ede830a26e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:47.446673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 942/1874] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:47.461970 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f9753-c1a7-472f-bb57-28bc6a58db11 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:47.462910 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f9753-c1a7-472f-bb57-28bc6a58db11 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:47.463874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f9753-c1a7-472f-bb57-28bc6a58db11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:47.523990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-615f9753-c1a7-472f-bb57-28bc6a58db11 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:47.529507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-615f9753-c1a7-472f-bb57-28bc6a58db11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:47.567500 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 933/1875] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:47.573108 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f9244-cc4f-4c64-9936-9ede830a26e4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:47.606014 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f9244-cc4f-4c64-9936-9ede830a26e4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:47.634916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24a493-db6e-43b3-9ecc-f0d495bec9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:47.635820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24a493-db6e-43b3-9ecc-f0d495bec9fd admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:47.639036 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24a493-db6e-43b3-9ecc-f0d495bec9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:47.639611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24a493-db6e-43b3-9ecc-f0d495bec9fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:47.640831 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24a493-db6e-43b3-9ecc-f0d495bec9fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:26:47.643364 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24a493-db6e-43b3-9ecc-f0d495bec9fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:47.649979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24a493-db6e-43b3-9ecc-f0d495bec9fd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:47.697667 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 943/1876] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:26:47.705224 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f9753-c1a7-472f-bb57-28bc6a58db11 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:47.774188 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f9753-c1a7-472f-bb57-28bc6a58db11 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:47.816749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5ee1e-31a1-40d7-a3e7-97aaafd7a448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:47.818826 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5ee1e-31a1-40d7-a3e7-97aaafd7a448 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:47.819450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5ee1e-31a1-40d7-a3e7-97aaafd7a448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:47.820069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5ee1e-31a1-40d7-a3e7-97aaafd7a448 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:47.821608 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5ee1e-31a1-40d7-a3e7-97aaafd7a448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:47.834052 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5ee1e-31a1-40d7-a3e7-97aaafd7a448 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:47.853786 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24a493-db6e-43b3-9ecc-f0d495bec9fd admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:47.856689 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2f24a493-db6e-43b3-9ecc-f0d495bec9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:47.883233 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24a493-db6e-43b3-9ecc-f0d495bec9fd admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:47.899140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51580b-9a1f-4fcc-be34-b05ff0b94995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:47.900362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51580b-9a1f-4fcc-be34-b05ff0b94995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:47.900897 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51580b-9a1f-4fcc-be34-b05ff0b94995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:47.901317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51580b-9a1f-4fcc-be34-b05ff0b94995 admin admin] PATH_INFO: `/v3/users/4aa93d54d70345b8838007f39aa19379` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:47.916449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51580b-9a1f-4fcc-be34-b05ff0b94995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aa93d54d70345b8838007f39aa19379)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:47.919111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51580b-9a1f-4fcc-be34-b05ff0b94995 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:47.976083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 934/1877] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:47 2022] POST /identity/v3/projects => generated 371 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:47.980367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5ee1e-31a1-40d7-a3e7-97aaafd7a448 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:48.119566 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba51580b-9a1f-4fcc-be34-b05ff0b94995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aa93d54d70345b8838007f39aa19379'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:48.136930 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba51580b-9a1f-4fcc-be34-b05ff0b94995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aa93d54d70345b8838007f39aa19379'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:48.138121 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba51580b-9a1f-4fcc-be34-b05ff0b94995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aa93d54d70345b8838007f39aa19379'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:48.139652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba51580b-9a1f-4fcc-be34-b05ff0b94995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aa93d54d70345b8838007f39aa19379'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:48.186063 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba51580b-9a1f-4fcc-be34-b05ff0b94995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aa93d54d70345b8838007f39aa19379'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:48.224383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5ee1e-31a1-40d7-a3e7-97aaafd7a448 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:48.233721 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b51122-f665-4429-952f-4890f08ce47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:48.235171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b51122-f665-4429-952f-4890f08ce47c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:48.237001 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b51122-f665-4429-952f-4890f08ce47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:48.237709 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b51122-f665-4429-952f-4890f08ce47c admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:48.239195 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b51122-f665-4429-952f-4890f08ce47c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:48.243711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b51122-f665-4429-952f-4890f08ce47c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:48.250206 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 944/1878] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:26:47 2022] DELETE /identity/v3/users/4aa93d54d70345b8838007f39aa19379 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:48.256979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66c623-019d-4716-9915-a0d03b90a132 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:48.258348 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66c623-019d-4716-9915-a0d03b90a132 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:48.260593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66c623-019d-4716-9915-a0d03b90a132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:48.310259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 935/1879] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:47 2022] POST /identity/v3/users => generated 286 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:48.313115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b51122-f665-4429-952f-4890f08ce47c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:48.319281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-88b51122-f665-4429-952f-4890f08ce47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:48.345397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b51122-f665-4429-952f-4890f08ce47c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:48.347711 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ac66c623-019d-4716-9915-a0d03b90a132 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:48.350574 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ac66c623-019d-4716-9915-a0d03b90a132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:48.459867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31b0f0-4fbf-4722-ae54-634397119cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:48.461140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31b0f0-4fbf-4722-ae54-634397119cff admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:48.461440 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31b0f0-4fbf-4722-ae54-634397119cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:48.461730 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31b0f0-4fbf-4722-ae54-634397119cff admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:48.462554 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31b0f0-4fbf-4722-ae54-634397119cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:48.465015 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31b0f0-4fbf-4722-ae54-634397119cff admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:48.484225 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 936/1880] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:48.494915 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31b0f0-4fbf-4722-ae54-634397119cff admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:48.512537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:48.522282 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31b0f0-4fbf-4722-ae54-634397119cff admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:48.540301 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b42f2-5c1a-493f-84e6-9dbb2261e89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:48.551605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b42f2-5c1a-493f-84e6-9dbb2261e89f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:48.552231 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b42f2-5c1a-493f-84e6-9dbb2261e89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:48.552717 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b42f2-5c1a-493f-84e6-9dbb2261e89f admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:48.554126 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b42f2-5c1a-493f-84e6-9dbb2261e89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:48.556605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b42f2-5c1a-493f-84e6-9dbb2261e89f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:48.573185 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 945/1881] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:48.585686 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 937/1882] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:48.587621 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66c623-019d-4716-9915-a0d03b90a132 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:48.590099 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b42f2-5c1a-493f-84e6-9dbb2261e89f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:48.592637 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9f9b42f2-5c1a-493f-84e6-9dbb2261e89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:48.622635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66c623-019d-4716-9915-a0d03b90a132 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:48.641143 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dfd2d-014f-4303-afff-65c7f500249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:48.642965 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dfd2d-014f-4303-afff-65c7f500249d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:48.643276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dfd2d-014f-4303-afff-65c7f500249d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:48.643563 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dfd2d-014f-4303-afff-65c7f500249d admin admin] PATH_INFO: `/v3/projects/a45a2dd190ad4a2abe2a314993eb32e7/users/77ff2c22fc684248b9cff546e5eefd6b/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:48.654019 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:48.679900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dfd2d-014f-4303-afff-65c7f500249d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45a2dd190ad4a2abe2a314993eb32e7, user_id=77ff2c22fc684248b9cff546e5eefd6b, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:48.688013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dfd2d-014f-4303-afff-65c7f500249d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:48.718661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b42f2-5c1a-493f-84e6-9dbb2261e89f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:48.724449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 946/1883] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:48 2022] PUT /identity/v3/projects/a45a2dd190ad4a2abe2a314993eb32e7/users/77ff2c22fc684248b9cff546e5eefd6b/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:48.733565 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9679-de72-4114-b360-06527cebf8dc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:48.736308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9679-de72-4114-b360-06527cebf8dc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:48.736957 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9679-de72-4114-b360-06527cebf8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:48.819829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e5ec9679-de72-4114-b360-06527cebf8dc None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:48.824202 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e5ec9679-de72-4114-b360-06527cebf8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:48.950169 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa77c14-f888-4827-99b0-e260c9a9e347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:48.951458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa77c14-f888-4827-99b0-e260c9a9e347 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:48.952304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa77c14-f888-4827-99b0-e260c9a9e347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:48.954605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa77c14-f888-4827-99b0-e260c9a9e347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:48.983983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 947/1884] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:26:49.097041 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec9679-de72-4114-b360-06527cebf8dc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:49.114337 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec9679-de72-4114-b360-06527cebf8dc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:49.126424 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00198f9a-986e-4c40-a139-1164f000336e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:49.127522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00198f9a-986e-4c40-a139-1164f000336e service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:49.132087 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00198f9a-986e-4c40-a139-1164f000336e service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:49.132327 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00198f9a-986e-4c40-a139-1164f000336e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:49.176283 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00198f9a-986e-4c40-a139-1164f000336e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:49.183846 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00198f9a-986e-4c40-a139-1164f000336e service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:49.212712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa77c14-f888-4827-99b0-e260c9a9e347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:49.218655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa77c14-f888-4827-99b0-e260c9a9e347 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:49.237266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 948/1885] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:49.258453 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 938/1886] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:26:50.440716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00198f9a-986e-4c40-a139-1164f000336e service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:50.443777 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-00198f9a-986e-4c40-a139-1164f000336e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:50.468957 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00198f9a-986e-4c40-a139-1164f000336e service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:50.479324 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a999486-2faa-4dbb-a7be-beab35cdb7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:50.481320 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a999486-2faa-4dbb-a7be-beab35cdb7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:50.482106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a999486-2faa-4dbb-a7be-beab35cdb7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:50.483017 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a999486-2faa-4dbb-a7be-beab35cdb7d3 admin admin] PATH_INFO: `/v3/projects/cde57c8ff35c46b2a6f29c581955881e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:50.485731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a999486-2faa-4dbb-a7be-beab35cdb7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde57c8ff35c46b2a6f29c581955881e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:50.490144 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a999486-2faa-4dbb-a7be-beab35cdb7d3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:50.646350 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2a999486-2faa-4dbb-a7be-beab35cdb7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde57c8ff35c46b2a6f29c581955881e', 'request_id': 'req-2a999486-2faa-4dbb-a7be-beab35cdb7d3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:50.662538 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2a999486-2faa-4dbb-a7be-beab35cdb7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde57c8ff35c46b2a6f29c581955881e', 'request_id': 'req-2a999486-2faa-4dbb-a7be-beab35cdb7d3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:50.684974 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2a999486-2faa-4dbb-a7be-beab35cdb7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde57c8ff35c46b2a6f29c581955881e', 'request_id': 'req-2a999486-2faa-4dbb-a7be-beab35cdb7d3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:50.747059 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2a999486-2faa-4dbb-a7be-beab35cdb7d3 admin admin] The token cache is being invalidate because project cde57c8ff35c46b2a6f29c581955881e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:50.749286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2a999486-2faa-4dbb-a7be-beab35cdb7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:50.752339 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2a999486-2faa-4dbb-a7be-beab35cdb7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:50.761929 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 949/1887] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:50 2022] DELETE /identity/v3/projects/cde57c8ff35c46b2a6f29c581955881e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:50.768302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa77c14-f888-4827-99b0-e260c9a9e347 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:50.808372 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa77c14-f888-4827-99b0-e260c9a9e347 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:50.984662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ec7f5-bb55-4568-9231-bef621d29d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:50.986515 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ec7f5-bb55-4568-9231-bef621d29d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:50.987177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ec7f5-bb55-4568-9231-bef621d29d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:50.987840 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ec7f5-bb55-4568-9231-bef621d29d2c admin admin] PATH_INFO: `/v3/users/4d0360844c72411f9b15e3527281d2e3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:50.994144 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ec7f5-bb55-4568-9231-bef621d29d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d0360844c72411f9b15e3527281d2e3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:50.999618 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ec7f5-bb55-4568-9231-bef621d29d2c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:51.004181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:51.232236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-721ec7f5-bb55-4568-9231-bef621d29d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d0360844c72411f9b15e3527281d2e3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:51.248786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-721ec7f5-bb55-4568-9231-bef621d29d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d0360844c72411f9b15e3527281d2e3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:51.266634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-721ec7f5-bb55-4568-9231-bef621d29d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d0360844c72411f9b15e3527281d2e3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:51.267449 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-721ec7f5-bb55-4568-9231-bef621d29d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d0360844c72411f9b15e3527281d2e3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:51.301133 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-721ec7f5-bb55-4568-9231-bef621d29d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d0360844c72411f9b15e3527281d2e3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:51.316895 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 939/1888] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:26:50 2022] DELETE /identity/v3/users/4d0360844c72411f9b15e3527281d2e3 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:51.473016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a999486-2faa-4dbb-a7be-beab35cdb7d3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:51.476683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2a999486-2faa-4dbb-a7be-beab35cdb7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:51.531365 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a999486-2faa-4dbb-a7be-beab35cdb7d3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:51.700353 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:51.723297 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d3fc1-422f-4034-b5c7-6eebce6bb3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:51.724574 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d3fc1-422f-4034-b5c7-6eebce6bb3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:51.724784 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d3fc1-422f-4034-b5c7-6eebce6bb3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:51.725150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d3fc1-422f-4034-b5c7-6eebce6bb3e8 admin admin] PATH_INFO: `/v3/users/dbd66cf5fe1e4d52bbcbd1cc7d7765a1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:51.727684 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d3fc1-422f-4034-b5c7-6eebce6bb3e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd66cf5fe1e4d52bbcbd1cc7d7765a1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:51.740099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d3fc1-422f-4034-b5c7-6eebce6bb3e8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:51.874659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8b1d3fc1-422f-4034-b5c7-6eebce6bb3e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd66cf5fe1e4d52bbcbd1cc7d7765a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:51.901856 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8b1d3fc1-422f-4034-b5c7-6eebce6bb3e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd66cf5fe1e4d52bbcbd1cc7d7765a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:51.902518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8b1d3fc1-422f-4034-b5c7-6eebce6bb3e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd66cf5fe1e4d52bbcbd1cc7d7765a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:51.904499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8b1d3fc1-422f-4034-b5c7-6eebce6bb3e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd66cf5fe1e4d52bbcbd1cc7d7765a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:51.968619 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8b1d3fc1-422f-4034-b5c7-6eebce6bb3e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd66cf5fe1e4d52bbcbd1cc7d7765a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:52.029142 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 950/1889] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:26:51 2022] DELETE /identity/v3/users/dbd66cf5fe1e4d52bbcbd1cc7d7765a1 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:52.035689 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d8bb-6bdb-4320-aea9-51dda39037a8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:52.036913 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d8bb-6bdb-4320-aea9-51dda39037a8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:52.037663 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d8bb-6bdb-4320-aea9-51dda39037a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:52.094389 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-40b5d8bb-6bdb-4320-aea9-51dda39037a8 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:52.097019 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-40b5d8bb-6bdb-4320-aea9-51dda39037a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:52.141946 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d3fc1-422f-4034-b5c7-6eebce6bb3e8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:52.145381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8b1d3fc1-422f-4034-b5c7-6eebce6bb3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:52.324329 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 940/1890] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:52.346961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d3fc1-422f-4034-b5c7-6eebce6bb3e8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:52.355080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4661d3-fb58-471f-bea6-4bf874a83337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:52.356724 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4661d3-fb58-471f-bea6-4bf874a83337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:52.357013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4661d3-fb58-471f-bea6-4bf874a83337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:52.357358 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4661d3-fb58-471f-bea6-4bf874a83337 admin admin] PATH_INFO: `/v3/projects/4569748183824751904e400af5a93095` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:52.359049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4661d3-fb58-471f-bea6-4bf874a83337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4569748183824751904e400af5a93095)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:52.362141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4661d3-fb58-471f-bea6-4bf874a83337 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:52.408876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5d8bb-6bdb-4320-aea9-51dda39037a8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:52.411545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-40b5d8bb-6bdb-4320-aea9-51dda39037a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:52.463554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd4661d3-fb58-471f-bea6-4bf874a83337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4569748183824751904e400af5a93095', 'request_id': 'req-bd4661d3-fb58-471f-bea6-4bf874a83337'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:52.482209 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd4661d3-fb58-471f-bea6-4bf874a83337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4569748183824751904e400af5a93095', 'request_id': 'req-bd4661d3-fb58-471f-bea6-4bf874a83337'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:52.518911 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd4661d3-fb58-471f-bea6-4bf874a83337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4569748183824751904e400af5a93095', 'request_id': 'req-bd4661d3-fb58-471f-bea6-4bf874a83337'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:52.576325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd4661d3-fb58-471f-bea6-4bf874a83337 admin admin] The token cache is being invalidate because project 4569748183824751904e400af5a93095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:52.577270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd4661d3-fb58-471f-bea6-4bf874a83337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:52.578755 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd4661d3-fb58-471f-bea6-4bf874a83337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:52.582863 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 951/1891] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:52 2022] DELETE /identity/v3/projects/4569748183824751904e400af5a93095 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:52.592840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fabf1-8639-4ebd-baf1-b4b198b3099b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:52.593875 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fabf1-8639-4ebd-baf1-b4b198b3099b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:52.597466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fabf1-8639-4ebd-baf1-b4b198b3099b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:52.615691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:52.662702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-349fabf1-8639-4ebd-baf1-b4b198b3099b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:52.665502 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-349fabf1-8639-4ebd-baf1-b4b198b3099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:52.674191 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5d8bb-6bdb-4320-aea9-51dda39037a8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:52.805965 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:52.861816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907f0df-86b8-4f3b-ad1c-4fc2ed66e4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:52.862671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907f0df-86b8-4f3b-ad1c-4fc2ed66e4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:52.862963 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907f0df-86b8-4f3b-ad1c-4fc2ed66e4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:52.863296 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907f0df-86b8-4f3b-ad1c-4fc2ed66e4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:52.873605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2907f0df-86b8-4f3b-ad1c-4fc2ed66e4d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:52.916976 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 952/1892] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:52.932267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41981746-5fc4-4b3e-bb2c-121d49506fd7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:52.932788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41981746-5fc4-4b3e-bb2c-121d49506fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:52.933285 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41981746-5fc4-4b3e-bb2c-121d49506fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:52.972569 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-41981746-5fc4-4b3e-bb2c-121d49506fd7 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:52.975183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-41981746-5fc4-4b3e-bb2c-121d49506fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:52.994083 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 953/1893] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:26:53.000888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41981746-5fc4-4b3e-bb2c-121d49506fd7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:53.041302 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41981746-5fc4-4b3e-bb2c-121d49506fd7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:53.057528 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b14de-a557-4b7a-8baa-5ded74b7636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:53.061855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b14de-a557-4b7a-8baa-5ded74b7636c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:53.063481 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b14de-a557-4b7a-8baa-5ded74b7636c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:53.064020 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b14de-a557-4b7a-8baa-5ded74b7636c admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:53.066185 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b14de-a557-4b7a-8baa-5ded74b7636c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:26:53.067061 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b14de-a557-4b7a-8baa-5ded74b7636c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:53.073258 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b14de-a557-4b7a-8baa-5ded74b7636c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:53.074633 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907f0df-86b8-4f3b-ad1c-4fc2ed66e4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:53.076867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907f0df-86b8-4f3b-ad1c-4fc2ed66e4d3 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:53.090067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 941/1894] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:26:53.115166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 954/1895] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:26:53.117030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907f0df-86b8-4f3b-ad1c-4fc2ed66e4d3 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:53.131233 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907f0df-86b8-4f3b-ad1c-4fc2ed66e4d3 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:53.137121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9215fe4-300e-4c6d-b0af-26fb17aa7f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:53.138162 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9215fe4-300e-4c6d-b0af-26fb17aa7f1b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:53.138627 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9215fe4-300e-4c6d-b0af-26fb17aa7f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:53.139076 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9215fe4-300e-4c6d-b0af-26fb17aa7f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:53.139974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9215fe4-300e-4c6d-b0af-26fb17aa7f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:53.142170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9215fe4-300e-4c6d-b0af-26fb17aa7f1b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:53.185842 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 942/1896] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:53 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:53.187590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b14de-a557-4b7a-8baa-5ded74b7636c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:53.225308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b14de-a557-4b7a-8baa-5ded74b7636c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:53.425142 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdd20d-9f75-4442-a4a1-ca668bf65848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:53.425888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdd20d-9f75-4442-a4a1-ca668bf65848 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:53.426249 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdd20d-9f75-4442-a4a1-ca668bf65848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:53.426538 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdd20d-9f75-4442-a4a1-ca668bf65848 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:53.428506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdd20d-9f75-4442-a4a1-ca668bf65848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:53.430780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdd20d-9f75-4442-a4a1-ca668bf65848 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:53.483670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 955/1897] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:53 2022] POST /identity/v3/users => generated 289 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:53.487723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9215fe4-300e-4c6d-b0af-26fb17aa7f1b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:53.504526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9215fe4-300e-4c6d-b0af-26fb17aa7f1b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:53.518875 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30540efb-0ae2-4d0c-9f96-40e28d8abf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:53.519585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30540efb-0ae2-4d0c-9f96-40e28d8abf7c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:53.519874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30540efb-0ae2-4d0c-9f96-40e28d8abf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:53.520155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30540efb-0ae2-4d0c-9f96-40e28d8abf7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:53.521023 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30540efb-0ae2-4d0c-9f96-40e28d8abf7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:53.525710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30540efb-0ae2-4d0c-9f96-40e28d8abf7c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:53.558600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 943/1898] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:53.559786 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdd20d-9f75-4442-a4a1-ca668bf65848 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:53.601915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdd20d-9f75-4442-a4a1-ca668bf65848 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:53.657699 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9e997-1a7c-4e92-b812-7343a47991cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:53.658948 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9e997-1a7c-4e92-b812-7343a47991cd admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:53.668474 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9e997-1a7c-4e92-b812-7343a47991cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:53.675234 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9e997-1a7c-4e92-b812-7343a47991cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:53.679770 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9e997-1a7c-4e92-b812-7343a47991cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:53.687478 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9e997-1a7c-4e92-b812-7343a47991cd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:53.719524 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 956/1899] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:53.722903 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30540efb-0ae2-4d0c-9f96-40e28d8abf7c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:53.742386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30540efb-0ae2-4d0c-9f96-40e28d8abf7c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:53.755707 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b13812-7fa8-4780-9bf0-bee601273fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:53.756684 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b13812-7fa8-4780-9bf0-bee601273fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:53.757065 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b13812-7fa8-4780-9bf0-bee601273fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:53.757454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b13812-7fa8-4780-9bf0-bee601273fb2 admin admin] PATH_INFO: `/v3/projects/66b62eeefe504b9188233a9b238335dc/users/f3becf7959dd4579a5dea2d0f34eca5c/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:53.789683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b13812-7fa8-4780-9bf0-bee601273fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b62eeefe504b9188233a9b238335dc, user_id=f3becf7959dd4579a5dea2d0f34eca5c, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:53.792527 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b13812-7fa8-4780-9bf0-bee601273fb2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:53.826562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 944/1900] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:53 2022] PUT /identity/v3/projects/66b62eeefe504b9188233a9b238335dc/users/f3becf7959dd4579a5dea2d0f34eca5c/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:53.840528 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b8662-deb4-449b-96e8-77ef87559b22 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:53.841061 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b8662-deb4-449b-96e8-77ef87559b22 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:53.841540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b8662-deb4-449b-96e8-77ef87559b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:53.898548 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d19b8662-deb4-449b-96e8-77ef87559b22 None None] MFA Rules not processed for user `f3becf7959dd4579a5dea2d0f34eca5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:53.903010 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d19b8662-deb4-449b-96e8-77ef87559b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:53.995593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:54.050349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 957/1901] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:26:54.070358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b13812-7fa8-4780-9bf0-bee601273fb2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:54.072234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-32b13812-7fa8-4780-9bf0-bee601273fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:54.218541 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b13812-7fa8-4780-9bf0-bee601273fb2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:54.222870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f40992-a8b6-435a-8fa7-8510c1288853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:54.224085 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f40992-a8b6-435a-8fa7-8510c1288853 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:54.224261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f40992-a8b6-435a-8fa7-8510c1288853 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:54.224402 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f40992-a8b6-435a-8fa7-8510c1288853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:54.265993 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f40992-a8b6-435a-8fa7-8510c1288853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:54.268241 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f40992-a8b6-435a-8fa7-8510c1288853 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:54.298931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 945/1902] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:26:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:26:55.103954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b8662-deb4-449b-96e8-77ef87559b22 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:55.135105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d19b8662-deb4-449b-96e8-77ef87559b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:55.452291 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b8662-deb4-449b-96e8-77ef87559b22 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:55.477014 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:55.481409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:55.482100 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:55.483379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51 admin admin] PATH_INFO: `/v3/projects/e6415ec32ba048d69bbb82216d27d149` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:55.503619 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6415ec32ba048d69bbb82216d27d149)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:55.509701 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:55.741799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6415ec32ba048d69bbb82216d27d149', 'request_id': 'req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:55.763228 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6415ec32ba048d69bbb82216d27d149', 'request_id': 'req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:55.778370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6415ec32ba048d69bbb82216d27d149', 'request_id': 'req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:55.809009 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51 admin admin] The token cache is being invalidate because project e6415ec32ba048d69bbb82216d27d149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:55.809234 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:55.810026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:55.815576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 958/1903] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:55 2022] DELETE /identity/v3/projects/e6415ec32ba048d69bbb82216d27d149 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:55.817474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f40992-a8b6-435a-8fa7-8510c1288853 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:55.879265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f40992-a8b6-435a-8fa7-8510c1288853 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:55.992103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:56.103873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04881bf3-4bb1-4ed3-b779-6596abb0b3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:56.105119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04881bf3-4bb1-4ed3-b779-6596abb0b3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:56.105554 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04881bf3-4bb1-4ed3-b779-6596abb0b3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:56.106081 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04881bf3-4bb1-4ed3-b779-6596abb0b3b4 admin admin] PATH_INFO: `/v3/users/0ba2132cc0824e469bbf8511ddd5a22d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:56.107724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04881bf3-4bb1-4ed3-b779-6596abb0b3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba2132cc0824e469bbf8511ddd5a22d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:56.110418 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04881bf3-4bb1-4ed3-b779-6596abb0b3b4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:56.295111 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-04881bf3-4bb1-4ed3-b779-6596abb0b3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba2132cc0824e469bbf8511ddd5a22d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:56.327104 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-04881bf3-4bb1-4ed3-b779-6596abb0b3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba2132cc0824e469bbf8511ddd5a22d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:56.344694 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-04881bf3-4bb1-4ed3-b779-6596abb0b3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba2132cc0824e469bbf8511ddd5a22d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:56.347389 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-04881bf3-4bb1-4ed3-b779-6596abb0b3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba2132cc0824e469bbf8511ddd5a22d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:56.386248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-04881bf3-4bb1-4ed3-b779-6596abb0b3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba2132cc0824e469bbf8511ddd5a22d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:56.410970 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 946/1904] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:26:55 2022] DELETE /identity/v3/users/0ba2132cc0824e469bbf8511ddd5a22d => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:58.263062 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:58.264797 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:58.299323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157e6cd-603f-4c50-a46d-bdcc9ec39a51 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:58.510332 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed89472-82b0-47b8-8e42-241db7269d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:58.514155 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed89472-82b0-47b8-8e42-241db7269d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:58.514155 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed89472-82b0-47b8-8e42-241db7269d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:58.518374 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed89472-82b0-47b8-8e42-241db7269d89 admin admin] PATH_INFO: `/v3/projects/85d50ae799904467ac678384b1052053` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:58.526013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed89472-82b0-47b8-8e42-241db7269d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d50ae799904467ac678384b1052053)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:58.531322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed89472-82b0-47b8-8e42-241db7269d89 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:58.610958 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:58.655238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5ed89472-82b0-47b8-8e42-241db7269d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d50ae799904467ac678384b1052053', 'request_id': 'req-5ed89472-82b0-47b8-8e42-241db7269d89'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:58.671336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5ed89472-82b0-47b8-8e42-241db7269d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d50ae799904467ac678384b1052053', 'request_id': 'req-5ed89472-82b0-47b8-8e42-241db7269d89'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:58.689762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5ed89472-82b0-47b8-8e42-241db7269d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d50ae799904467ac678384b1052053', 'request_id': 'req-5ed89472-82b0-47b8-8e42-241db7269d89'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:58.712132 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5ed89472-82b0-47b8-8e42-241db7269d89 admin admin] The token cache is being invalidate because project 85d50ae799904467ac678384b1052053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:26:58.712892 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5ed89472-82b0-47b8-8e42-241db7269d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:58.713879 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5ed89472-82b0-47b8-8e42-241db7269d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:26:58.719740 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 959/1905] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:26:58 2022] DELETE /identity/v3/projects/85d50ae799904467ac678384b1052053 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:26:58.725416 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a478cab-a514-4a9e-b958-123a1c71be5a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:58.726011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a478cab-a514-4a9e-b958-123a1c71be5a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:58.726011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a478cab-a514-4a9e-b958-123a1c71be5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:58.750432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7a478cab-a514-4a9e-b958-123a1c71be5a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:58.752619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7a478cab-a514-4a9e-b958-123a1c71be5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:58.837603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 947/1906] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:58.848429 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293e21e-d7cf-4068-882e-eecf519bfd71 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:58.849344 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293e21e-d7cf-4068-882e-eecf519bfd71 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:58.849901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293e21e-d7cf-4068-882e-eecf519bfd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:58.892568 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1293e21e-d7cf-4068-882e-eecf519bfd71 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:58.894159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1293e21e-d7cf-4068-882e-eecf519bfd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:26:58.912058 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 960/1907] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:26:58.916526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a478cab-a514-4a9e-b958-123a1c71be5a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:58.932700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a478cab-a514-4a9e-b958-123a1c71be5a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:58.955148 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2e95b-0825-4e2e-8b59-37acadacfa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:58.956502 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2e95b-0825-4e2e-8b59-37acadacfa42 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:58.956814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2e95b-0825-4e2e-8b59-37acadacfa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:58.959186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2e95b-0825-4e2e-8b59-37acadacfa42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:58.959671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2e95b-0825-4e2e-8b59-37acadacfa42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:26:58.960124 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2e95b-0825-4e2e-8b59-37acadacfa42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:58.965420 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2e95b-0825-4e2e-8b59-37acadacfa42 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:58.990240 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 948/1908] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:26:58.995068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293e21e-d7cf-4068-882e-eecf519bfd71 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:59.015014 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293e21e-d7cf-4068-882e-eecf519bfd71 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:59.023654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa16227-38d8-46ad-bce0-99bc7a7cf77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:59.025040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa16227-38d8-46ad-bce0-99bc7a7cf77f admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:59.025605 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa16227-38d8-46ad-bce0-99bc7a7cf77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:59.026129 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa16227-38d8-46ad-bce0-99bc7a7cf77f admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:59.027264 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa16227-38d8-46ad-bce0-99bc7a7cf77f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:59.039346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa16227-38d8-46ad-bce0-99bc7a7cf77f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:59.106718 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 961/1909] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:26:58 2022] POST /identity/v3/projects => generated 401 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:59.108609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2e95b-0825-4e2e-8b59-37acadacfa42 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:59.145702 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2e95b-0825-4e2e-8b59-37acadacfa42 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:59.256199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:59.311319 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcc236-3b45-4756-a3a6-162efbc7b97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:59.312302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcc236-3b45-4756-a3a6-162efbc7b97f admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:59.312801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcc236-3b45-4756-a3a6-162efbc7b97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:59.313256 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcc236-3b45-4756-a3a6-162efbc7b97f admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:59.314109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcc236-3b45-4756-a3a6-162efbc7b97f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:59.316508 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcc236-3b45-4756-a3a6-162efbc7b97f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:59.377174 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 949/1910] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:26:59 2022] POST /identity/v3/users => generated 301 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:26:59.381570 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa16227-38d8-46ad-bce0-99bc7a7cf77f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:59.395014 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa16227-38d8-46ad-bce0-99bc7a7cf77f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:59.404955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9ce9a-3623-42dd-a1f9-e95e5f629f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:59.405859 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9ce9a-3623-42dd-a1f9-e95e5f629f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:59.406288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9ce9a-3623-42dd-a1f9-e95e5f629f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:59.406677 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9ce9a-3623-42dd-a1f9-e95e5f629f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:59.408223 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9ce9a-3623-42dd-a1f9-e95e5f629f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:59.409443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9ce9a-3623-42dd-a1f9-e95e5f629f45 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:59.462510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 962/1911] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:59.466113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcc236-3b45-4756-a3a6-162efbc7b97f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:59.484867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcc236-3b45-4756-a3a6-162efbc7b97f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:59.497243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8cefb-7806-4e78-bba0-e188cafd98e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:59.497973 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8cefb-7806-4e78-bba0-e188cafd98e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:59.498342 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8cefb-7806-4e78-bba0-e188cafd98e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:59.498605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8cefb-7806-4e78-bba0-e188cafd98e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:59.499387 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8cefb-7806-4e78-bba0-e188cafd98e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:59.501091 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8cefb-7806-4e78-bba0-e188cafd98e7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:59.523587 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 950/1912] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:26:59.529667 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9ce9a-3623-42dd-a1f9-e95e5f629f45 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:26:59.551398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9ce9a-3623-42dd-a1f9-e95e5f629f45 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:26:59.581591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc328e-8e7c-4356-83e7-296b36db892e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:26:59.582855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc328e-8e7c-4356-83e7-296b36db892e admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:59.583404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc328e-8e7c-4356-83e7-296b36db892e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:59.583838 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc328e-8e7c-4356-83e7-296b36db892e admin admin] PATH_INFO: `/v3/projects/7d3db59faa2d4da19f27af0ebd7465a4/users/24575c5154e74d229a223fb196c29833/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:59.693973 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc328e-8e7c-4356-83e7-296b36db892e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d3db59faa2d4da19f27af0ebd7465a4, user_id=24575c5154e74d229a223fb196c29833, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:26:59.697949 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc328e-8e7c-4356-83e7-296b36db892e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:26:59.737578 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 963/1913] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:26:59 2022] PUT /identity/v3/projects/7d3db59faa2d4da19f27af0ebd7465a4/users/24575c5154e74d229a223fb196c29833/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:26:59.752769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3af283-21d7-4097-bfc2-f818d14a62f0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:26:59.753329 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3af283-21d7-4097-bfc2-f818d14a62f0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:26:59.753329 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3af283-21d7-4097-bfc2-f818d14a62f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:26:59.835195 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8b3af283-21d7-4097-bfc2-f818d14a62f0 None None] MFA Rules not processed for user `24575c5154e74d229a223fb196c29833`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:26:59.836802 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8b3af283-21d7-4097-bfc2-f818d14a62f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:00.029963 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 951/1914] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:26:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:00.031002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc328e-8e7c-4356-83e7-296b36db892e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:00.276670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc328e-8e7c-4356-83e7-296b36db892e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:00.288189 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f51c9-58f7-4447-be59-725336d85e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:00.290823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f51c9-58f7-4447-be59-725336d85e89 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:00.291401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f51c9-58f7-4447-be59-725336d85e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:00.291942 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f51c9-58f7-4447-be59-725336d85e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:00.293970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f51c9-58f7-4447-be59-725336d85e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:00.300524 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f51c9-58f7-4447-be59-725336d85e89 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:00.395670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 964/1915] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:27:00 2022] POST /identity/v3/projects => generated 401 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:00.402192 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3af283-21d7-4097-bfc2-f818d14a62f0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:00.424275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3af283-21d7-4097-bfc2-f818d14a62f0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:00.669793 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027f3fd-66a1-43de-b717-4148217c78f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:00.673458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027f3fd-66a1-43de-b717-4148217c78f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:00.673458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027f3fd-66a1-43de-b717-4148217c78f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:00.674457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027f3fd-66a1-43de-b717-4148217c78f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:00.675470 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027f3fd-66a1-43de-b717-4148217c78f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:00.684270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027f3fd-66a1-43de-b717-4148217c78f0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:00.742384 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 952/1916] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:27:00 2022] POST /identity/v3/users => generated 307 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:00.742624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f51c9-58f7-4447-be59-725336d85e89 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:00.758644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f51c9-58f7-4447-be59-725336d85e89 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:00.781248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5653c-c262-404f-be72-a196182e8185 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:00.782095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5653c-c262-404f-be72-a196182e8185 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:00.782095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5653c-c262-404f-be72-a196182e8185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:00.785037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97e87f-e477-4754-9f0b-6c33d5cc4402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:00.785813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97e87f-e477-4754-9f0b-6c33d5cc4402 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:00.786475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97e87f-e477-4754-9f0b-6c33d5cc4402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:00.786645 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97e87f-e477-4754-9f0b-6c33d5cc4402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:00.788006 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97e87f-e477-4754-9f0b-6c33d5cc4402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:00.789161 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97e87f-e477-4754-9f0b-6c33d5cc4402 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:00.823363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 965/1917] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:27:00.828106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97e87f-e477-4754-9f0b-6c33d5cc4402 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:00.861861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cae5653c-c262-404f-be72-a196182e8185 None None] MFA Rules not processed for user `77ff2c22fc684248b9cff546e5eefd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:00.862077 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97e87f-e477-4754-9f0b-6c33d5cc4402 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:00.863604 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cae5653c-c262-404f-be72-a196182e8185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:00.892939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669321bc-9f24-4728-8c65-ca86035d5183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:00.894291 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669321bc-9f24-4728-8c65-ca86035d5183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:00.894816 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669321bc-9f24-4728-8c65-ca86035d5183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:00.895709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669321bc-9f24-4728-8c65-ca86035d5183 admin admin] PATH_INFO: `/v3/projects/bfc89c2c6c2f4cbcb08914e66fdd5750/users/2193662fed7f40888b86a14b91bb273c/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:00.965308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669321bc-9f24-4728-8c65-ca86035d5183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc89c2c6c2f4cbcb08914e66fdd5750, user_id=2193662fed7f40888b86a14b91bb273c, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:00.969694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669321bc-9f24-4728-8c65-ca86035d5183 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:00.970009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:00.997794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:01.008865 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 966/1918] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:00 2022] PUT /identity/v3/projects/bfc89c2c6c2f4cbcb08914e66fdd5750/users/2193662fed7f40888b86a14b91bb273c/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:27:01.013133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669321bc-9f24-4728-8c65-ca86035d5183 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:01.158344 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 953/1919] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:01.166020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5653c-c262-404f-be72-a196182e8185 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:01.175836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cae5653c-c262-404f-be72-a196182e8185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:01.245451 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5653c-c262-404f-be72-a196182e8185 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:01.267301 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669321bc-9f24-4728-8c65-ca86035d5183 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:01.268949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0bf45-1614-4022-b9e7-1e22d7a8ca71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:01.270578 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0bf45-1614-4022-b9e7-1e22d7a8ca71 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:01.271088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0bf45-1614-4022-b9e7-1e22d7a8ca71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:01.272083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0bf45-1614-4022-b9e7-1e22d7a8ca71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:01.293660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0bf45-1614-4022-b9e7-1e22d7a8ca71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:01.299998 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0bf45-1614-4022-b9e7-1e22d7a8ca71 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:01.311586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0ea65-7c7e-4b10-916b-3696944e2621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:01.312670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0ea65-7c7e-4b10-916b-3696944e2621 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:01.313375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0ea65-7c7e-4b10-916b-3696944e2621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:01.314333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0ea65-7c7e-4b10-916b-3696944e2621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:01.318694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0ea65-7c7e-4b10-916b-3696944e2621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:01.321951 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0ea65-7c7e-4b10-916b-3696944e2621 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:01.369857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 967/1920] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:27:01.379222 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0ea65-7c7e-4b10-916b-3696944e2621 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:01.431909 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 954/1921] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:27:01 2022] POST /identity/v3/projects => generated 373 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:01.433851 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0bf45-1614-4022-b9e7-1e22d7a8ca71 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:01.442518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0ea65-7c7e-4b10-916b-3696944e2621 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:01.656980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347adbd-6b28-48d6-97bf-25b7b56163b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:01.659785 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347adbd-6b28-48d6-97bf-25b7b56163b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:01.660294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347adbd-6b28-48d6-97bf-25b7b56163b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:01.660590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347adbd-6b28-48d6-97bf-25b7b56163b3 admin admin] PATH_INFO: `/v3/projects/bfc89c2c6c2f4cbcb08914e66fdd5750/users/2193662fed7f40888b86a14b91bb273c/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:01.665130 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347adbd-6b28-48d6-97bf-25b7b56163b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc89c2c6c2f4cbcb08914e66fdd5750, user_id=2193662fed7f40888b86a14b91bb273c, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:01.669919 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347adbd-6b28-48d6-97bf-25b7b56163b3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:01.673222 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0bf45-1614-4022-b9e7-1e22d7a8ca71 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:01.688072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934c84e-88ad-4fb6-a837-5c3341f0ba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:01.688913 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934c84e-88ad-4fb6-a837-5c3341f0ba83 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:01.689199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934c84e-88ad-4fb6-a837-5c3341f0ba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:01.689469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934c84e-88ad-4fb6-a837-5c3341f0ba83 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:01.690244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934c84e-88ad-4fb6-a837-5c3341f0ba83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:01.696256 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934c84e-88ad-4fb6-a837-5c3341f0ba83 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:01.703453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 968/1922] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:01 2022] PUT /identity/v3/projects/bfc89c2c6c2f4cbcb08914e66fdd5750/users/2193662fed7f40888b86a14b91bb273c/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:01.731478 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5096c0-b302-4a8c-82b1-6a54738779a7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:01.731964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5096c0-b302-4a8c-82b1-6a54738779a7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:01.732112 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5096c0-b302-4a8c-82b1-6a54738779a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:01.759836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 955/1923] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:27:01 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:01.767005 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934c84e-88ad-4fb6-a837-5c3341f0ba83 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:01.826004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934c84e-88ad-4fb6-a837-5c3341f0ba83 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:01.842716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7c5096c0-b302-4a8c-82b1-6a54738779a7 None None] MFA Rules not processed for user `2193662fed7f40888b86a14b91bb273c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:01.847843 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7c5096c0-b302-4a8c-82b1-6a54738779a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:02.175787 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b37d16-7caf-4fb4-af57-2756cf91eca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:02.178197 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37d16-7caf-4fb4-af57-2756cf91eca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:02.178699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37d16-7caf-4fb4-af57-2756cf91eca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:02.180067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37d16-7caf-4fb4-af57-2756cf91eca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:02.185730 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b37d16-7caf-4fb4-af57-2756cf91eca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:02.201988 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b37d16-7caf-4fb4-af57-2756cf91eca6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:02.276771 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 956/1924] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:27:02.278613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b37d16-7caf-4fb4-af57-2756cf91eca6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:02.318973 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 969/1925] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:01 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 582 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:27:02.319292 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b37d16-7caf-4fb4-af57-2756cf91eca6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:02.334867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482010b-0190-49e7-8ae2-03299094b9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:02.335824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482010b-0190-49e7-8ae2-03299094b9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:02.336111 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482010b-0190-49e7-8ae2-03299094b9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:02.336479 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482010b-0190-49e7-8ae2-03299094b9c9 admin admin] PATH_INFO: `/v3/projects/247c9ecd4c644b588fc9755fa6b8561c/users/6a62c582f2eb4317adf756f70b29f4e2/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:02.368016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5096c0-b302-4a8c-82b1-6a54738779a7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:02.376370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7c5096c0-b302-4a8c-82b1-6a54738779a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:02.382351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482010b-0190-49e7-8ae2-03299094b9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247c9ecd4c644b588fc9755fa6b8561c, user_id=6a62c582f2eb4317adf756f70b29f4e2, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:02.385195 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482010b-0190-49e7-8ae2-03299094b9c9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:02.401076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:02.431720 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 957/1926] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:02 2022] PUT /identity/v3/projects/247c9ecd4c644b588fc9755fa6b8561c/users/6a62c582f2eb4317adf756f70b29f4e2/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:02.431720 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482010b-0190-49e7-8ae2-03299094b9c9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:02.451206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:02.588709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5096c0-b302-4a8c-82b1-6a54738779a7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:02.682164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482010b-0190-49e7-8ae2-03299094b9c9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:02.709951 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5241ce5-bcd2-4550-8a19-5b19422e743a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:02.711249 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5241ce5-bcd2-4550-8a19-5b19422e743a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:02.711738 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5241ce5-bcd2-4550-8a19-5b19422e743a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:02.712088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5241ce5-bcd2-4550-8a19-5b19422e743a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:02.713391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5241ce5-bcd2-4550-8a19-5b19422e743a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:02.715981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5241ce5-bcd2-4550-8a19-5b19422e743a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:02.757377 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84d063-3a99-482c-bc50-8cbd0a0ee9cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:02.758734 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84d063-3a99-482c-bc50-8cbd0a0ee9cf service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:02.759499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84d063-3a99-482c-bc50-8cbd0a0ee9cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:02.760184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84d063-3a99-482c-bc50-8cbd0a0ee9cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:02.760553 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 958/1927] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:27:02.762137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5241ce5-bcd2-4550-8a19-5b19422e743a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:02.787764 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5241ce5-bcd2-4550-8a19-5b19422e743a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:02.808491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c6e9b-bccb-45f7-921a-0cd2038a6dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:02.814034 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c6e9b-bccb-45f7-921a-0cd2038a6dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:02.814775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c6e9b-bccb-45f7-921a-0cd2038a6dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:02.816012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c6e9b-bccb-45f7-921a-0cd2038a6dcf admin admin] PATH_INFO: `/v3/projects/247c9ecd4c644b588fc9755fa6b8561c/users/6a62c582f2eb4317adf756f70b29f4e2/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:02.827067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c6e9b-bccb-45f7-921a-0cd2038a6dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=247c9ecd4c644b588fc9755fa6b8561c, user_id=6a62c582f2eb4317adf756f70b29f4e2, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:02.839638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c6e9b-bccb-45f7-921a-0cd2038a6dcf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:02.896994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 959/1928] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:02 2022] PUT /identity/v3/projects/247c9ecd4c644b588fc9755fa6b8561c/users/6a62c582f2eb4317adf756f70b29f4e2/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:02.903425 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84d063-3a99-482c-bc50-8cbd0a0ee9cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:02.905651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84d063-3a99-482c-bc50-8cbd0a0ee9cf service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:02.928953 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 970/1929] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:02 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:27:03.113545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c6e9b-bccb-45f7-921a-0cd2038a6dcf admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:03.318527 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c6e9b-bccb-45f7-921a-0cd2038a6dcf admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:03.323127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d356e49-412f-4ac6-be24-560acfae9c98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:03.323978 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d356e49-412f-4ac6-be24-560acfae9c98 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:03.324359 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d356e49-412f-4ac6-be24-560acfae9c98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:03.324890 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d356e49-412f-4ac6-be24-560acfae9c98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:03.486528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d356e49-412f-4ac6-be24-560acfae9c98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:03.494094 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d356e49-412f-4ac6-be24-560acfae9c98 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:03.569241 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 960/1930] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:10.209069 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84d063-3a99-482c-bc50-8cbd0a0ee9cf service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:10.245271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84d063-3a99-482c-bc50-8cbd0a0ee9cf service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:10.408611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6e20a-2143-418e-a8c0-95b80cafef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:10.410394 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6e20a-2143-418e-a8c0-95b80cafef92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:10.411519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6e20a-2143-418e-a8c0-95b80cafef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:10.412285 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6e20a-2143-418e-a8c0-95b80cafef92 admin admin] PATH_INFO: `/v3/users/24575c5154e74d229a223fb196c29833` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:10.414933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6e20a-2143-418e-a8c0-95b80cafef92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24575c5154e74d229a223fb196c29833)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:10.423273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6e20a-2143-418e-a8c0-95b80cafef92 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:10.496552 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:10.580136 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d5e6e20a-2143-418e-a8c0-95b80cafef92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24575c5154e74d229a223fb196c29833'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:10.623898 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d5e6e20a-2143-418e-a8c0-95b80cafef92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24575c5154e74d229a223fb196c29833'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:10.626032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d5e6e20a-2143-418e-a8c0-95b80cafef92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24575c5154e74d229a223fb196c29833'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:10.626032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d5e6e20a-2143-418e-a8c0-95b80cafef92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24575c5154e74d229a223fb196c29833'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:10.670490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d5e6e20a-2143-418e-a8c0-95b80cafef92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24575c5154e74d229a223fb196c29833'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:10.725828 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 971/1931] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:27:10 2022] DELETE /identity/v3/users/24575c5154e74d229a223fb196c29833 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:10.730855 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda47ed-f035-4544-9c22-ff17b37c4554 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:10.731711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda47ed-f035-4544-9c22-ff17b37c4554 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:10.731711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda47ed-f035-4544-9c22-ff17b37c4554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:10.782994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2eda47ed-f035-4544-9c22-ff17b37c4554 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:10.784878 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2eda47ed-f035-4544-9c22-ff17b37c4554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:10.844830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6e20a-2143-418e-a8c0-95b80cafef92 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:10.849022 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d5e6e20a-2143-418e-a8c0-95b80cafef92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:10.891684 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:10.963511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 961/1932] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:11.012132 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6e20a-2143-418e-a8c0-95b80cafef92 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:11.023165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65e495-a991-459e-9fdc-5b0375a76d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:11.024273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65e495-a991-459e-9fdc-5b0375a76d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:11.024576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65e495-a991-459e-9fdc-5b0375a76d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:11.025117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65e495-a991-459e-9fdc-5b0375a76d87 admin admin] PATH_INFO: `/v3/users/f3becf7959dd4579a5dea2d0f34eca5c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:11.026564 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65e495-a991-459e-9fdc-5b0375a76d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3becf7959dd4579a5dea2d0f34eca5c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:11.028900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65e495-a991-459e-9fdc-5b0375a76d87 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:11.059512 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda47ed-f035-4544-9c22-ff17b37c4554 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:11.062032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2eda47ed-f035-4544-9c22-ff17b37c4554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:11.195201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4c65e495-a991-459e-9fdc-5b0375a76d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3becf7959dd4579a5dea2d0f34eca5c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:11.210819 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4c65e495-a991-459e-9fdc-5b0375a76d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3becf7959dd4579a5dea2d0f34eca5c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:11.212382 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4c65e495-a991-459e-9fdc-5b0375a76d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3becf7959dd4579a5dea2d0f34eca5c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:11.213280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4c65e495-a991-459e-9fdc-5b0375a76d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3becf7959dd4579a5dea2d0f34eca5c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:11.241693 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4c65e495-a991-459e-9fdc-5b0375a76d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3becf7959dd4579a5dea2d0f34eca5c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:11.303616 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 972/1933] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:27:10 2022] DELETE /identity/v3/users/f3becf7959dd4579a5dea2d0f34eca5c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:11.309139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893d4d1-c6e7-4fa1-8200-92c7b37524fc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:11.309692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893d4d1-c6e7-4fa1-8200-92c7b37524fc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:11.310201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893d4d1-c6e7-4fa1-8200-92c7b37524fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:11.339555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda47ed-f035-4544-9c22-ff17b37c4554 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:11.350787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0893d4d1-c6e7-4fa1-8200-92c7b37524fc None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:11.352954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0893d4d1-c6e7-4fa1-8200-92c7b37524fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:11.388965 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:11.501613 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 973/1934] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:11.513781 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893d4d1-c6e7-4fa1-8200-92c7b37524fc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:11.515989 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0893d4d1-c6e7-4fa1-8200-92c7b37524fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:11.551733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d14818-c548-4ec1-b1e2-808d0bca5ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:11.553324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d14818-c548-4ec1-b1e2-808d0bca5ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:11.553823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d14818-c548-4ec1-b1e2-808d0bca5ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:11.554361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d14818-c548-4ec1-b1e2-808d0bca5ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:11.563585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-55d14818-c548-4ec1-b1e2-808d0bca5ad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:11.609302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d14818-c548-4ec1-b1e2-808d0bca5ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:11.612272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d14818-c548-4ec1-b1e2-808d0bca5ad2 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:11.657963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893d4d1-c6e7-4fa1-8200-92c7b37524fc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:11.662457 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec711d55-567f-4ea0-8961-3e23050373d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:11.663161 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec711d55-567f-4ea0-8961-3e23050373d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:11.663651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec711d55-567f-4ea0-8961-3e23050373d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:11.664055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec711d55-567f-4ea0-8961-3e23050373d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:11.679098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec711d55-567f-4ea0-8961-3e23050373d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:11.680648 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec711d55-567f-4ea0-8961-3e23050373d6 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:11.692770 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 974/1935] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:27:11.695178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 962/1936] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:12.796100 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec711d55-567f-4ea0-8961-3e23050373d6 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:12.797587 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ec711d55-567f-4ea0-8961-3e23050373d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:12.842722 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec711d55-567f-4ea0-8961-3e23050373d6 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:12.863453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060342ef-675a-425e-bfb2-f47ae1fadf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:12.866438 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060342ef-675a-425e-bfb2-f47ae1fadf6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:12.866941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060342ef-675a-425e-bfb2-f47ae1fadf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:12.867438 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060342ef-675a-425e-bfb2-f47ae1fadf6e admin admin] PATH_INFO: `/v3/projects/66b62eeefe504b9188233a9b238335dc` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:12.878776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060342ef-675a-425e-bfb2-f47ae1fadf6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=66b62eeefe504b9188233a9b238335dc)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:12.884106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060342ef-675a-425e-bfb2-f47ae1fadf6e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:13.067978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-060342ef-675a-425e-bfb2-f47ae1fadf6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b62eeefe504b9188233a9b238335dc', 'request_id': 'req-060342ef-675a-425e-bfb2-f47ae1fadf6e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:13.083240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-060342ef-675a-425e-bfb2-f47ae1fadf6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b62eeefe504b9188233a9b238335dc', 'request_id': 'req-060342ef-675a-425e-bfb2-f47ae1fadf6e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:13.101930 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-060342ef-675a-425e-bfb2-f47ae1fadf6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b62eeefe504b9188233a9b238335dc', 'request_id': 'req-060342ef-675a-425e-bfb2-f47ae1fadf6e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:13.162818 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-060342ef-675a-425e-bfb2-f47ae1fadf6e admin admin] The token cache is being invalidate because project 66b62eeefe504b9188233a9b238335dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:27:13.166098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-060342ef-675a-425e-bfb2-f47ae1fadf6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:13.170409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-060342ef-675a-425e-bfb2-f47ae1fadf6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:13.184215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 975/1937] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:27:12 2022] DELETE /identity/v3/projects/66b62eeefe504b9188233a9b238335dc => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:13.186108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e437ea-ebb8-4247-afbe-05c42b3aaa58 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:13.186874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e437ea-ebb8-4247-afbe-05c42b3aaa58 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:13.186874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e437ea-ebb8-4247-afbe-05c42b3aaa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:13.223949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-68e437ea-ebb8-4247-afbe-05c42b3aaa58 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:13.225150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-68e437ea-ebb8-4247-afbe-05c42b3aaa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:13.455293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 963/1938] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:27:13.467247 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5ce6d-91f6-43ea-9863-c7235f09ee08 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:13.468136 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5ce6d-91f6-43ea-9863-c7235f09ee08 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:13.468925 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5ce6d-91f6-43ea-9863-c7235f09ee08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:13.503076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-31f5ce6d-91f6-43ea-9863-c7235f09ee08 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:13.505064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-31f5ce6d-91f6-43ea-9863-c7235f09ee08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:13.545620 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e437ea-ebb8-4247-afbe-05c42b3aaa58 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:13.546139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 976/1939] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:13.562376 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e437ea-ebb8-4247-afbe-05c42b3aaa58 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:13.571628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8022ff7-d80c-4ee7-a57e-5853298e3eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:13.572901 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8022ff7-d80c-4ee7-a57e-5853298e3eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:13.573244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8022ff7-d80c-4ee7-a57e-5853298e3eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:13.573541 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8022ff7-d80c-4ee7-a57e-5853298e3eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:13.574430 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8022ff7-d80c-4ee7-a57e-5853298e3eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:27:13.574740 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8022ff7-d80c-4ee7-a57e-5853298e3eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:13.576587 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8022ff7-d80c-4ee7-a57e-5853298e3eb4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:13.601833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 964/1940] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:27:13.607310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5ce6d-91f6-43ea-9863-c7235f09ee08 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:13.630986 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5ce6d-91f6-43ea-9863-c7235f09ee08 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:13.661468 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a62f2-0f4a-4450-b186-19bedd8db1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:13.663759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a62f2-0f4a-4450-b186-19bedd8db1fc admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:13.664613 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a62f2-0f4a-4450-b186-19bedd8db1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:13.665373 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a62f2-0f4a-4450-b186-19bedd8db1fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:13.667404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a62f2-0f4a-4450-b186-19bedd8db1fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:13.682610 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a62f2-0f4a-4450-b186-19bedd8db1fc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:13.779368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 977/1941] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:27:13 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:13.779582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8022ff7-d80c-4ee7-a57e-5853298e3eb4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:13.795554 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8022ff7-d80c-4ee7-a57e-5853298e3eb4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:13.831215 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:13.871777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd25789-4498-48ce-a697-e3f084ee42fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:13.872871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd25789-4498-48ce-a697-e3f084ee42fe admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:13.873333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd25789-4498-48ce-a697-e3f084ee42fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:13.874340 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd25789-4498-48ce-a697-e3f084ee42fe admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:13.875287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd25789-4498-48ce-a697-e3f084ee42fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:13.877478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd25789-4498-48ce-a697-e3f084ee42fe admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:13.913539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 965/1942] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:27:13 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:13.917877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a62f2-0f4a-4450-b186-19bedd8db1fc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:13.933084 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a62f2-0f4a-4450-b186-19bedd8db1fc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:13.939511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5db24-3933-4472-83a4-19fd41b8dcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:13.940731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5db24-3933-4472-83a4-19fd41b8dcaa admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:13.941240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5db24-3933-4472-83a4-19fd41b8dcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:13.941729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5db24-3933-4472-83a4-19fd41b8dcaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:13.942961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5db24-3933-4472-83a4-19fd41b8dcaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:13.945053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5db24-3933-4472-83a4-19fd41b8dcaa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:13.965145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 978/1943] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:27:13.966628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd25789-4498-48ce-a697-e3f084ee42fe admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:13.986866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd25789-4498-48ce-a697-e3f084ee42fe admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:14.000592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb0648-28c4-44a5-a4a9-facb870166bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:14.001311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb0648-28c4-44a5-a4a9-facb870166bf admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:14.001620 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb0648-28c4-44a5-a4a9-facb870166bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:14.002016 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb0648-28c4-44a5-a4a9-facb870166bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:14.003533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb0648-28c4-44a5-a4a9-facb870166bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:14.005531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb0648-28c4-44a5-a4a9-facb870166bf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:14.019476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 966/1944] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:27:14.030877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5db24-3933-4472-83a4-19fd41b8dcaa admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:14.043382 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:14.051911 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5db24-3933-4472-83a4-19fd41b8dcaa admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:14.062921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645878e4-c6ff-44c4-b4c9-cd732106edb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:14.064879 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645878e4-c6ff-44c4-b4c9-cd732106edb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:14.065800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645878e4-c6ff-44c4-b4c9-cd732106edb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:14.066544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645878e4-c6ff-44c4-b4c9-cd732106edb2 admin admin] PATH_INFO: `/v3/projects/015ae441ce2540b2a14b4451b2720137/users/526b47a8b6074648a09ca7dbfd3385bf/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:14.098513 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645878e4-c6ff-44c4-b4c9-cd732106edb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015ae441ce2540b2a14b4451b2720137, user_id=526b47a8b6074648a09ca7dbfd3385bf, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:14.105204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645878e4-c6ff-44c4-b4c9-cd732106edb2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:14.147871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 979/1945] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:14 2022] PUT /identity/v3/projects/015ae441ce2540b2a14b4451b2720137/users/526b47a8b6074648a09ca7dbfd3385bf/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:14.155932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467af5d-851e-4c60-8c1d-12f50c6d2635 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:14.157143 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467af5d-851e-4c60-8c1d-12f50c6d2635 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:14.158815 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467af5d-851e-4c60-8c1d-12f50c6d2635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:14.238408 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3467af5d-851e-4c60-8c1d-12f50c6d2635 None None] MFA Rules not processed for user `526b47a8b6074648a09ca7dbfd3385bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:14.240283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3467af5d-851e-4c60-8c1d-12f50c6d2635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:14.450055 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 967/1946] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:14.460898 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645878e4-c6ff-44c4-b4c9-cd732106edb2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:14.466052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-645878e4-c6ff-44c4-b4c9-cd732106edb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:14.486628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467af5d-851e-4c60-8c1d-12f50c6d2635 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:14.490076 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3467af5d-851e-4c60-8c1d-12f50c6d2635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:14.650053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645878e4-c6ff-44c4-b4c9-cd732106edb2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:14.656229 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255678dc-54d2-414a-80e0-0a7608fe4b1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:14.657865 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255678dc-54d2-414a-80e0-0a7608fe4b1f service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:14.657865 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255678dc-54d2-414a-80e0-0a7608fe4b1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:14.657865 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255678dc-54d2-414a-80e0-0a7608fe4b1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:14.693732 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255678dc-54d2-414a-80e0-0a7608fe4b1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:14.697131 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255678dc-54d2-414a-80e0-0a7608fe4b1f service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:14.726123 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 980/1947] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:14.728507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467af5d-851e-4c60-8c1d-12f50c6d2635 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:14.744699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69cffd-c262-4ef5-b87c-6906c50f9a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:14.745202 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69cffd-c262-4ef5-b87c-6906c50f9a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:14.746579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69cffd-c262-4ef5-b87c-6906c50f9a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:14.747108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69cffd-c262-4ef5-b87c-6906c50f9a82 admin admin] PATH_INFO: `/v3/projects/7d3db59faa2d4da19f27af0ebd7465a4` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:14.749523 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69cffd-c262-4ef5-b87c-6906c50f9a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d3db59faa2d4da19f27af0ebd7465a4)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:14.753785 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69cffd-c262-4ef5-b87c-6906c50f9a82 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:14.787647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255678dc-54d2-414a-80e0-0a7608fe4b1f service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:14.823696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255678dc-54d2-414a-80e0-0a7608fe4b1f service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:14.843151 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2381e7-d76d-42a4-94e0-083f9e661373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:14.844085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2381e7-d76d-42a4-94e0-083f9e661373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:14.844370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2381e7-d76d-42a4-94e0-083f9e661373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:14.844651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2381e7-d76d-42a4-94e0-083f9e661373 admin admin] PATH_INFO: `/v3/users/526b47a8b6074648a09ca7dbfd3385bf` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:14.848351 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2381e7-d76d-42a4-94e0-083f9e661373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=526b47a8b6074648a09ca7dbfd3385bf)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:14.850966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2381e7-d76d-42a4-94e0-083f9e661373 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:14.905616 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:14.934377 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5c69cffd-c262-4ef5-b87c-6906c50f9a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d3db59faa2d4da19f27af0ebd7465a4', 'request_id': 'req-5c69cffd-c262-4ef5-b87c-6906c50f9a82'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:14.960022 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5c69cffd-c262-4ef5-b87c-6906c50f9a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d3db59faa2d4da19f27af0ebd7465a4', 'request_id': 'req-5c69cffd-c262-4ef5-b87c-6906c50f9a82'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:14.977785 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5c69cffd-c262-4ef5-b87c-6906c50f9a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d3db59faa2d4da19f27af0ebd7465a4', 'request_id': 'req-5c69cffd-c262-4ef5-b87c-6906c50f9a82'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:15.011368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6b2381e7-d76d-42a4-94e0-083f9e661373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '526b47a8b6074648a09ca7dbfd3385bf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:15.020123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5c69cffd-c262-4ef5-b87c-6906c50f9a82 admin admin] The token cache is being invalidate because project 7d3db59faa2d4da19f27af0ebd7465a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:27:15.020792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5c69cffd-c262-4ef5-b87c-6906c50f9a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:15.021763 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5c69cffd-c262-4ef5-b87c-6906c50f9a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:15.028702 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 968/1948] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:27:14 2022] DELETE /identity/v3/projects/7d3db59faa2d4da19f27af0ebd7465a4 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:15.035905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69cffd-c262-4ef5-b87c-6906c50f9a82 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:15.047621 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5c69cffd-c262-4ef5-b87c-6906c50f9a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:15.048460 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6b2381e7-d76d-42a4-94e0-083f9e661373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '526b47a8b6074648a09ca7dbfd3385bf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:15.050855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6b2381e7-d76d-42a4-94e0-083f9e661373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '526b47a8b6074648a09ca7dbfd3385bf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:15.051884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6b2381e7-d76d-42a4-94e0-083f9e661373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '526b47a8b6074648a09ca7dbfd3385bf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:15.080193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6b2381e7-d76d-42a4-94e0-083f9e661373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '526b47a8b6074648a09ca7dbfd3385bf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:15.169127 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 981/1949] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:27:14 2022] DELETE /identity/v3/users/526b47a8b6074648a09ca7dbfd3385bf => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:27:15.184400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf2ebb-361d-46c9-8893-859d9915cef9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:15.189721 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf2ebb-361d-46c9-8893-859d9915cef9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:15.190809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf2ebb-361d-46c9-8893-859d9915cef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:15.222526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69cffd-c262-4ef5-b87c-6906c50f9a82 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:15.235302 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-46bf2ebb-361d-46c9-8893-859d9915cef9 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:15.238579 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-46bf2ebb-361d-46c9-8893-859d9915cef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:15.381742 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:15.399673 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534df291-1623-4abc-a563-3fcf8577ae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:15.401138 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534df291-1623-4abc-a563-3fcf8577ae21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:15.412870 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 982/1950] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:15.417638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534df291-1623-4abc-a563-3fcf8577ae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:15.418148 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534df291-1623-4abc-a563-3fcf8577ae21 admin admin] PATH_INFO: `/v3/users/2193662fed7f40888b86a14b91bb273c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:15.427997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534df291-1623-4abc-a563-3fcf8577ae21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2193662fed7f40888b86a14b91bb273c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:15.432496 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534df291-1623-4abc-a563-3fcf8577ae21 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:15.464786 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf2ebb-361d-46c9-8893-859d9915cef9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:15.466608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-46bf2ebb-361d-46c9-8893-859d9915cef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:15.596541 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-534df291-1623-4abc-a563-3fcf8577ae21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2193662fed7f40888b86a14b91bb273c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:15.618277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-534df291-1623-4abc-a563-3fcf8577ae21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2193662fed7f40888b86a14b91bb273c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:15.644035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-534df291-1623-4abc-a563-3fcf8577ae21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2193662fed7f40888b86a14b91bb273c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:15.645239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-534df291-1623-4abc-a563-3fcf8577ae21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2193662fed7f40888b86a14b91bb273c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:15.671609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:15.673517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-534df291-1623-4abc-a563-3fcf8577ae21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2193662fed7f40888b86a14b91bb273c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:15.691879 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 969/1951] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:27:15 2022] DELETE /identity/v3/users/2193662fed7f40888b86a14b91bb273c => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:15.748598 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf2ebb-361d-46c9-8893-859d9915cef9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:15.959651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52783855-958c-47ee-aafd-940f362a6f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:15.961009 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52783855-958c-47ee-aafd-940f362a6f4a service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:15.961311 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52783855-958c-47ee-aafd-940f362a6f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:15.962096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52783855-958c-47ee-aafd-940f362a6f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:15.965781 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-52783855-958c-47ee-aafd-940f362a6f4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:16.228868 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52783855-958c-47ee-aafd-940f362a6f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:16.232401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52783855-958c-47ee-aafd-940f362a6f4a service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:16.259706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 983/1952] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 795 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:27:17.770041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534df291-1623-4abc-a563-3fcf8577ae21 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:17.774343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-534df291-1623-4abc-a563-3fcf8577ae21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:17.841812 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534df291-1623-4abc-a563-3fcf8577ae21 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:17.856712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b83d3-2840-43ad-83f2-0a7dd6861015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:17.857947 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b83d3-2840-43ad-83f2-0a7dd6861015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:17.858325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b83d3-2840-43ad-83f2-0a7dd6861015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:17.858549 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b83d3-2840-43ad-83f2-0a7dd6861015 admin admin] PATH_INFO: `/v3/projects/bfc89c2c6c2f4cbcb08914e66fdd5750` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:17.861556 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b83d3-2840-43ad-83f2-0a7dd6861015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc89c2c6c2f4cbcb08914e66fdd5750)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:17.863908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b83d3-2840-43ad-83f2-0a7dd6861015 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:17.984386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c93b83d3-2840-43ad-83f2-0a7dd6861015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc89c2c6c2f4cbcb08914e66fdd5750', 'request_id': 'req-c93b83d3-2840-43ad-83f2-0a7dd6861015'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:17.996259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c93b83d3-2840-43ad-83f2-0a7dd6861015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc89c2c6c2f4cbcb08914e66fdd5750', 'request_id': 'req-c93b83d3-2840-43ad-83f2-0a7dd6861015'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:18.005075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c93b83d3-2840-43ad-83f2-0a7dd6861015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc89c2c6c2f4cbcb08914e66fdd5750', 'request_id': 'req-c93b83d3-2840-43ad-83f2-0a7dd6861015'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:18.032938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c93b83d3-2840-43ad-83f2-0a7dd6861015 admin admin] The token cache is being invalidate because project bfc89c2c6c2f4cbcb08914e66fdd5750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:27:18.033499 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c93b83d3-2840-43ad-83f2-0a7dd6861015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:18.035225 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c93b83d3-2840-43ad-83f2-0a7dd6861015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:18.041231 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 970/1953] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:27:17 2022] DELETE /identity/v3/projects/bfc89c2c6c2f4cbcb08914e66fdd5750 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:18.042942 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae64ab-701f-41b0-b412-9761ae91a247 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:18.043978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae64ab-701f-41b0-b412-9761ae91a247 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:18.044648 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae64ab-701f-41b0-b412-9761ae91a247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:18.090792 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1bae64ab-701f-41b0-b412-9761ae91a247 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:18.093802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1bae64ab-701f-41b0-b412-9761ae91a247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:18.139168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b83d3-2840-43ad-83f2-0a7dd6861015 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:18.141206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c93b83d3-2840-43ad-83f2-0a7dd6861015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:18.281639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b83d3-2840-43ad-83f2-0a7dd6861015 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:18.290252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee403a-cb60-4ea4-bb7b-abac5cb41f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:18.291223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee403a-cb60-4ea4-bb7b-abac5cb41f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:18.291513 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee403a-cb60-4ea4-bb7b-abac5cb41f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:18.291860 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee403a-cb60-4ea4-bb7b-abac5cb41f3d admin admin] PATH_INFO: `/v3/projects/015ae441ce2540b2a14b4451b2720137` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:18.300067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee403a-cb60-4ea4-bb7b-abac5cb41f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=015ae441ce2540b2a14b4451b2720137)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:18.303187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee403a-cb60-4ea4-bb7b-abac5cb41f3d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:18.322377 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 984/1954] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:18.332208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df844630-ff70-464f-a5b5-695b597f1cd3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:18.335775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df844630-ff70-464f-a5b5-695b597f1cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:18.336638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df844630-ff70-464f-a5b5-695b597f1cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:18.354991 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:18.387240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-df844630-ff70-464f-a5b5-695b597f1cd3 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:18.389679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-df844630-ff70-464f-a5b5-695b597f1cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:18.412608 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c2ee403a-cb60-4ea4-bb7b-abac5cb41f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015ae441ce2540b2a14b4451b2720137', 'request_id': 'req-c2ee403a-cb60-4ea4-bb7b-abac5cb41f3d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:18.435033 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c2ee403a-cb60-4ea4-bb7b-abac5cb41f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015ae441ce2540b2a14b4451b2720137', 'request_id': 'req-c2ee403a-cb60-4ea4-bb7b-abac5cb41f3d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:18.450741 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c2ee403a-cb60-4ea4-bb7b-abac5cb41f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015ae441ce2540b2a14b4451b2720137', 'request_id': 'req-c2ee403a-cb60-4ea4-bb7b-abac5cb41f3d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:18.485234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c2ee403a-cb60-4ea4-bb7b-abac5cb41f3d admin admin] The token cache is being invalidate because project 015ae441ce2540b2a14b4451b2720137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:27:18.485531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c2ee403a-cb60-4ea4-bb7b-abac5cb41f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:18.486377 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c2ee403a-cb60-4ea4-bb7b-abac5cb41f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:18.488469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 971/1955] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:27:18 2022] DELETE /identity/v3/projects/015ae441ce2540b2a14b4451b2720137 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:27:18.495158 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31420a42-9af1-4cda-9d83-6e543a233224 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:18.495426 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31420a42-9af1-4cda-9d83-6e543a233224 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:18.495720 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31420a42-9af1-4cda-9d83-6e543a233224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:18.512747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:18.524658 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-31420a42-9af1-4cda-9d83-6e543a233224 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:18.533477 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-31420a42-9af1-4cda-9d83-6e543a233224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:18.594190 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 985/1956] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:18.600392 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df844630-ff70-464f-a5b5-695b597f1cd3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:18.613526 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df844630-ff70-464f-a5b5-695b597f1cd3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:18.633356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a0139-35cc-4d8d-b914-54dc375c3761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:18.634129 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0139-35cc-4d8d-b914-54dc375c3761 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:18.634435 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0139-35cc-4d8d-b914-54dc375c3761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:18.636926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0139-35cc-4d8d-b914-54dc375c3761 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:18.637865 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a0139-35cc-4d8d-b914-54dc375c3761 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:27:18.638125 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a0139-35cc-4d8d-b914-54dc375c3761 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:18.646910 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a0139-35cc-4d8d-b914-54dc375c3761 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:18.689273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 986/1957] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:27:18.698273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a0139-35cc-4d8d-b914-54dc375c3761 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:18.716404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a0139-35cc-4d8d-b914-54dc375c3761 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:18.731234 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60704275-44bd-49b8-8602-3f9ad628f02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:18.732179 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60704275-44bd-49b8-8602-3f9ad628f02c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:18.732401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60704275-44bd-49b8-8602-3f9ad628f02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:18.732673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60704275-44bd-49b8-8602-3f9ad628f02c admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:18.733424 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60704275-44bd-49b8-8602-3f9ad628f02c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:18.735719 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60704275-44bd-49b8-8602-3f9ad628f02c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:18.763762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 972/1958] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:27:18.771304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fd270-546a-4f8d-b2eb-925117b1679a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:18.772241 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fd270-546a-4f8d-b2eb-925117b1679a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:18.772241 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fd270-546a-4f8d-b2eb-925117b1679a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:18.833896 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 987/1959] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:27:18 2022] POST /identity/v3/projects => generated 405 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:18.840355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60704275-44bd-49b8-8602-3f9ad628f02c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:18.854939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6b1fd270-546a-4f8d-b2eb-925117b1679a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:18.857265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6b1fd270-546a-4f8d-b2eb-925117b1679a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:19.119135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 973/1960] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:19.120933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fd270-546a-4f8d-b2eb-925117b1679a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:19.134424 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60704275-44bd-49b8-8602-3f9ad628f02c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:19.151666 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65d1fe-a66e-49a2-9586-54e758a4e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:19.152552 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65d1fe-a66e-49a2-9586-54e758a4e67c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:19.153167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65d1fe-a66e-49a2-9586-54e758a4e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:19.155044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65d1fe-a66e-49a2-9586-54e758a4e67c admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:19.156775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65d1fe-a66e-49a2-9586-54e758a4e67c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:19.162075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65d1fe-a66e-49a2-9586-54e758a4e67c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:19.162895 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fd270-546a-4f8d-b2eb-925117b1679a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:19.181531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f15bc-abdf-4329-b875-8e5f0c655790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:19.183124 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f15bc-abdf-4329-b875-8e5f0c655790 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:19.183597 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f15bc-abdf-4329-b875-8e5f0c655790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:19.184028 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f15bc-abdf-4329-b875-8e5f0c655790 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:19.185144 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f15bc-abdf-4329-b875-8e5f0c655790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:27:19.186128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f15bc-abdf-4329-b875-8e5f0c655790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:19.191484 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f15bc-abdf-4329-b875-8e5f0c655790 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:19.207433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 988/1961] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:27:18 2022] POST /identity/v3/users => generated 303 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:19.212343 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65d1fe-a66e-49a2-9586-54e758a4e67c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:19.234931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 974/1962] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:27:19.240899 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f15bc-abdf-4329-b875-8e5f0c655790 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:19.260873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65d1fe-a66e-49a2-9586-54e758a4e67c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:19.271615 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92928c25-5b9d-4e8c-a757-f61dcb5e594c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:19.273469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92928c25-5b9d-4e8c-a757-f61dcb5e594c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:19.274612 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92928c25-5b9d-4e8c-a757-f61dcb5e594c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:19.275467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92928c25-5b9d-4e8c-a757-f61dcb5e594c admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:19.277331 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92928c25-5b9d-4e8c-a757-f61dcb5e594c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:19.280652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f15bc-abdf-4329-b875-8e5f0c655790 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:19.282095 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92928c25-5b9d-4e8c-a757-f61dcb5e594c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:19.294634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cc167-f0e4-4a97-845c-bafaef3cf81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:19.295897 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cc167-f0e4-4a97-845c-bafaef3cf81b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:19.295897 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cc167-f0e4-4a97-845c-bafaef3cf81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:19.296579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cc167-f0e4-4a97-845c-bafaef3cf81b admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:19.297170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cc167-f0e4-4a97-845c-bafaef3cf81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:19.299232 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cc167-f0e4-4a97-845c-bafaef3cf81b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:19.308602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 989/1963] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:27:19.313985 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92928c25-5b9d-4e8c-a757-f61dcb5e594c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:19.334913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92928c25-5b9d-4e8c-a757-f61dcb5e594c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:19.365407 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fe1d3-5c84-4bd3-b5e0-b5c9613b9636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:19.367103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 975/1964] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:27:19 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:19.368612 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fe1d3-5c84-4bd3-b5e0-b5c9613b9636 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:19.369230 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b315760-1ae1-420f-8f6f-7a2db524c5f0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:19.369526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b315760-1ae1-420f-8f6f-7a2db524c5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:19.369811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b315760-1ae1-420f-8f6f-7a2db524c5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:19.370197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fe1d3-5c84-4bd3-b5e0-b5c9613b9636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:19.371254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fe1d3-5c84-4bd3-b5e0-b5c9613b9636 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:19.373678 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fe1d3-5c84-4bd3-b5e0-b5c9613b9636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:19.378558 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fe1d3-5c84-4bd3-b5e0-b5c9613b9636 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:19.414306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 990/1965] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:27:19.416533 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fe1d3-5c84-4bd3-b5e0-b5c9613b9636 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:19.441573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fe1d3-5c84-4bd3-b5e0-b5c9613b9636 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:19.463917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0b315760-1ae1-420f-8f6f-7a2db524c5f0 None None] MFA Rules not processed for user `6a62c582f2eb4317adf756f70b29f4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:19.466853 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0b315760-1ae1-420f-8f6f-7a2db524c5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:19.525919 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:19.572329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161cc81-7aa9-4c4d-830e-a89ccb69d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:19.573075 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161cc81-7aa9-4c4d-830e-a89ccb69d22e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:19.573365 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161cc81-7aa9-4c4d-830e-a89ccb69d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:19.573641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161cc81-7aa9-4c4d-830e-a89ccb69d22e admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:19.574404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161cc81-7aa9-4c4d-830e-a89ccb69d22e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:19.576629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161cc81-7aa9-4c4d-830e-a89ccb69d22e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:19.617313 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 991/1966] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:27:19 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:19.617313 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161cc81-7aa9-4c4d-830e-a89ccb69d22e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:19.625749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161cc81-7aa9-4c4d-830e-a89ccb69d22e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:19.631550 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497c718-132e-4c8c-a9a7-cd3acaea4e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:19.632524 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497c718-132e-4c8c-a9a7-cd3acaea4e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:19.632801 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497c718-132e-4c8c-a9a7-cd3acaea4e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:19.633088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497c718-132e-4c8c-a9a7-cd3acaea4e99 admin admin] PATH_INFO: `/v3/projects/b58934ded378452a97849bb6992f01a0/users/bedd38f9df284383abbeb380af784159/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:19.656250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497c718-132e-4c8c-a9a7-cd3acaea4e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58934ded378452a97849bb6992f01a0, user_id=bedd38f9df284383abbeb380af784159, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:19.659302 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497c718-132e-4c8c-a9a7-cd3acaea4e99 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:19.663326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:19.676228 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 976/1967] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:19.677670 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b315760-1ae1-420f-8f6f-7a2db524c5f0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:19.707257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b315760-1ae1-420f-8f6f-7a2db524c5f0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:19.712744 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 992/1968] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:19 2022] PUT /identity/v3/projects/b58934ded378452a97849bb6992f01a0/users/bedd38f9df284383abbeb380af784159/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:19.713893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497c718-132e-4c8c-a9a7-cd3acaea4e99 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:19.715984 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a497c718-132e-4c8c-a9a7-cd3acaea4e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:19.878912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d43aa8-8286-4d1b-8a16-825a5b81602c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:19.880787 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d43aa8-8286-4d1b-8a16-825a5b81602c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:19.881129 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d43aa8-8286-4d1b-8a16-825a5b81602c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:19.881305 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d43aa8-8286-4d1b-8a16-825a5b81602c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:19.886719 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d43aa8-8286-4d1b-8a16-825a5b81602c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:19.889975 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d43aa8-8286-4d1b-8a16-825a5b81602c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:19.900777 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497c718-132e-4c8c-a9a7-cd3acaea4e99 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:19.911657 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 977/1969] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:27:19.911657 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75907a-b525-407f-a9c7-740a59220d14 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:19.911657 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75907a-b525-407f-a9c7-740a59220d14 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:19.911657 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75907a-b525-407f-a9c7-740a59220d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:19.948669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bb75907a-b525-407f-a9c7-740a59220d14 None None] MFA Rules not processed for user `bedd38f9df284383abbeb380af784159`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:19.950315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bb75907a-b525-407f-a9c7-740a59220d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:19.951453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a9f5a-d87b-4e0d-a094-a2e9b6857096 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:19.952772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a9f5a-d87b-4e0d-a094-a2e9b6857096 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:19.957835 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a9f5a-d87b-4e0d-a094-a2e9b6857096 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:19.958924 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a9f5a-d87b-4e0d-a094-a2e9b6857096 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:19.969694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ac0a9f5a-d87b-4e0d-a094-a2e9b6857096 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:20.085503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 978/1970] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:20.094338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75907a-b525-407f-a9c7-740a59220d14 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:20.110027 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75907a-b525-407f-a9c7-740a59220d14 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:20.125151 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f41ff6-fba8-4dfb-a467-9dc0b2ad595e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:20.125959 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f41ff6-fba8-4dfb-a467-9dc0b2ad595e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:20.126271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f41ff6-fba8-4dfb-a467-9dc0b2ad595e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:20.126561 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f41ff6-fba8-4dfb-a467-9dc0b2ad595e admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:20.127402 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f41ff6-fba8-4dfb-a467-9dc0b2ad595e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:20.139078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f41ff6-fba8-4dfb-a467-9dc0b2ad595e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:20.198343 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a9f5a-d87b-4e0d-a094-a2e9b6857096 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:20.201067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a9f5a-d87b-4e0d-a094-a2e9b6857096 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:20.229399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 993/1971] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:20.235091 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 979/1972] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:27:20.241983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a9f5a-d87b-4e0d-a094-a2e9b6857096 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:20.245039 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f41ff6-fba8-4dfb-a467-9dc0b2ad595e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:20.279394 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f41ff6-fba8-4dfb-a467-9dc0b2ad595e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:20.295663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a9f5a-d87b-4e0d-a094-a2e9b6857096 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:20.303273 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae2fd2-2f3b-4055-9b56-39d193c9b1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:20.304498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae2fd2-2f3b-4055-9b56-39d193c9b1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:20.307557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae2fd2-2f3b-4055-9b56-39d193c9b1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:20.308217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae2fd2-2f3b-4055-9b56-39d193c9b1f5 admin admin] PATH_INFO: `/v3/projects/07ead95fd72042f9add9cb11a6cde632/users/c7598c3db9004ac1a23d36071c2149dd/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:20.311693 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2fe48-5273-403c-b6b3-22dc63c1f6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:20.312409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2fe48-5273-403c-b6b3-22dc63c1f6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:20.312696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2fe48-5273-403c-b6b3-22dc63c1f6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:20.317511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2fe48-5273-403c-b6b3-22dc63c1f6d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:20.318062 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2fe48-5273-403c-b6b3-22dc63c1f6d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:20.324199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2fe48-5273-403c-b6b3-22dc63c1f6d7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:20.349228 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae2fd2-2f3b-4055-9b56-39d193c9b1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ead95fd72042f9add9cb11a6cde632, user_id=c7598c3db9004ac1a23d36071c2149dd, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:20.355376 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae2fd2-2f3b-4055-9b56-39d193c9b1f5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:20.383745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 980/1973] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:20 2022] PUT /identity/v3/projects/07ead95fd72042f9add9cb11a6cde632/users/c7598c3db9004ac1a23d36071c2149dd/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:20.404464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5c8f1-88ef-4ed0-b68f-b44f7c2f586c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:20.404735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5c8f1-88ef-4ed0-b68f-b44f7c2f586c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:20.405191 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5c8f1-88ef-4ed0-b68f-b44f7c2f586c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:20.444605 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 994/1974] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:27:20 2022] POST /identity/v3/projects => generated 407 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:20.447177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2fe48-5273-403c-b6b3-22dc63c1f6d7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:20.464661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c4e5c8f1-88ef-4ed0-b68f-b44f7c2f586c None None] MFA Rules not processed for user `c7598c3db9004ac1a23d36071c2149dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:20.465972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c4e5c8f1-88ef-4ed0-b68f-b44f7c2f586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:20.541995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:20.581742 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:20.664356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 981/1975] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:20.689312 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5c8f1-88ef-4ed0-b68f-b44f7c2f586c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:20.691260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c4e5c8f1-88ef-4ed0-b68f-b44f7c2f586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:20.724656 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2fe48-5273-403c-b6b3-22dc63c1f6d7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:20.735168 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384feca-540f-410e-b552-3506db802539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:20.736487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384feca-540f-410e-b552-3506db802539 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:20.736979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384feca-540f-410e-b552-3506db802539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:20.737670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384feca-540f-410e-b552-3506db802539 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:20.739127 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384feca-540f-410e-b552-3506db802539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:20.747045 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384feca-540f-410e-b552-3506db802539 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:20.856157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 995/1976] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:27:20 2022] POST /identity/v3/users => generated 310 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:20.861420 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5c8f1-88ef-4ed0-b68f-b44f7c2f586c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:20.867162 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384feca-540f-410e-b552-3506db802539 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:20.868348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060dcd3-74e3-4ee0-85ff-db9cc455dad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:20.869203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060dcd3-74e3-4ee0-85ff-db9cc455dad8 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:20.869503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060dcd3-74e3-4ee0-85ff-db9cc455dad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:20.870047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060dcd3-74e3-4ee0-85ff-db9cc455dad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:20.897634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060dcd3-74e3-4ee0-85ff-db9cc455dad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:20.899593 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060dcd3-74e3-4ee0-85ff-db9cc455dad8 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:20.903496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384feca-540f-410e-b552-3506db802539 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:20.913586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bfcb3-54ce-454f-8781-b5d1da1a828b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:20.914474 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bfcb3-54ce-454f-8781-b5d1da1a828b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:20.914838 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bfcb3-54ce-454f-8781-b5d1da1a828b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:20.915144 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bfcb3-54ce-454f-8781-b5d1da1a828b admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:20.916735 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bfcb3-54ce-454f-8781-b5d1da1a828b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:20.919187 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bfcb3-54ce-454f-8781-b5d1da1a828b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:20.928593 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 982/1977] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:27:20.942775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 996/1978] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:27:20.943886 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060dcd3-74e3-4ee0-85ff-db9cc455dad8 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:20.972532 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060dcd3-74e3-4ee0-85ff-db9cc455dad8 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:20.981871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29f7ff-bf22-4e88-b040-df717b38acaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:20.983619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29f7ff-bf22-4e88-b040-df717b38acaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:20.984217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29f7ff-bf22-4e88-b040-df717b38acaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:20.984707 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29f7ff-bf22-4e88-b040-df717b38acaf admin admin] PATH_INFO: `/v3/projects/9ddc41eee5074ccfaedb992a3f10b414/users/e5a26021778c4ee99a2f25aeb6a62b53/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:21.050335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29f7ff-bf22-4e88-b040-df717b38acaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ddc41eee5074ccfaedb992a3f10b414, user_id=e5a26021778c4ee99a2f25aeb6a62b53, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:21.070855 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29f7ff-bf22-4e88-b040-df717b38acaf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:21.103056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 983/1979] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:20 2022] PUT /identity/v3/projects/9ddc41eee5074ccfaedb992a3f10b414/users/e5a26021778c4ee99a2f25aeb6a62b53/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:21.109658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bfcb3-54ce-454f-8781-b5d1da1a828b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:21.147197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bfcb3-54ce-454f-8781-b5d1da1a828b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:21.280899 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0fe1a-fc6d-4f90-94e6-ee9538a11dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:21.282272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0fe1a-fc6d-4f90-94e6-ee9538a11dce admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:21.282676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0fe1a-fc6d-4f90-94e6-ee9538a11dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:21.284098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0fe1a-fc6d-4f90-94e6-ee9538a11dce admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:21.285404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0fe1a-fc6d-4f90-94e6-ee9538a11dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:21.287570 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0fe1a-fc6d-4f90-94e6-ee9538a11dce admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:21.304057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 997/1980] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:27:21.312564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29f7ff-bf22-4e88-b040-df717b38acaf admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:21.374382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29f7ff-bf22-4e88-b040-df717b38acaf admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:21.388113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880ed53-007b-4937-8516-756a3d11130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:21.390326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880ed53-007b-4937-8516-756a3d11130f admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:21.391156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880ed53-007b-4937-8516-756a3d11130f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:21.392574 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880ed53-007b-4937-8516-756a3d11130f admin admin] PATH_INFO: `/v3/projects/9ddc41eee5074ccfaedb992a3f10b414/users/e5a26021778c4ee99a2f25aeb6a62b53/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:21.396971 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880ed53-007b-4937-8516-756a3d11130f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ddc41eee5074ccfaedb992a3f10b414, user_id=e5a26021778c4ee99a2f25aeb6a62b53, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:21.403654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880ed53-007b-4937-8516-756a3d11130f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:21.457773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 984/1981] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:21 2022] PUT /identity/v3/projects/9ddc41eee5074ccfaedb992a3f10b414/users/e5a26021778c4ee99a2f25aeb6a62b53/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:27:21.476263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176623f-f418-4a08-ba91-2f9c40254ab8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:21.476951 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176623f-f418-4a08-ba91-2f9c40254ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:21.477435 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176623f-f418-4a08-ba91-2f9c40254ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:21.545242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8176623f-f418-4a08-ba91-2f9c40254ab8 None None] MFA Rules not processed for user `e5a26021778c4ee99a2f25aeb6a62b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:21.547448 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8176623f-f418-4a08-ba91-2f9c40254ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:21.714319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 998/1982] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:21 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:21.726373 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880ed53-007b-4937-8516-756a3d11130f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:22.005432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880ed53-007b-4937-8516-756a3d11130f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:22.051860 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f3e3a-c703-455e-80da-e8d38972e4c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:22.053680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f3e3a-c703-455e-80da-e8d38972e4c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:22.055481 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f3e3a-c703-455e-80da-e8d38972e4c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:22.056074 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f3e3a-c703-455e-80da-e8d38972e4c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:22.102843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f3e3a-c703-455e-80da-e8d38972e4c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:22.109565 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f3e3a-c703-455e-80da-e8d38972e4c7 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:22.149255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 985/1983] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:21 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:22.461039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176623f-f418-4a08-ba91-2f9c40254ab8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:22.487942 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176623f-f418-4a08-ba91-2f9c40254ab8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:22.502064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd02208-7d4d-4ae3-8d3c-c35edf7f34ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:22.503262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd02208-7d4d-4ae3-8d3c-c35edf7f34ed service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:22.503720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd02208-7d4d-4ae3-8d3c-c35edf7f34ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:22.504217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd02208-7d4d-4ae3-8d3c-c35edf7f34ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:22.539439 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:22.563116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b6ecb-3269-4ec4-a0b1-c056cd9a8c2e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:22.563418 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b6ecb-3269-4ec4-a0b1-c056cd9a8c2e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:22.563715 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b6ecb-3269-4ec4-a0b1-c056cd9a8c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:22.606003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd02208-7d4d-4ae3-8d3c-c35edf7f34ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:22.607586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd02208-7d4d-4ae3-8d3c-c35edf7f34ed service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:22.616862 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9e0b6ecb-3269-4ec4-a0b1-c056cd9a8c2e None None] MFA Rules not processed for user `77ff2c22fc684248b9cff546e5eefd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:22.621093 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9e0b6ecb-3269-4ec4-a0b1-c056cd9a8c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:22.621580 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 999/1984] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:22 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:22.703533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:22.746279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 986/1985] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:23.298977 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af7c5f-3309-49be-9bff-93452ec35b88 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:23.299272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af7c5f-3309-49be-9bff-93452ec35b88 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:23.299561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af7c5f-3309-49be-9bff-93452ec35b88 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:23.301412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1000/1986] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 27 15:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:27:23.319830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eade2-e907-4da8-be0d-ada5666c0625 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:23.320855 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eade2-e907-4da8-be0d-ada5666c0625 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:23.321303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eade2-e907-4da8-be0d-ada5666c0625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:23.410438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-195eade2-e907-4da8-be0d-ada5666c0625 None None] MFA Rules not processed for user `b471b5b4ede845c7a9dfbf2a90544591`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:23.412142 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-195eade2-e907-4da8-be0d-ada5666c0625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:23.618450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 987/1987] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 27 15:27:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:23.680425 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af7c5f-3309-49be-9bff-93452ec35b88 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:23.684547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a2af7c5f-3309-49be-9bff-93452ec35b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:23.732453 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eade2-e907-4da8-be0d-ada5666c0625 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:23.734708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-195eade2-e907-4da8-be0d-ada5666c0625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:23.773180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af7c5f-3309-49be-9bff-93452ec35b88 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:23.806004 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6656a53-4fbc-4470-923a-82c9d84bdbf3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b471b5b4ede845c7a9dfbf2a90544591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:23.807776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6656a53-4fbc-4470-923a-82c9d84bdbf3 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:23.812311 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6656a53-4fbc-4470-923a-82c9d84bdbf3 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:23.815169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6656a53-4fbc-4470-923a-82c9d84bdbf3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:23.862932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6656a53-4fbc-4470-923a-82c9d84bdbf3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:23.873523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6656a53-4fbc-4470-923a-82c9d84bdbf3 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:23.938210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1001/1988] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:23.984873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eade2-e907-4da8-be0d-ada5666c0625 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:24.001075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4440bf2-a8bd-4604-a946-c4d99bf8706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:24.002809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4440bf2-a8bd-4604-a946-c4d99bf8706e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:24.003321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4440bf2-a8bd-4604-a946-c4d99bf8706e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:24.003732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4440bf2-a8bd-4604-a946-c4d99bf8706e admin admin] PATH_INFO: `/v3/users/0b9e52d16695470dbbf42a45dae4271b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:24.011494 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4440bf2-a8bd-4604-a946-c4d99bf8706e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b9e52d16695470dbbf42a45dae4271b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:24.018615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4440bf2-a8bd-4604-a946-c4d99bf8706e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:24.147850 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a4440bf2-a8bd-4604-a946-c4d99bf8706e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b9e52d16695470dbbf42a45dae4271b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:24.177530 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a4440bf2-a8bd-4604-a946-c4d99bf8706e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b9e52d16695470dbbf42a45dae4271b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:24.190300 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a4440bf2-a8bd-4604-a946-c4d99bf8706e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b9e52d16695470dbbf42a45dae4271b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:24.191179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a4440bf2-a8bd-4604-a946-c4d99bf8706e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b9e52d16695470dbbf42a45dae4271b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:24.211090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a4440bf2-a8bd-4604-a946-c4d99bf8706e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b9e52d16695470dbbf42a45dae4271b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:24.223306 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 988/1989] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:27:23 2022] DELETE /identity/v3/users/0b9e52d16695470dbbf42a45dae4271b => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:24.497710 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6656a53-4fbc-4470-923a-82c9d84bdbf3 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:24.518588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6656a53-4fbc-4470-923a-82c9d84bdbf3 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:24.621691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb3479-dd68-44f8-b281-b47236036f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:24.623381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb3479-dd68-44f8-b281-b47236036f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:24.623381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb3479-dd68-44f8-b281-b47236036f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:24.624312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb3479-dd68-44f8-b281-b47236036f7f admin admin] PATH_INFO: `/v3/projects/5eecbecf72da407fa30e3035276ece75` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:24.626170 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb3479-dd68-44f8-b281-b47236036f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eecbecf72da407fa30e3035276ece75)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:24.628378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb3479-dd68-44f8-b281-b47236036f7f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:24.750849 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2acb3479-dd68-44f8-b281-b47236036f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eecbecf72da407fa30e3035276ece75', 'request_id': 'req-2acb3479-dd68-44f8-b281-b47236036f7f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:24.769687 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2acb3479-dd68-44f8-b281-b47236036f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eecbecf72da407fa30e3035276ece75', 'request_id': 'req-2acb3479-dd68-44f8-b281-b47236036f7f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:24.784691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2acb3479-dd68-44f8-b281-b47236036f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eecbecf72da407fa30e3035276ece75', 'request_id': 'req-2acb3479-dd68-44f8-b281-b47236036f7f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:24.831291 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2acb3479-dd68-44f8-b281-b47236036f7f admin admin] The token cache is being invalidate because project 5eecbecf72da407fa30e3035276ece75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:27:24.832747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2acb3479-dd68-44f8-b281-b47236036f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:24.834551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2acb3479-dd68-44f8-b281-b47236036f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:24.841409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1002/1990] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:27:24 2022] DELETE /identity/v3/projects/5eecbecf72da407fa30e3035276ece75 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:24.849852 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f0fc0-a8a1-4d2e-bf95-afafcdf8d493 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:24.850859 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f0fc0-a8a1-4d2e-bf95-afafcdf8d493 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:24.851353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f0fc0-a8a1-4d2e-bf95-afafcdf8d493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:24.881725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:24.918659 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-482f0fc0-a8a1-4d2e-bf95-afafcdf8d493 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:24.920938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-482f0fc0-a8a1-4d2e-bf95-afafcdf8d493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:25.026421 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 989/1991] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:25.040398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6be161-bd95-4713-9361-50400c0cb170 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:25.041823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6be161-bd95-4713-9361-50400c0cb170 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:25.042399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6be161-bd95-4713-9361-50400c0cb170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:25.078688 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fa6be161-bd95-4713-9361-50400c0cb170 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:25.081325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fa6be161-bd95-4713-9361-50400c0cb170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:25.118982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1003/1992] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:25.125102 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f0fc0-a8a1-4d2e-bf95-afafcdf8d493 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:25.169413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f0fc0-a8a1-4d2e-bf95-afafcdf8d493 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:25.182819 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86afd8a-3f8f-4570-8572-6124b20a7702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:25.184047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86afd8a-3f8f-4570-8572-6124b20a7702 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:25.184734 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86afd8a-3f8f-4570-8572-6124b20a7702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:25.185249 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86afd8a-3f8f-4570-8572-6124b20a7702 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:25.186545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86afd8a-3f8f-4570-8572-6124b20a7702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:27:25.187227 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86afd8a-3f8f-4570-8572-6124b20a7702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:25.189719 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86afd8a-3f8f-4570-8572-6124b20a7702 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:25.208322 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 990/1993] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:27:25.214182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6be161-bd95-4713-9361-50400c0cb170 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:25.226973 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6be161-bd95-4713-9361-50400c0cb170 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:25.233362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af0f45-7c5f-4a68-b3df-c978757ba19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:25.234435 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af0f45-7c5f-4a68-b3df-c978757ba19f admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:25.235048 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af0f45-7c5f-4a68-b3df-c978757ba19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:25.235464 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af0f45-7c5f-4a68-b3df-c978757ba19f admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:25.236322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af0f45-7c5f-4a68-b3df-c978757ba19f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:25.238626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af0f45-7c5f-4a68-b3df-c978757ba19f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:25.282280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1004/1994] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:27:25 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:27:25.288450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86afd8a-3f8f-4570-8572-6124b20a7702 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:25.306051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86afd8a-3f8f-4570-8572-6124b20a7702 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:25.483892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c93b0-b73f-48de-ade0-f283db4632d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:25.485662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c93b0-b73f-48de-ade0-f283db4632d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:25.486309 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c93b0-b73f-48de-ade0-f283db4632d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:25.486857 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c93b0-b73f-48de-ade0-f283db4632d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:25.489148 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c93b0-b73f-48de-ade0-f283db4632d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:25.493093 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c93b0-b73f-48de-ade0-f283db4632d7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:25.520592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 991/1995] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:27:25 2022] POST /identity/v3/users => generated 288 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:27:25.533143 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af0f45-7c5f-4a68-b3df-c978757ba19f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:25.541136 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:25.554366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af0f45-7c5f-4a68-b3df-c978757ba19f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:25.563261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0f381-5797-4131-b35c-75b00254d222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:25.564235 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0f381-5797-4131-b35c-75b00254d222 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:25.564927 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0f381-5797-4131-b35c-75b00254d222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:25.565544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0f381-5797-4131-b35c-75b00254d222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:25.567988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0f381-5797-4131-b35c-75b00254d222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:25.569862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0f381-5797-4131-b35c-75b00254d222 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:25.586812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1005/1996] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:27:25.588335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c93b0-b73f-48de-ade0-f283db4632d7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:25.607238 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c93b0-b73f-48de-ade0-f283db4632d7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:25.615276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4111f-e20d-4869-97fb-6e61611d67fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:25.616469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4111f-e20d-4869-97fb-6e61611d67fc admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:25.616992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4111f-e20d-4869-97fb-6e61611d67fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:25.617512 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4111f-e20d-4869-97fb-6e61611d67fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:25.618950 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4111f-e20d-4869-97fb-6e61611d67fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:25.621977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4111f-e20d-4869-97fb-6e61611d67fc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:25.639553 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 992/1997] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:27:25.644082 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0f381-5797-4131-b35c-75b00254d222 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:25.661328 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0f381-5797-4131-b35c-75b00254d222 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:25.674534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caf29e-6393-4017-a814-55d34641b93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:25.674534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caf29e-6393-4017-a814-55d34641b93b admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:25.674534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caf29e-6393-4017-a814-55d34641b93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:25.675277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caf29e-6393-4017-a814-55d34641b93b admin admin] PATH_INFO: `/v3/projects/23386e79711a462a99425fab87ccea07/users/6583546c9f4f4699bfa7c7afebc72cc3/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:25.703872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5caf29e-6393-4017-a814-55d34641b93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=23386e79711a462a99425fab87ccea07, user_id=6583546c9f4f4699bfa7c7afebc72cc3, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:25.707400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5caf29e-6393-4017-a814-55d34641b93b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:25.734851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1006/1998] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:25 2022] PUT /identity/v3/projects/23386e79711a462a99425fab87ccea07/users/6583546c9f4f4699bfa7c7afebc72cc3/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:25.748149 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea305df3-af70-421d-9828-0c0e31b98dc0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:25.748548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea305df3-af70-421d-9828-0c0e31b98dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:25.749023 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea305df3-af70-421d-9828-0c0e31b98dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:25.796865 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ea305df3-af70-421d-9828-0c0e31b98dc0 None None] MFA Rules not processed for user `6583546c9f4f4699bfa7c7afebc72cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:25.798253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ea305df3-af70-421d-9828-0c0e31b98dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:25.934365 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 993/1999] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:27:25.946906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caf29e-6393-4017-a814-55d34641b93b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:25.950556 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d5caf29e-6393-4017-a814-55d34641b93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:26.056109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caf29e-6393-4017-a814-55d34641b93b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:26.062390 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44a571-c6b6-4963-80e2-9ec763420fc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:26.063084 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44a571-c6b6-4963-80e2-9ec763420fc4 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:26.063370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44a571-c6b6-4963-80e2-9ec763420fc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:26.063650 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44a571-c6b6-4963-80e2-9ec763420fc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:26.073931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44a571-c6b6-4963-80e2-9ec763420fc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:26.075621 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44a571-c6b6-4963-80e2-9ec763420fc4 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:26.087266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1007/2000] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:26.396378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea305df3-af70-421d-9828-0c0e31b98dc0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:26.401271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:26.502874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea305df3-af70-421d-9828-0c0e31b98dc0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:26.517457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfa874-4430-4f03-9022-fc63630e025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:26.518585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfa874-4430-4f03-9022-fc63630e025e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:26.518943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfa874-4430-4f03-9022-fc63630e025e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:26.519301 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfa874-4430-4f03-9022-fc63630e025e admin admin] PATH_INFO: `/v3/users/6583546c9f4f4699bfa7c7afebc72cc3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:26.527015 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfa874-4430-4f03-9022-fc63630e025e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6583546c9f4f4699bfa7c7afebc72cc3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:26.529333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfa874-4430-4f03-9022-fc63630e025e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:26.605848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-85bfa874-4430-4f03-9022-fc63630e025e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6583546c9f4f4699bfa7c7afebc72cc3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:26.615006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-85bfa874-4430-4f03-9022-fc63630e025e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6583546c9f4f4699bfa7c7afebc72cc3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:26.626041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-85bfa874-4430-4f03-9022-fc63630e025e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6583546c9f4f4699bfa7c7afebc72cc3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:26.629015 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-85bfa874-4430-4f03-9022-fc63630e025e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6583546c9f4f4699bfa7c7afebc72cc3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:26.666839 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-85bfa874-4430-4f03-9022-fc63630e025e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6583546c9f4f4699bfa7c7afebc72cc3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:26.677393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 994/2001] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:27:26 2022] DELETE /identity/v3/users/6583546c9f4f4699bfa7c7afebc72cc3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:26.684704 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa54cf-156d-45b2-a834-5728c35f4562 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:26.685399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa54cf-156d-45b2-a834-5728c35f4562 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:26.685861 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa54cf-156d-45b2-a834-5728c35f4562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:26.706703 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e1aa54cf-156d-45b2-a834-5728c35f4562 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:26.708038 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e1aa54cf-156d-45b2-a834-5728c35f4562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:26.814090 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1008/2002] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:26.827197 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfa874-4430-4f03-9022-fc63630e025e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:26.829478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-85bfa874-4430-4f03-9022-fc63630e025e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:26.925511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfa874-4430-4f03-9022-fc63630e025e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:26.929793 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746ec0f-d5c2-46f4-be6c-2aba4fdcbdcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:26.930654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746ec0f-d5c2-46f4-be6c-2aba4fdcbdcc service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:26.930996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746ec0f-d5c2-46f4-be6c-2aba4fdcbdcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:26.931331 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746ec0f-d5c2-46f4-be6c-2aba4fdcbdcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:26.948446 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746ec0f-d5c2-46f4-be6c-2aba4fdcbdcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:26.951035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746ec0f-d5c2-46f4-be6c-2aba4fdcbdcc service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:26.963036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 995/2003] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:27.600462 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa54cf-156d-45b2-a834-5728c35f4562 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:27.602293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e1aa54cf-156d-45b2-a834-5728c35f4562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:27.628439 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa54cf-156d-45b2-a834-5728c35f4562 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:27.638257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617abd0a-48cb-4f9e-972a-89f6cc36667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:27.639998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617abd0a-48cb-4f9e-972a-89f6cc36667e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:27.640450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617abd0a-48cb-4f9e-972a-89f6cc36667e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:27.641283 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617abd0a-48cb-4f9e-972a-89f6cc36667e admin admin] PATH_INFO: `/v3/projects/23386e79711a462a99425fab87ccea07` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:27.643968 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617abd0a-48cb-4f9e-972a-89f6cc36667e admin admin] RBAC: Authorizing `identity:delete_project(project_id=23386e79711a462a99425fab87ccea07)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:27.649019 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617abd0a-48cb-4f9e-972a-89f6cc36667e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:27.752648 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:27.755526 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-617abd0a-48cb-4f9e-972a-89f6cc36667e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23386e79711a462a99425fab87ccea07', 'request_id': 'req-617abd0a-48cb-4f9e-972a-89f6cc36667e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:27.770837 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-617abd0a-48cb-4f9e-972a-89f6cc36667e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23386e79711a462a99425fab87ccea07', 'request_id': 'req-617abd0a-48cb-4f9e-972a-89f6cc36667e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:27.785264 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-617abd0a-48cb-4f9e-972a-89f6cc36667e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23386e79711a462a99425fab87ccea07', 'request_id': 'req-617abd0a-48cb-4f9e-972a-89f6cc36667e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:27.810980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-617abd0a-48cb-4f9e-972a-89f6cc36667e admin admin] The token cache is being invalidate because project 23386e79711a462a99425fab87ccea07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:27:27.811326 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-617abd0a-48cb-4f9e-972a-89f6cc36667e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:27.812489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-617abd0a-48cb-4f9e-972a-89f6cc36667e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:27.814458 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1009/2004] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:27:27 2022] DELETE /identity/v3/projects/23386e79711a462a99425fab87ccea07 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:27:27.820750 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fb667-3d47-455b-b455-82a1f50a76be None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:27.821334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fb667-3d47-455b-b455-82a1f50a76be None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:27.821828 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fb667-3d47-455b-b455-82a1f50a76be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:27.859481 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-021fb667-3d47-455b-b455-82a1f50a76be None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:27.860005 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-021fb667-3d47-455b-b455-82a1f50a76be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:27.897369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:27.966551 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 996/2005] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:27.980475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e62fe3-4ee9-496d-825b-bf98f87d250a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:27.980802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e62fe3-4ee9-496d-825b-bf98f87d250a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:27.981042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e62fe3-4ee9-496d-825b-bf98f87d250a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:28.015347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-76e62fe3-4ee9-496d-825b-bf98f87d250a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:28.016689 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-76e62fe3-4ee9-496d-825b-bf98f87d250a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:28.032293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1010/2006] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:28.040937 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fb667-3d47-455b-b455-82a1f50a76be None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:28.086187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fb667-3d47-455b-b455-82a1f50a76be None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:28.095418 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a76ab0-c192-407f-985c-597622c8df87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:28.096544 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a76ab0-c192-407f-985c-597622c8df87 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:28.097047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a76ab0-c192-407f-985c-597622c8df87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:28.097538 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a76ab0-c192-407f-985c-597622c8df87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:28.099161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a76ab0-c192-407f-985c-597622c8df87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:27:28.099729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a76ab0-c192-407f-985c-597622c8df87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:28.104472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a76ab0-c192-407f-985c-597622c8df87 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:28.121412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 997/2007] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:27:28.126088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e62fe3-4ee9-496d-825b-bf98f87d250a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:28.143918 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e62fe3-4ee9-496d-825b-bf98f87d250a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:28.150671 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2f1cd-7f7a-4b80-8bf1-45125217dafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:28.151451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2f1cd-7f7a-4b80-8bf1-45125217dafc admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:28.151805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2f1cd-7f7a-4b80-8bf1-45125217dafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:28.152139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2f1cd-7f7a-4b80-8bf1-45125217dafc admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:28.153480 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2f1cd-7f7a-4b80-8bf1-45125217dafc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:28.155741 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2f1cd-7f7a-4b80-8bf1-45125217dafc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:28.193358 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1011/2008] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:27:28 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:28.197335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a76ab0-c192-407f-985c-597622c8df87 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:28.208551 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a76ab0-c192-407f-985c-597622c8df87 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:28.280706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1ae93-ec0e-4ec0-890e-775073686721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:28.281872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1ae93-ec0e-4ec0-890e-775073686721 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:28.282443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1ae93-ec0e-4ec0-890e-775073686721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:28.283147 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1ae93-ec0e-4ec0-890e-775073686721 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:28.284472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1ae93-ec0e-4ec0-890e-775073686721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:28.287721 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1ae93-ec0e-4ec0-890e-775073686721 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:28.321526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 998/2009] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:27:28 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:28.324305 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2f1cd-7f7a-4b80-8bf1-45125217dafc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:28.339174 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2f1cd-7f7a-4b80-8bf1-45125217dafc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:28.344851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4767d3-221c-4397-8cab-72c785b79d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:28.345542 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4767d3-221c-4397-8cab-72c785b79d76 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:28.346020 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4767d3-221c-4397-8cab-72c785b79d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:28.346340 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4767d3-221c-4397-8cab-72c785b79d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:28.347096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4767d3-221c-4397-8cab-72c785b79d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:28.348770 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4767d3-221c-4397-8cab-72c785b79d76 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:28.362267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1012/2010] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:27:28.371198 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1ae93-ec0e-4ec0-890e-775073686721 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:28.387600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1ae93-ec0e-4ec0-890e-775073686721 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:28.394352 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a85fe-dc29-4176-a46d-1eab2e1bacef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:28.395452 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a85fe-dc29-4176-a46d-1eab2e1bacef admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:28.395938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a85fe-dc29-4176-a46d-1eab2e1bacef admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:28.396427 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a85fe-dc29-4176-a46d-1eab2e1bacef admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:28.397385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a85fe-dc29-4176-a46d-1eab2e1bacef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:28.399507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a85fe-dc29-4176-a46d-1eab2e1bacef admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:28.413668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 999/2011] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:27:28.418918 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4767d3-221c-4397-8cab-72c785b79d76 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:28.433105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4767d3-221c-4397-8cab-72c785b79d76 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:28.440852 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4a1fe-88d5-43e7-b548-47c34bafceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:28.441952 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4a1fe-88d5-43e7-b548-47c34bafceed admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:28.442386 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4a1fe-88d5-43e7-b548-47c34bafceed admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:28.442766 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4a1fe-88d5-43e7-b548-47c34bafceed admin admin] PATH_INFO: `/v3/projects/1995963881cf4139a07d9554ca4dc6a9/users/e0759adbee524296b32f8401cebc6d7c/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:28.475320 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4a1fe-88d5-43e7-b548-47c34bafceed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1995963881cf4139a07d9554ca4dc6a9, user_id=e0759adbee524296b32f8401cebc6d7c, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:28.478378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4a1fe-88d5-43e7-b548-47c34bafceed admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:28.494456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1013/2012] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:28 2022] PUT /identity/v3/projects/1995963881cf4139a07d9554ca4dc6a9/users/e0759adbee524296b32f8401cebc6d7c/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:27:28.505606 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e279631-ab9b-4df8-a077-afbcac1e29b1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:28.506092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e279631-ab9b-4df8-a077-afbcac1e29b1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:28.506613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e279631-ab9b-4df8-a077-afbcac1e29b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:28.549583 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4e279631-ab9b-4df8-a077-afbcac1e29b1 None None] MFA Rules not processed for user `e0759adbee524296b32f8401cebc6d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:28.551053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4e279631-ab9b-4df8-a077-afbcac1e29b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:28.634194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1000/2013] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:28.635657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4a1fe-88d5-43e7-b548-47c34bafceed admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:28.728413 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4a1fe-88d5-43e7-b548-47c34bafceed admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:28.735510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3030f-0d3d-4417-a386-77771f26660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:28.736326 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3030f-0d3d-4417-a386-77771f26660b admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:28.736610 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3030f-0d3d-4417-a386-77771f26660b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:28.736910 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3030f-0d3d-4417-a386-77771f26660b admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:28.737616 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3030f-0d3d-4417-a386-77771f26660b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:28.739794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3030f-0d3d-4417-a386-77771f26660b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:28.772610 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1014/2014] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:27:28 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:28.776880 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e279631-ab9b-4df8-a077-afbcac1e29b1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:28.791544 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e279631-ab9b-4df8-a077-afbcac1e29b1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:28.812069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:28.865826 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f93a1-b686-48e7-9a57-efcf89bca6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:28.867076 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f93a1-b686-48e7-9a57-efcf89bca6cd admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:28.867568 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f93a1-b686-48e7-9a57-efcf89bca6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:28.868044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f93a1-b686-48e7-9a57-efcf89bca6cd admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:28.869149 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f93a1-b686-48e7-9a57-efcf89bca6cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:28.871710 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f93a1-b686-48e7-9a57-efcf89bca6cd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:28.902303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1001/2015] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:27:28 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:27:28.908510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3030f-0d3d-4417-a386-77771f26660b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:28.925944 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3030f-0d3d-4417-a386-77771f26660b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:28.934545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcedb24-2bb3-4d31-b954-3fb5563ac834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:28.935437 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcedb24-2bb3-4d31-b954-3fb5563ac834 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:28.935692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcedb24-2bb3-4d31-b954-3fb5563ac834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:28.936062 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcedb24-2bb3-4d31-b954-3fb5563ac834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:28.937236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcedb24-2bb3-4d31-b954-3fb5563ac834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:28.940444 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcedb24-2bb3-4d31-b954-3fb5563ac834 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:28.964118 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1015/2016] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:27:28.971174 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f93a1-b686-48e7-9a57-efcf89bca6cd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:28.995825 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f93a1-b686-48e7-9a57-efcf89bca6cd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:29.002948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c89055-234b-4fb8-82d4-33ace47710d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:29.004333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c89055-234b-4fb8-82d4-33ace47710d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:29.004835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c89055-234b-4fb8-82d4-33ace47710d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:29.005321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c89055-234b-4fb8-82d4-33ace47710d6 admin admin] PATH_INFO: `/v3/projects/60e3bb647aff4fb7a76b77196230fe4d/users/b6f5f3fcf70042bdad8f55b1dd4b69c4/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:29.034581 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c89055-234b-4fb8-82d4-33ace47710d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e3bb647aff4fb7a76b77196230fe4d, user_id=b6f5f3fcf70042bdad8f55b1dd4b69c4, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:29.046396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c89055-234b-4fb8-82d4-33ace47710d6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:29.066903 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1002/2017] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:28 2022] PUT /identity/v3/projects/60e3bb647aff4fb7a76b77196230fe4d/users/b6f5f3fcf70042bdad8f55b1dd4b69c4/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:29.071301 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcedb24-2bb3-4d31-b954-3fb5563ac834 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:29.086235 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcedb24-2bb3-4d31-b954-3fb5563ac834 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:29.154313 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:29.178502 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e353db2-7182-4f5b-bf56-2da61acb7cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:29.179474 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353db2-7182-4f5b-bf56-2da61acb7cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:29.179909 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353db2-7182-4f5b-bf56-2da61acb7cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:29.180333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353db2-7182-4f5b-bf56-2da61acb7cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:29.181281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e353db2-7182-4f5b-bf56-2da61acb7cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:29.183202 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e353db2-7182-4f5b-bf56-2da61acb7cdb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:29.210330 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1016/2018] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:27:29.211566 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c89055-234b-4fb8-82d4-33ace47710d6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:29.232609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c89055-234b-4fb8-82d4-33ace47710d6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:29.240726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbfa24-c006-46b7-8b40-588f85ef0bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:29.242700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbfa24-c006-46b7-8b40-588f85ef0bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:29.246052 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbfa24-c006-46b7-8b40-588f85ef0bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:29.246532 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbfa24-c006-46b7-8b40-588f85ef0bcc admin admin] PATH_INFO: `/v3/projects/60e3bb647aff4fb7a76b77196230fe4d/users/b6f5f3fcf70042bdad8f55b1dd4b69c4/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:29.249948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbfa24-c006-46b7-8b40-588f85ef0bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e3bb647aff4fb7a76b77196230fe4d, user_id=b6f5f3fcf70042bdad8f55b1dd4b69c4, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:29.253829 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbfa24-c006-46b7-8b40-588f85ef0bcc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:29.270990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1003/2019] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:29 2022] PUT /identity/v3/projects/60e3bb647aff4fb7a76b77196230fe4d/users/b6f5f3fcf70042bdad8f55b1dd4b69c4/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:29.283920 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9051ee-5001-4387-ac7c-1aaf9371d6a1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:29.284223 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9051ee-5001-4387-ac7c-1aaf9371d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:29.284523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9051ee-5001-4387-ac7c-1aaf9371d6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:29.322720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4f9051ee-5001-4387-ac7c-1aaf9371d6a1 None None] MFA Rules not processed for user `b6f5f3fcf70042bdad8f55b1dd4b69c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:29.324199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4f9051ee-5001-4387-ac7c-1aaf9371d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:29.373891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbfa24-c006-46b7-8b40-588f85ef0bcc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:29.377520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e5bbfa24-c006-46b7-8b40-588f85ef0bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:29.442463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1017/2020] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:29.456087 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9051ee-5001-4387-ac7c-1aaf9371d6a1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:29.457611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4f9051ee-5001-4387-ac7c-1aaf9371d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:29.479766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbfa24-c006-46b7-8b40-588f85ef0bcc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:29.490511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8447f00-6419-400d-83f6-bd98b1c2ff05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:29.492259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8447f00-6419-400d-83f6-bd98b1c2ff05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:29.492733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8447f00-6419-400d-83f6-bd98b1c2ff05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:29.493200 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8447f00-6419-400d-83f6-bd98b1c2ff05 admin admin] PATH_INFO: `/v3/users/bedd38f9df284383abbeb380af784159` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:29.495348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8447f00-6419-400d-83f6-bd98b1c2ff05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bedd38f9df284383abbeb380af784159)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:29.498515 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8447f00-6419-400d-83f6-bd98b1c2ff05 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:29.559936 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9051ee-5001-4387-ac7c-1aaf9371d6a1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:29.566603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44787c97-93ec-4feb-8075-d515a05e93d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:29.568308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44787c97-93ec-4feb-8075-d515a05e93d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:29.568580 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44787c97-93ec-4feb-8075-d515a05e93d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:29.568762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44787c97-93ec-4feb-8075-d515a05e93d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:29.575078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8447f00-6419-400d-83f6-bd98b1c2ff05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bedd38f9df284383abbeb380af784159'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:29.585759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44787c97-93ec-4feb-8075-d515a05e93d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:29.587361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44787c97-93ec-4feb-8075-d515a05e93d0 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:29.587548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8447f00-6419-400d-83f6-bd98b1c2ff05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bedd38f9df284383abbeb380af784159'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:29.608563 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1018/2021] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:29 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:27:29.612638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8447f00-6419-400d-83f6-bd98b1c2ff05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bedd38f9df284383abbeb380af784159'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:29.613954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8447f00-6419-400d-83f6-bd98b1c2ff05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bedd38f9df284383abbeb380af784159'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:29.624309 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:29.636113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8447f00-6419-400d-83f6-bd98b1c2ff05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bedd38f9df284383abbeb380af784159'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:29.644265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1004/2022] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:27:29 2022] DELETE /identity/v3/users/bedd38f9df284383abbeb380af784159 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:29.650483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb58f6-d712-4075-89f1-9a20cc2cb8c7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:29.651063 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb58f6-d712-4075-89f1-9a20cc2cb8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:29.651989 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb58f6-d712-4075-89f1-9a20cc2cb8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:29.674267 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3ecb58f6-d712-4075-89f1-9a20cc2cb8c7 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:29.675520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3ecb58f6-d712-4075-89f1-9a20cc2cb8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:29.716109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8447f00-6419-400d-83f6-bd98b1c2ff05 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:29.717613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f8447f00-6419-400d-83f6-bd98b1c2ff05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:29.769401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1019/2023] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:29.779794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb58f6-d712-4075-89f1-9a20cc2cb8c7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:29.781641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3ecb58f6-d712-4075-89f1-9a20cc2cb8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:29.799740 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:29.809078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8447f00-6419-400d-83f6-bd98b1c2ff05 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:29.813017 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2af05-9d80-48de-a269-114bf493e822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:29.813718 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2af05-9d80-48de-a269-114bf493e822 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:29.814004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2af05-9d80-48de-a269-114bf493e822 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:29.814309 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2af05-9d80-48de-a269-114bf493e822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:29.816245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f4d2af05-9d80-48de-a269-114bf493e822 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:29.868297 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb58f6-d712-4075-89f1-9a20cc2cb8c7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:29.881635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5f003-9e93-43f3-9cdd-d4e52c360364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:29.882359 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5f003-9e93-43f3-9cdd-d4e52c360364 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:29.882660 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5f003-9e93-43f3-9cdd-d4e52c360364 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:29.883023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5f003-9e93-43f3-9cdd-d4e52c360364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:29.889916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2af05-9d80-48de-a269-114bf493e822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:29.890100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2af05-9d80-48de-a269-114bf493e822 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:29.895040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5f003-9e93-43f3-9cdd-d4e52c360364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:29.896924 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5f003-9e93-43f3-9cdd-d4e52c360364 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:29.900911 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1005/2024] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:29.908613 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1020/2025] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:27:30.317311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2af05-9d80-48de-a269-114bf493e822 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:30.319063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f4d2af05-9d80-48de-a269-114bf493e822 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:30.336423 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2af05-9d80-48de-a269-114bf493e822 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:30.358511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9804a-0bd7-4045-90a4-004ce1ec40e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:30.359921 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9804a-0bd7-4045-90a4-004ce1ec40e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:30.360297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9804a-0bd7-4045-90a4-004ce1ec40e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:30.360776 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9804a-0bd7-4045-90a4-004ce1ec40e3 admin admin] PATH_INFO: `/v3/projects/b58934ded378452a97849bb6992f01a0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:30.364004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9804a-0bd7-4045-90a4-004ce1ec40e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58934ded378452a97849bb6992f01a0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:30.366998 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9804a-0bd7-4045-90a4-004ce1ec40e3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:30.458381 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-99a9804a-0bd7-4045-90a4-004ce1ec40e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58934ded378452a97849bb6992f01a0', 'request_id': 'req-99a9804a-0bd7-4045-90a4-004ce1ec40e3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:30.467823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-99a9804a-0bd7-4045-90a4-004ce1ec40e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58934ded378452a97849bb6992f01a0', 'request_id': 'req-99a9804a-0bd7-4045-90a4-004ce1ec40e3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:30.481580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-99a9804a-0bd7-4045-90a4-004ce1ec40e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58934ded378452a97849bb6992f01a0', 'request_id': 'req-99a9804a-0bd7-4045-90a4-004ce1ec40e3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:30.498026 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-99a9804a-0bd7-4045-90a4-004ce1ec40e3 admin admin] The token cache is being invalidate because project b58934ded378452a97849bb6992f01a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:27:30.499000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-99a9804a-0bd7-4045-90a4-004ce1ec40e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:30.499811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-99a9804a-0bd7-4045-90a4-004ce1ec40e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:30.501478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1006/2026] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:27:30 2022] DELETE /identity/v3/projects/b58934ded378452a97849bb6992f01a0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:27:30.506813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5f003-9e93-43f3-9cdd-d4e52c360364 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:30.517751 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5f003-9e93-43f3-9cdd-d4e52c360364 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:30.601294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72f432-3f1f-4a82-8bcf-716f8a5e6e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:30.602636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72f432-3f1f-4a82-8bcf-716f8a5e6e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:30.602915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72f432-3f1f-4a82-8bcf-716f8a5e6e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:30.603311 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72f432-3f1f-4a82-8bcf-716f8a5e6e50 admin admin] PATH_INFO: `/v3/users/e5a26021778c4ee99a2f25aeb6a62b53` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:30.605265 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72f432-3f1f-4a82-8bcf-716f8a5e6e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a26021778c4ee99a2f25aeb6a62b53)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:30.609001 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72f432-3f1f-4a82-8bcf-716f8a5e6e50 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:30.684708 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1d72f432-3f1f-4a82-8bcf-716f8a5e6e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a26021778c4ee99a2f25aeb6a62b53'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:30.693709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1d72f432-3f1f-4a82-8bcf-716f8a5e6e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a26021778c4ee99a2f25aeb6a62b53'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:30.694658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1d72f432-3f1f-4a82-8bcf-716f8a5e6e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a26021778c4ee99a2f25aeb6a62b53'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:30.695376 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1d72f432-3f1f-4a82-8bcf-716f8a5e6e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a26021778c4ee99a2f25aeb6a62b53'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:30.712092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1d72f432-3f1f-4a82-8bcf-716f8a5e6e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a26021778c4ee99a2f25aeb6a62b53'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:30.729312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1021/2027] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:27:30 2022] DELETE /identity/v3/users/e5a26021778c4ee99a2f25aeb6a62b53 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:31.054715 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9804a-0bd7-4045-90a4-004ce1ec40e3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:31.056860 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-99a9804a-0bd7-4045-90a4-004ce1ec40e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:31.093701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9804a-0bd7-4045-90a4-004ce1ec40e3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:31.124006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:31.159598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c0c61-be56-4b2e-8f75-486cb5147a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:31.160510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c0c61-be56-4b2e-8f75-486cb5147a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:31.160933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c0c61-be56-4b2e-8f75-486cb5147a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:31.161373 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c0c61-be56-4b2e-8f75-486cb5147a9b admin admin] PATH_INFO: `/v3/projects/9ddc41eee5074ccfaedb992a3f10b414` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:31.162656 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c0c61-be56-4b2e-8f75-486cb5147a9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ddc41eee5074ccfaedb992a3f10b414)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:31.165455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c0c61-be56-4b2e-8f75-486cb5147a9b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:31.221338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-249c0c61-be56-4b2e-8f75-486cb5147a9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ddc41eee5074ccfaedb992a3f10b414', 'request_id': 'req-249c0c61-be56-4b2e-8f75-486cb5147a9b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:31.230530 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-249c0c61-be56-4b2e-8f75-486cb5147a9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ddc41eee5074ccfaedb992a3f10b414', 'request_id': 'req-249c0c61-be56-4b2e-8f75-486cb5147a9b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:31.236836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-249c0c61-be56-4b2e-8f75-486cb5147a9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ddc41eee5074ccfaedb992a3f10b414', 'request_id': 'req-249c0c61-be56-4b2e-8f75-486cb5147a9b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:31.249724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-249c0c61-be56-4b2e-8f75-486cb5147a9b admin admin] The token cache is being invalidate because project 9ddc41eee5074ccfaedb992a3f10b414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:27:31.250080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-249c0c61-be56-4b2e-8f75-486cb5147a9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:31.250783 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-249c0c61-be56-4b2e-8f75-486cb5147a9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:31.252390 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1007/2028] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:27:31 2022] DELETE /identity/v3/projects/9ddc41eee5074ccfaedb992a3f10b414 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:31.257813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fee83-3b74-430d-b8bb-f080a475559c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:31.258110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fee83-3b74-430d-b8bb-f080a475559c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:31.258457 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fee83-3b74-430d-b8bb-f080a475559c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:31.279991 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-673fee83-3b74-430d-b8bb-f080a475559c None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:31.279991 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-673fee83-3b74-430d-b8bb-f080a475559c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:31.316530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:31.370832 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1022/2029] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:27:31.381142 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff72e45-c57a-4114-9a7b-7dc62a242d00 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:31.382111 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff72e45-c57a-4114-9a7b-7dc62a242d00 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:31.382466 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff72e45-c57a-4114-9a7b-7dc62a242d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:31.416389 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-aff72e45-c57a-4114-9a7b-7dc62a242d00 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:31.418410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-aff72e45-c57a-4114-9a7b-7dc62a242d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:31.472576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1008/2030] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:27:31.473901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fee83-3b74-430d-b8bb-f080a475559c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:31.486062 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fee83-3b74-430d-b8bb-f080a475559c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:31.502037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0a3de-f4d7-41c0-a741-6cc1d0d19c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:31.502783 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0a3de-f4d7-41c0-a741-6cc1d0d19c3e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:31.503117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0a3de-f4d7-41c0-a741-6cc1d0d19c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:31.503405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0a3de-f4d7-41c0-a741-6cc1d0d19c3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:31.504383 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0a3de-f4d7-41c0-a741-6cc1d0d19c3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:27:31.504856 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0a3de-f4d7-41c0-a741-6cc1d0d19c3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:31.506743 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0a3de-f4d7-41c0-a741-6cc1d0d19c3e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:31.526439 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1023/2031] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:27:31.531528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff72e45-c57a-4114-9a7b-7dc62a242d00 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:31.552467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff72e45-c57a-4114-9a7b-7dc62a242d00 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:31.557778 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d79ea-d04c-4d34-84e2-5c7e21766804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:31.558621 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d79ea-d04c-4d34-84e2-5c7e21766804 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:31.558798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d79ea-d04c-4d34-84e2-5c7e21766804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:31.559267 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d79ea-d04c-4d34-84e2-5c7e21766804 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:31.560009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d79ea-d04c-4d34-84e2-5c7e21766804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:31.562319 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d79ea-d04c-4d34-84e2-5c7e21766804 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:31.630531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1009/2032] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:27:31 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:31.636017 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0a3de-f4d7-41c0-a741-6cc1d0d19c3e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:31.648784 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0a3de-f4d7-41c0-a741-6cc1d0d19c3e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:31.738990 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa2162-3dca-4c88-bd4d-68f7ad3bf59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:31.739750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa2162-3dca-4c88-bd4d-68f7ad3bf59b admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:31.740302 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa2162-3dca-4c88-bd4d-68f7ad3bf59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:31.740590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa2162-3dca-4c88-bd4d-68f7ad3bf59b admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:31.741317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa2162-3dca-4c88-bd4d-68f7ad3bf59b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:31.743361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa2162-3dca-4c88-bd4d-68f7ad3bf59b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:31.773272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1024/2033] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:27:31 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:31.778284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d79ea-d04c-4d34-84e2-5c7e21766804 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:31.793048 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d79ea-d04c-4d34-84e2-5c7e21766804 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:31.794853 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454f1ee-c878-4dc1-aca4-d388752cbbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:31.795550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454f1ee-c878-4dc1-aca4-d388752cbbde admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:31.795831 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454f1ee-c878-4dc1-aca4-d388752cbbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:31.796462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454f1ee-c878-4dc1-aca4-d388752cbbde admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:31.797209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454f1ee-c878-4dc1-aca4-d388752cbbde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:31.798878 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454f1ee-c878-4dc1-aca4-d388752cbbde admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:31.818486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1010/2034] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:27:31.819871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa2162-3dca-4c88-bd4d-68f7ad3bf59b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:31.833304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa2162-3dca-4c88-bd4d-68f7ad3bf59b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:31.839850 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ea911-7c3f-4c3d-b598-43b051674f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:31.840595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ea911-7c3f-4c3d-b598-43b051674f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:31.840883 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ea911-7c3f-4c3d-b598-43b051674f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:31.841190 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ea911-7c3f-4c3d-b598-43b051674f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:31.841936 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ea911-7c3f-4c3d-b598-43b051674f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:31.844110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ea911-7c3f-4c3d-b598-43b051674f04 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:31.857612 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1025/2035] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:27:31.862770 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454f1ee-c878-4dc1-aca4-d388752cbbde admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:31.879120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454f1ee-c878-4dc1-aca4-d388752cbbde admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:31.886975 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d706f6-4c6c-4d63-ac9d-54dff54e4278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:31.888508 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d706f6-4c6c-4d63-ac9d-54dff54e4278 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:31.888999 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d706f6-4c6c-4d63-ac9d-54dff54e4278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:31.889496 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d706f6-4c6c-4d63-ac9d-54dff54e4278 admin admin] PATH_INFO: `/v3/projects/ba4cf0f9ce3d4152a0eded1f243ef4b9/users/8cc8d797a6424a0ca3ae9bd6a47dda9e/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:31.915066 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d706f6-4c6c-4d63-ac9d-54dff54e4278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4cf0f9ce3d4152a0eded1f243ef4b9, user_id=8cc8d797a6424a0ca3ae9bd6a47dda9e, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:31.918291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d706f6-4c6c-4d63-ac9d-54dff54e4278 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:31.941002 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1011/2036] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:31 2022] PUT /identity/v3/projects/ba4cf0f9ce3d4152a0eded1f243ef4b9/users/8cc8d797a6424a0ca3ae9bd6a47dda9e/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:31.958493 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188f514-1393-4f93-802f-352d19216581 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:31.958749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188f514-1393-4f93-802f-352d19216581 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:31.959042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188f514-1393-4f93-802f-352d19216581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:31.996642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5188f514-1393-4f93-802f-352d19216581 None None] MFA Rules not processed for user `8cc8d797a6424a0ca3ae9bd6a47dda9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:31.998758 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5188f514-1393-4f93-802f-352d19216581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:32.091485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1026/2037] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:32.103236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d706f6-4c6c-4d63-ac9d-54dff54e4278 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:32.105654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c8d706f6-4c6c-4d63-ac9d-54dff54e4278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:32.183726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d706f6-4c6c-4d63-ac9d-54dff54e4278 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:32.188864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305560d1-6d10-44c1-acca-1279251b3530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:32.189577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305560d1-6d10-44c1-acca-1279251b3530 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:32.189877 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305560d1-6d10-44c1-acca-1279251b3530 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:32.190126 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305560d1-6d10-44c1-acca-1279251b3530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:32.201003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305560d1-6d10-44c1-acca-1279251b3530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:32.202572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305560d1-6d10-44c1-acca-1279251b3530 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:32.207210 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:32.216399 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1012/2038] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:34.084571 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188f514-1393-4f93-802f-352d19216581 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:34.086173 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5188f514-1393-4f93-802f-352d19216581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:34.141062 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:34.209739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188f514-1393-4f93-802f-352d19216581 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:34.215496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8e462-88dd-4236-b739-ed9ca14d6556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:34.216506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8e462-88dd-4236-b739-ed9ca14d6556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:34.216864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8e462-88dd-4236-b739-ed9ca14d6556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:34.217154 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8e462-88dd-4236-b739-ed9ca14d6556 admin admin] PATH_INFO: `/v3/users/c7598c3db9004ac1a23d36071c2149dd` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:34.218532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8e462-88dd-4236-b739-ed9ca14d6556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7598c3db9004ac1a23d36071c2149dd)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:34.220921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8e462-88dd-4236-b739-ed9ca14d6556 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:34.284182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86c8e462-88dd-4236-b739-ed9ca14d6556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7598c3db9004ac1a23d36071c2149dd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:34.293359 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86c8e462-88dd-4236-b739-ed9ca14d6556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7598c3db9004ac1a23d36071c2149dd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:34.294327 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86c8e462-88dd-4236-b739-ed9ca14d6556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7598c3db9004ac1a23d36071c2149dd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:34.295038 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86c8e462-88dd-4236-b739-ed9ca14d6556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7598c3db9004ac1a23d36071c2149dd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:34.311307 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86c8e462-88dd-4236-b739-ed9ca14d6556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7598c3db9004ac1a23d36071c2149dd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:34.338922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1027/2039] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:27:34 2022] DELETE /identity/v3/users/c7598c3db9004ac1a23d36071c2149dd => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:34.343943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3559249-9f28-40bb-81a1-aa56ef4715e9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:34.344475 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3559249-9f28-40bb-81a1-aa56ef4715e9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:34.344569 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3559249-9f28-40bb-81a1-aa56ef4715e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:34.362816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c3559249-9f28-40bb-81a1-aa56ef4715e9 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:34.364154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c3559249-9f28-40bb-81a1-aa56ef4715e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:34.431050 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1013/2040] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:34.441199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8e462-88dd-4236-b739-ed9ca14d6556 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:34.443079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-86c8e462-88dd-4236-b739-ed9ca14d6556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:34.524058 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8e462-88dd-4236-b739-ed9ca14d6556 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:34.528193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b5b8d-b6df-4635-8e39-a1b1a0a9ccc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:34.528867 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b5b8d-b6df-4635-8e39-a1b1a0a9ccc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:34.529153 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b5b8d-b6df-4635-8e39-a1b1a0a9ccc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:34.529433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b5b8d-b6df-4635-8e39-a1b1a0a9ccc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:34.539683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b5b8d-b6df-4635-8e39-a1b1a0a9ccc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:34.541217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b5b8d-b6df-4635-8e39-a1b1a0a9ccc7 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:34.556855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1028/2041] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:27:34.918650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3559249-9f28-40bb-81a1-aa56ef4715e9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:34.920306 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c3559249-9f28-40bb-81a1-aa56ef4715e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:34.939625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3559249-9f28-40bb-81a1-aa56ef4715e9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:34.953202 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1943b-4e3d-4c73-a310-a7d81e5355c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:34.954253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1943b-4e3d-4c73-a310-a7d81e5355c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:34.954606 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1943b-4e3d-4c73-a310-a7d81e5355c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:34.954851 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1943b-4e3d-4c73-a310-a7d81e5355c0 admin admin] PATH_INFO: `/v3/projects/07ead95fd72042f9add9cb11a6cde632` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:34.956354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1943b-4e3d-4c73-a310-a7d81e5355c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ead95fd72042f9add9cb11a6cde632)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:34.958762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1943b-4e3d-4c73-a310-a7d81e5355c0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:35.036293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc1943b-4e3d-4c73-a310-a7d81e5355c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ead95fd72042f9add9cb11a6cde632', 'request_id': 'req-5dc1943b-4e3d-4c73-a310-a7d81e5355c0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:35.046590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc1943b-4e3d-4c73-a310-a7d81e5355c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ead95fd72042f9add9cb11a6cde632', 'request_id': 'req-5dc1943b-4e3d-4c73-a310-a7d81e5355c0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:35.054667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc1943b-4e3d-4c73-a310-a7d81e5355c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ead95fd72042f9add9cb11a6cde632', 'request_id': 'req-5dc1943b-4e3d-4c73-a310-a7d81e5355c0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:35.073140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc1943b-4e3d-4c73-a310-a7d81e5355c0 admin admin] The token cache is being invalidate because project 07ead95fd72042f9add9cb11a6cde632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:27:35.073659 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc1943b-4e3d-4c73-a310-a7d81e5355c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:35.074763 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc1943b-4e3d-4c73-a310-a7d81e5355c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:35.077607 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1014/2042] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:27:34 2022] DELETE /identity/v3/projects/07ead95fd72042f9add9cb11a6cde632 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:35.082939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b97b0-abf4-4488-9f92-bdb570a83b7f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:35.083655 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b97b0-abf4-4488-9f92-bdb570a83b7f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:35.083942 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b97b0-abf4-4488-9f92-bdb570a83b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:35.103605 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5c1b97b0-abf4-4488-9f92-bdb570a83b7f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:35.105652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5c1b97b0-abf4-4488-9f92-bdb570a83b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:35.194633 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:35.226948 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1029/2043] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:35.228279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2313ef-fbcc-46de-b20e-baac781cb65f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:35.228638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2313ef-fbcc-46de-b20e-baac781cb65f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:35.229105 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2313ef-fbcc-46de-b20e-baac781cb65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:35.254590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9b2313ef-fbcc-46de-b20e-baac781cb65f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:35.256031 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9b2313ef-fbcc-46de-b20e-baac781cb65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:35.266438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1015/2044] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:35.271988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b97b0-abf4-4488-9f92-bdb570a83b7f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:35.291794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b97b0-abf4-4488-9f92-bdb570a83b7f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:35.301752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82293f-cd9e-42f5-988d-51ec0a91a17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:35.302993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82293f-cd9e-42f5-988d-51ec0a91a17d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:35.303892 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82293f-cd9e-42f5-988d-51ec0a91a17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:35.304342 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82293f-cd9e-42f5-988d-51ec0a91a17d admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:35.307407 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82293f-cd9e-42f5-988d-51ec0a91a17d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:27:35.307407 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82293f-cd9e-42f5-988d-51ec0a91a17d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:35.310591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82293f-cd9e-42f5-988d-51ec0a91a17d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:35.337522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1030/2045] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:27:35.342411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2313ef-fbcc-46de-b20e-baac781cb65f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:35.353066 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2313ef-fbcc-46de-b20e-baac781cb65f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:35.360097 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f191b3b-fa06-4b85-ab49-e01d77104733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:35.360798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f191b3b-fa06-4b85-ab49-e01d77104733 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:35.361256 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f191b3b-fa06-4b85-ab49-e01d77104733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:35.361708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f191b3b-fa06-4b85-ab49-e01d77104733 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:35.363053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f191b3b-fa06-4b85-ab49-e01d77104733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:35.365519 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f191b3b-fa06-4b85-ab49-e01d77104733 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:35.407609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1016/2046] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:27:35 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:35.412225 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82293f-cd9e-42f5-988d-51ec0a91a17d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:35.436685 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82293f-cd9e-42f5-988d-51ec0a91a17d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:35.544165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6df8b9-0bb8-4569-85d4-1d1061a6ed29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:35.544881 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6df8b9-0bb8-4569-85d4-1d1061a6ed29 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:35.545176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6df8b9-0bb8-4569-85d4-1d1061a6ed29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:35.545459 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6df8b9-0bb8-4569-85d4-1d1061a6ed29 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:35.546857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6df8b9-0bb8-4569-85d4-1d1061a6ed29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:35.550395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6df8b9-0bb8-4569-85d4-1d1061a6ed29 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:35.582824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1031/2047] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:27:35 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:35.584956 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f191b3b-fa06-4b85-ab49-e01d77104733 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:35.598691 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f191b3b-fa06-4b85-ab49-e01d77104733 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:35.604737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c76b1-1a76-4134-bd14-19ddf1678e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:35.606315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c76b1-1a76-4134-bd14-19ddf1678e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:35.606792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c76b1-1a76-4134-bd14-19ddf1678e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:35.607153 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c76b1-1a76-4134-bd14-19ddf1678e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:35.607998 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c76b1-1a76-4134-bd14-19ddf1678e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:35.609818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c76b1-1a76-4134-bd14-19ddf1678e71 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:35.623647 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1017/2048] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:27:35.631757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6df8b9-0bb8-4569-85d4-1d1061a6ed29 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:35.653366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6df8b9-0bb8-4569-85d4-1d1061a6ed29 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:35.662126 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e2aed-6ce9-40af-95af-098c7fc6edee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:35.663456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e2aed-6ce9-40af-95af-098c7fc6edee admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:35.663910 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e2aed-6ce9-40af-95af-098c7fc6edee admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:35.664375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e2aed-6ce9-40af-95af-098c7fc6edee admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:35.665444 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e2aed-6ce9-40af-95af-098c7fc6edee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:35.667477 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e2aed-6ce9-40af-95af-098c7fc6edee admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:35.681506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1032/2049] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:27:35.687228 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c76b1-1a76-4134-bd14-19ddf1678e71 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:35.703373 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c76b1-1a76-4134-bd14-19ddf1678e71 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:35.710845 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8a428-1cc2-4a50-87e1-2e089fb2e59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:35.712594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8a428-1cc2-4a50-87e1-2e089fb2e59b admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:35.713474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8a428-1cc2-4a50-87e1-2e089fb2e59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:35.713474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8a428-1cc2-4a50-87e1-2e089fb2e59b admin admin] PATH_INFO: `/v3/projects/204b02b5afb24710b7cc8725993c98cd/users/e93c670c90a643978a0ef04d83ee02d3/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:35.741060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8a428-1cc2-4a50-87e1-2e089fb2e59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=204b02b5afb24710b7cc8725993c98cd, user_id=e93c670c90a643978a0ef04d83ee02d3, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:35.743955 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8a428-1cc2-4a50-87e1-2e089fb2e59b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:35.764853 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1018/2050] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:35 2022] PUT /identity/v3/projects/204b02b5afb24710b7cc8725993c98cd/users/e93c670c90a643978a0ef04d83ee02d3/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:35.772367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ccfea-2a81-4e8f-b0ef-3719e58682bf None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:35.773440 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ccfea-2a81-4e8f-b0ef-3719e58682bf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:35.773727 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ccfea-2a81-4e8f-b0ef-3719e58682bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:35.804041 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4b6ccfea-2a81-4e8f-b0ef-3719e58682bf None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:35.805939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4b6ccfea-2a81-4e8f-b0ef-3719e58682bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:35.906631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1033/2051] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:35.917948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8a428-1cc2-4a50-87e1-2e089fb2e59b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:35.924442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fed8a428-1cc2-4a50-87e1-2e089fb2e59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:35.951741 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:36.004885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8a428-1cc2-4a50-87e1-2e089fb2e59b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:36.009069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fceb27-195c-421e-b2d0-1969b31ecba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:36.009875 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fceb27-195c-421e-b2d0-1969b31ecba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:36.010163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fceb27-195c-421e-b2d0-1969b31ecba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:36.010467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fceb27-195c-421e-b2d0-1969b31ecba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:36.022640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fceb27-195c-421e-b2d0-1969b31ecba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:36.024893 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fceb27-195c-421e-b2d0-1969b31ecba8 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:36.042677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1019/2052] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:37.266188 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dfe82-f146-47ae-949a-5b80c597088d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:37.266923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dfe82-f146-47ae-949a-5b80c597088d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:37.266923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dfe82-f146-47ae-949a-5b80c597088d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:37.298791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5f7dfe82-f146-47ae-949a-5b80c597088d None None] MFA Rules not processed for user `e93c670c90a643978a0ef04d83ee02d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:37.300145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5f7dfe82-f146-47ae-949a-5b80c597088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:37.364553 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:37.397993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1034/2053] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:37.414895 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fceb27-195c-421e-b2d0-1969b31ecba8 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:37.416833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a8fceb27-195c-421e-b2d0-1969b31ecba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:37.524535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fceb27-195c-421e-b2d0-1969b31ecba8 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:37.528603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347ea31-6cde-4db4-b16f-2101ef3ab741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:37.529276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347ea31-6cde-4db4-b16f-2101ef3ab741 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:37.529558 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347ea31-6cde-4db4-b16f-2101ef3ab741 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:37.529862 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347ea31-6cde-4db4-b16f-2101ef3ab741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:37.539794 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347ea31-6cde-4db4-b16f-2101ef3ab741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:37.541428 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347ea31-6cde-4db4-b16f-2101ef3ab741 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:37.553337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1020/2054] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:38.151027 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dfe82-f146-47ae-949a-5b80c597088d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:38.152799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5f7dfe82-f146-47ae-949a-5b80c597088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:38.175971 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dfe82-f146-47ae-949a-5b80c597088d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:38.183447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db3c91-9e02-4de9-ad94-28a46844e51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:38.185275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db3c91-9e02-4de9-ad94-28a46844e51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:38.185788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db3c91-9e02-4de9-ad94-28a46844e51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:38.186175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db3c91-9e02-4de9-ad94-28a46844e51e admin admin] PATH_INFO: `/v3/users/8cc8d797a6424a0ca3ae9bd6a47dda9e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:38.187657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db3c91-9e02-4de9-ad94-28a46844e51e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc8d797a6424a0ca3ae9bd6a47dda9e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:38.190271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db3c91-9e02-4de9-ad94-28a46844e51e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:38.245796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-57db3c91-9e02-4de9-ad94-28a46844e51e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc8d797a6424a0ca3ae9bd6a47dda9e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:38.254609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-57db3c91-9e02-4de9-ad94-28a46844e51e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc8d797a6424a0ca3ae9bd6a47dda9e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:38.255422 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-57db3c91-9e02-4de9-ad94-28a46844e51e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc8d797a6424a0ca3ae9bd6a47dda9e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:38.256216 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-57db3c91-9e02-4de9-ad94-28a46844e51e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc8d797a6424a0ca3ae9bd6a47dda9e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:38.271795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-57db3c91-9e02-4de9-ad94-28a46844e51e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc8d797a6424a0ca3ae9bd6a47dda9e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:38.286883 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1035/2055] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:27:38 2022] DELETE /identity/v3/users/8cc8d797a6424a0ca3ae9bd6a47dda9e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:38.293309 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a2add-baf2-4a81-bed4-dfd08cea3a94 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:38.294128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a2add-baf2-4a81-bed4-dfd08cea3a94 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:38.294606 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a2add-baf2-4a81-bed4-dfd08cea3a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:38.320830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-337a2add-baf2-4a81-bed4-dfd08cea3a94 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:38.322957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-337a2add-baf2-4a81-bed4-dfd08cea3a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:38.406519 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1021/2056] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:38.416824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db3c91-9e02-4de9-ad94-28a46844e51e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:38.418934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-57db3c91-9e02-4de9-ad94-28a46844e51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:38.493559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db3c91-9e02-4de9-ad94-28a46844e51e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:38.497244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6359d-0f02-4f3b-9455-dd26e8513708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:38.497908 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6359d-0f02-4f3b-9455-dd26e8513708 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:38.498193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6359d-0f02-4f3b-9455-dd26e8513708 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:38.498503 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6359d-0f02-4f3b-9455-dd26e8513708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:38.508298 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6359d-0f02-4f3b-9455-dd26e8513708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:38.509750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6359d-0f02-4f3b-9455-dd26e8513708 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:38.520836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1036/2057] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:38.839750 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a2add-baf2-4a81-bed4-dfd08cea3a94 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:38.842015 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-337a2add-baf2-4a81-bed4-dfd08cea3a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:38.859461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a2add-baf2-4a81-bed4-dfd08cea3a94 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:38.865897 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20580d4-d4ad-44b6-8a45-45f33d9cdd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:38.867046 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20580d4-d4ad-44b6-8a45-45f33d9cdd95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:38.867165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20580d4-d4ad-44b6-8a45-45f33d9cdd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:38.867411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20580d4-d4ad-44b6-8a45-45f33d9cdd95 admin admin] PATH_INFO: `/v3/projects/ba4cf0f9ce3d4152a0eded1f243ef4b9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:38.868769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20580d4-d4ad-44b6-8a45-45f33d9cdd95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba4cf0f9ce3d4152a0eded1f243ef4b9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:38.871014 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20580d4-d4ad-44b6-8a45-45f33d9cdd95 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:38.944208 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c20580d4-d4ad-44b6-8a45-45f33d9cdd95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba4cf0f9ce3d4152a0eded1f243ef4b9', 'request_id': 'req-c20580d4-d4ad-44b6-8a45-45f33d9cdd95'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:38.954841 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c20580d4-d4ad-44b6-8a45-45f33d9cdd95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba4cf0f9ce3d4152a0eded1f243ef4b9', 'request_id': 'req-c20580d4-d4ad-44b6-8a45-45f33d9cdd95'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:38.958418 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:38.964938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c20580d4-d4ad-44b6-8a45-45f33d9cdd95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba4cf0f9ce3d4152a0eded1f243ef4b9', 'request_id': 'req-c20580d4-d4ad-44b6-8a45-45f33d9cdd95'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:38.982936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c20580d4-d4ad-44b6-8a45-45f33d9cdd95 admin admin] The token cache is being invalidate because project ba4cf0f9ce3d4152a0eded1f243ef4b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:27:38.983620 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c20580d4-d4ad-44b6-8a45-45f33d9cdd95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:38.984293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c20580d4-d4ad-44b6-8a45-45f33d9cdd95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:38.985923 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1022/2058] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:27:38 2022] DELETE /identity/v3/projects/ba4cf0f9ce3d4152a0eded1f243ef4b9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:38.991254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a012bf5-0195-4f0a-96a5-2713ac31b804 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:38.991536 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a012bf5-0195-4f0a-96a5-2713ac31b804 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:38.991829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a012bf5-0195-4f0a-96a5-2713ac31b804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:39.003649 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd6a46-d07a-4c03-ac8d-3eb79de51c44 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:39.003937 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd6a46-d07a-4c03-ac8d-3eb79de51c44 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:39.004282 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd6a46-d07a-4c03-ac8d-3eb79de51c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:39.014273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0a012bf5-0195-4f0a-96a5-2713ac31b804 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:39.015501 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0a012bf5-0195-4f0a-96a5-2713ac31b804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:39.025059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-37cd6a46-d07a-4c03-ac8d-3eb79de51c44 None None] MFA Rules not processed for user `e93c670c90a643978a0ef04d83ee02d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:39.026894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-37cd6a46-d07a-4c03-ac8d-3eb79de51c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:39.130278 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1023/2059] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:39.138961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1037/2060] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:27:39.148272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3365aa-62fe-4374-863b-99a054f4cd30 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:39.148711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3365aa-62fe-4374-863b-99a054f4cd30 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:39.149048 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3365aa-62fe-4374-863b-99a054f4cd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:39.186943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1c3365aa-62fe-4374-863b-99a054f4cd30 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:39.188744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1c3365aa-62fe-4374-863b-99a054f4cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:39.200319 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1024/2061] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:39.209763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a012bf5-0195-4f0a-96a5-2713ac31b804 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:39.215506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:39.221961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a012bf5-0195-4f0a-96a5-2713ac31b804 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:39.235520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9eceb-b8f0-414d-9b24-66ed2ed7234c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:39.235520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9eceb-b8f0-414d-9b24-66ed2ed7234c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:39.235520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9eceb-b8f0-414d-9b24-66ed2ed7234c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:39.235520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9eceb-b8f0-414d-9b24-66ed2ed7234c admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:39.236216 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9eceb-b8f0-414d-9b24-66ed2ed7234c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:27:39.236216 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9eceb-b8f0-414d-9b24-66ed2ed7234c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:39.236216 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9eceb-b8f0-414d-9b24-66ed2ed7234c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:39.264261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1038/2062] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:27:39.269279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3365aa-62fe-4374-863b-99a054f4cd30 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:39.280391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3365aa-62fe-4374-863b-99a054f4cd30 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:39.286503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81579699-4e0d-40d6-9e2a-77527c49a0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:39.287207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81579699-4e0d-40d6-9e2a-77527c49a0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:39.287491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81579699-4e0d-40d6-9e2a-77527c49a0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:39.287792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81579699-4e0d-40d6-9e2a-77527c49a0e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:39.288491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81579699-4e0d-40d6-9e2a-77527c49a0e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:39.290512 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81579699-4e0d-40d6-9e2a-77527c49a0e1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:39.329705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1025/2063] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:27:39 2022] POST /identity/v3/projects => generated 361 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:39.335993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9eceb-b8f0-414d-9b24-66ed2ed7234c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:39.356000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9eceb-b8f0-414d-9b24-66ed2ed7234c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:39.474983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cf7b8-f2d2-4551-9f84-987eee14a69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:39.476078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cf7b8-f2d2-4551-9f84-987eee14a69f admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:39.476459 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cf7b8-f2d2-4551-9f84-987eee14a69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:39.476742 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cf7b8-f2d2-4551-9f84-987eee14a69f admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:39.477496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cf7b8-f2d2-4551-9f84-987eee14a69f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:39.479590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cf7b8-f2d2-4551-9f84-987eee14a69f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:39.509920 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1039/2064] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:27:39 2022] POST /identity/v3/users => generated 281 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:27:39.511805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81579699-4e0d-40d6-9e2a-77527c49a0e1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:39.524069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81579699-4e0d-40d6-9e2a-77527c49a0e1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:39.529060 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7dfff-0834-479a-8e14-3298549f025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:39.529846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7dfff-0834-479a-8e14-3298549f025e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:39.530131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7dfff-0834-479a-8e14-3298549f025e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:39.530443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7dfff-0834-479a-8e14-3298549f025e admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:39.531186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7dfff-0834-479a-8e14-3298549f025e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:39.532798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7dfff-0834-479a-8e14-3298549f025e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:39.546469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1026/2065] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:27:39.550851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cf7b8-f2d2-4551-9f84-987eee14a69f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:39.563379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cf7b8-f2d2-4551-9f84-987eee14a69f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:39.569198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420371f3-78e6-4df5-bdf5-2f5afe1e15c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:39.569907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420371f3-78e6-4df5-bdf5-2f5afe1e15c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:39.570192 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420371f3-78e6-4df5-bdf5-2f5afe1e15c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:39.570497 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420371f3-78e6-4df5-bdf5-2f5afe1e15c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:39.571241 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420371f3-78e6-4df5-bdf5-2f5afe1e15c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:39.572871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420371f3-78e6-4df5-bdf5-2f5afe1e15c4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:39.584409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1040/2066] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:27:39.589166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7dfff-0834-479a-8e14-3298549f025e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:39.600059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7dfff-0834-479a-8e14-3298549f025e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:39.605326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee9aac-4e66-4ecb-924d-ad7ff5d6b43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:39.606375 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee9aac-4e66-4ecb-924d-ad7ff5d6b43a admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:39.606733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee9aac-4e66-4ecb-924d-ad7ff5d6b43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:39.607315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee9aac-4e66-4ecb-924d-ad7ff5d6b43a admin admin] PATH_INFO: `/v3/projects/df154aa9544b48699ff9b1631b7c69b7/users/52c80a47b37f4ce7ad22feccb8c75dee/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:39.629543 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee9aac-4e66-4ecb-924d-ad7ff5d6b43a admin admin] RBAC: Authorizing `identity:create_grant(project_id=df154aa9544b48699ff9b1631b7c69b7, user_id=52c80a47b37f4ce7ad22feccb8c75dee, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:39.632603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee9aac-4e66-4ecb-924d-ad7ff5d6b43a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:39.650773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1027/2067] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:39 2022] PUT /identity/v3/projects/df154aa9544b48699ff9b1631b7c69b7/users/52c80a47b37f4ce7ad22feccb8c75dee/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:39.661989 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d6ad3-1f43-4bd9-8231-1f6babd41e85 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:39.662339 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d6ad3-1f43-4bd9-8231-1f6babd41e85 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:39.662624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d6ad3-1f43-4bd9-8231-1f6babd41e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:39.709603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2d0d6ad3-1f43-4bd9-8231-1f6babd41e85 None None] MFA Rules not processed for user `52c80a47b37f4ce7ad22feccb8c75dee`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:39.710866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2d0d6ad3-1f43-4bd9-8231-1f6babd41e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:39.790550 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1041/2068] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:39.830318 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee9aac-4e66-4ecb-924d-ad7ff5d6b43a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:39.832662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7bee9aac-4e66-4ecb-924d-ad7ff5d6b43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:39.901097 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee9aac-4e66-4ecb-924d-ad7ff5d6b43a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:39.906034 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142c233-4beb-49bf-a0e6-a1f11ef6c6b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:39.906748 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142c233-4beb-49bf-a0e6-a1f11ef6c6b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:39.907030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142c233-4beb-49bf-a0e6-a1f11ef6c6b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:39.907306 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142c233-4beb-49bf-a0e6-a1f11ef6c6b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:39.919730 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142c233-4beb-49bf-a0e6-a1f11ef6c6b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:39.922103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142c233-4beb-49bf-a0e6-a1f11ef6c6b9 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:39.936053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1028/2069] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:39.951539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d6ad3-1f43-4bd9-8231-1f6babd41e85 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:40.053606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:40.069803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d6ad3-1f43-4bd9-8231-1f6babd41e85 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:40.075829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40d391-e19f-4ff3-becf-faa5f0a917c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:40.078498 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40d391-e19f-4ff3-becf-faa5f0a917c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:40.078790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40d391-e19f-4ff3-becf-faa5f0a917c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:40.079070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40d391-e19f-4ff3-becf-faa5f0a917c9 admin admin] PATH_INFO: `/v3/users/52c80a47b37f4ce7ad22feccb8c75dee` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:40.080352 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40d391-e19f-4ff3-becf-faa5f0a917c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c80a47b37f4ce7ad22feccb8c75dee)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:40.083597 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40d391-e19f-4ff3-becf-faa5f0a917c9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:40.156930 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cb40d391-e19f-4ff3-becf-faa5f0a917c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c80a47b37f4ce7ad22feccb8c75dee'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:40.168546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cb40d391-e19f-4ff3-becf-faa5f0a917c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c80a47b37f4ce7ad22feccb8c75dee'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:40.169668 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cb40d391-e19f-4ff3-becf-faa5f0a917c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c80a47b37f4ce7ad22feccb8c75dee'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:40.170482 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cb40d391-e19f-4ff3-becf-faa5f0a917c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c80a47b37f4ce7ad22feccb8c75dee'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:40.186784 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cb40d391-e19f-4ff3-becf-faa5f0a917c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c80a47b37f4ce7ad22feccb8c75dee'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:40.204152 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1042/2070] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:27:39 2022] DELETE /identity/v3/users/52c80a47b37f4ce7ad22feccb8c75dee => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:40.209460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30690cc-e242-492c-a513-f23719b6296f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:40.209743 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30690cc-e242-492c-a513-f23719b6296f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:40.210136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30690cc-e242-492c-a513-f23719b6296f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:40.239428 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e30690cc-e242-492c-a513-f23719b6296f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:40.241010 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e30690cc-e242-492c-a513-f23719b6296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:40.275645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:40.333596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1029/2071] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:40.349216 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40d391-e19f-4ff3-becf-faa5f0a917c9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:40.351187 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cb40d391-e19f-4ff3-becf-faa5f0a917c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:40.426162 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40d391-e19f-4ff3-becf-faa5f0a917c9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:40.430956 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900cb3e-e817-43e1-a874-fc7aa95cf664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:40.431801 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900cb3e-e817-43e1-a874-fc7aa95cf664 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:40.432256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900cb3e-e817-43e1-a874-fc7aa95cf664 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:40.432519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900cb3e-e817-43e1-a874-fc7aa95cf664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:40.445942 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900cb3e-e817-43e1-a874-fc7aa95cf664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:40.448199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900cb3e-e817-43e1-a874-fc7aa95cf664 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:40.467927 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1043/2072] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:40.807917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30690cc-e242-492c-a513-f23719b6296f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:40.809544 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e30690cc-e242-492c-a513-f23719b6296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:40.823684 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30690cc-e242-492c-a513-f23719b6296f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:40.831442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7963a-fed1-4d3e-b0c1-1c312a1fdc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:40.833645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7963a-fed1-4d3e-b0c1-1c312a1fdc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:40.833998 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7963a-fed1-4d3e-b0c1-1c312a1fdc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:40.834378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7963a-fed1-4d3e-b0c1-1c312a1fdc48 admin admin] PATH_INFO: `/v3/projects/df154aa9544b48699ff9b1631b7c69b7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:40.836100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7963a-fed1-4d3e-b0c1-1c312a1fdc48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df154aa9544b48699ff9b1631b7c69b7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:40.839687 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7963a-fed1-4d3e-b0c1-1c312a1fdc48 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:40.908460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-84c7963a-fed1-4d3e-b0c1-1c312a1fdc48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df154aa9544b48699ff9b1631b7c69b7', 'request_id': 'req-84c7963a-fed1-4d3e-b0c1-1c312a1fdc48'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:40.918262 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-84c7963a-fed1-4d3e-b0c1-1c312a1fdc48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df154aa9544b48699ff9b1631b7c69b7', 'request_id': 'req-84c7963a-fed1-4d3e-b0c1-1c312a1fdc48'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:40.927856 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-84c7963a-fed1-4d3e-b0c1-1c312a1fdc48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df154aa9544b48699ff9b1631b7c69b7', 'request_id': 'req-84c7963a-fed1-4d3e-b0c1-1c312a1fdc48'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:40.940909 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-84c7963a-fed1-4d3e-b0c1-1c312a1fdc48 admin admin] The token cache is being invalidate because project df154aa9544b48699ff9b1631b7c69b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:27:40.941226 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-84c7963a-fed1-4d3e-b0c1-1c312a1fdc48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:40.942586 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-84c7963a-fed1-4d3e-b0c1-1c312a1fdc48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:27:40.944199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1030/2073] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:27:40 2022] DELETE /identity/v3/projects/df154aa9544b48699ff9b1631b7c69b7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:40.949421 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0b076-1433-4a5f-bfca-25bbcf52d739 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:40.949647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0b076-1433-4a5f-bfca-25bbcf52d739 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:40.949906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0b076-1433-4a5f-bfca-25bbcf52d739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:40.969371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e1f0b076-1433-4a5f-bfca-25bbcf52d739 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:40.970649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e1f0b076-1433-4a5f-bfca-25bbcf52d739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:41.039914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1044/2074] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:27:41.050684 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcff67b-8b9f-4438-ad08-4a394c8d5308 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:41.051399 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcff67b-8b9f-4438-ad08-4a394c8d5308 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:41.051848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcff67b-8b9f-4438-ad08-4a394c8d5308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:41.073627 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cbcff67b-8b9f-4438-ad08-4a394c8d5308 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:41.074907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cbcff67b-8b9f-4438-ad08-4a394c8d5308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:41.083745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1031/2075] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:41.088186 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0b076-1433-4a5f-bfca-25bbcf52d739 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:41.099138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0b076-1433-4a5f-bfca-25bbcf52d739 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:41.106678 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f822419-d575-4367-a621-74ca73b97fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:41.107588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f822419-d575-4367-a621-74ca73b97fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:41.107747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f822419-d575-4367-a621-74ca73b97fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:41.108035 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f822419-d575-4367-a621-74ca73b97fe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:41.108779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f822419-d575-4367-a621-74ca73b97fe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:27:41.109082 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f822419-d575-4367-a621-74ca73b97fe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:41.111044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f822419-d575-4367-a621-74ca73b97fe6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:41.131217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1045/2076] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:27:41.146071 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcff67b-8b9f-4438-ad08-4a394c8d5308 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:41.156463 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcff67b-8b9f-4438-ad08-4a394c8d5308 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:41.161513 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce459bd9-ae9a-4f41-8995-ae432ec38f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:41.162213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce459bd9-ae9a-4f41-8995-ae432ec38f89 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:41.162542 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce459bd9-ae9a-4f41-8995-ae432ec38f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:41.162828 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce459bd9-ae9a-4f41-8995-ae432ec38f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:41.163580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce459bd9-ae9a-4f41-8995-ae432ec38f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:41.166418 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce459bd9-ae9a-4f41-8995-ae432ec38f89 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:41.206735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1032/2077] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:27:41 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:27:41.210816 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f822419-d575-4367-a621-74ca73b97fe6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:41.228339 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f822419-d575-4367-a621-74ca73b97fe6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:41.232581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:41.343284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe393c-10a1-40ed-b46a-7feedf526e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:41.343284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe393c-10a1-40ed-b46a-7feedf526e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:41.343284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe393c-10a1-40ed-b46a-7feedf526e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:41.343284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe393c-10a1-40ed-b46a-7feedf526e51 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:41.343848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe393c-10a1-40ed-b46a-7feedf526e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:41.344782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe393c-10a1-40ed-b46a-7feedf526e51 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:41.375334 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1046/2078] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:27:41 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:27:41.377254 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce459bd9-ae9a-4f41-8995-ae432ec38f89 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:41.394041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce459bd9-ae9a-4f41-8995-ae432ec38f89 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:41.399423 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc8331-9e2a-451e-b467-7d15ba47da60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:41.400230 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc8331-9e2a-451e-b467-7d15ba47da60 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:41.400529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc8331-9e2a-451e-b467-7d15ba47da60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:41.400781 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc8331-9e2a-451e-b467-7d15ba47da60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:41.401537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc8331-9e2a-451e-b467-7d15ba47da60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:41.403215 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc8331-9e2a-451e-b467-7d15ba47da60 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:41.423022 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe393c-10a1-40ed-b46a-7feedf526e51 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:41.424033 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1033/2079] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:27:41.440260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe393c-10a1-40ed-b46a-7feedf526e51 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:41.472073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043cb98-82d4-4784-a391-5c7758b1ecd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:41.473491 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043cb98-82d4-4784-a391-5c7758b1ecd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:41.474448 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043cb98-82d4-4784-a391-5c7758b1ecd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:41.474993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043cb98-82d4-4784-a391-5c7758b1ecd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:41.477631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043cb98-82d4-4784-a391-5c7758b1ecd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:41.484355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043cb98-82d4-4784-a391-5c7758b1ecd6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:41.506281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1047/2080] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:27:41.511254 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc8331-9e2a-451e-b467-7d15ba47da60 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:41.531270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc8331-9e2a-451e-b467-7d15ba47da60 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:41.545376 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f826797-97e8-43bf-91c7-f57912cff947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:41.549672 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f826797-97e8-43bf-91c7-f57912cff947 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:41.550272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f826797-97e8-43bf-91c7-f57912cff947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:41.551218 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f826797-97e8-43bf-91c7-f57912cff947 admin admin] PATH_INFO: `/v3/projects/d822293514264d25bd3232b3420f7074/users/9f361e40b2ec4b7cace299a7bfaa7bd2/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:41.595168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f826797-97e8-43bf-91c7-f57912cff947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d822293514264d25bd3232b3420f7074, user_id=9f361e40b2ec4b7cace299a7bfaa7bd2, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:41.601606 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f826797-97e8-43bf-91c7-f57912cff947 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:41.652142 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1034/2081] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:27:41 2022] PUT /identity/v3/projects/d822293514264d25bd3232b3420f7074/users/9f361e40b2ec4b7cace299a7bfaa7bd2/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:27:41.663194 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c08e3c-ed43-4ac2-afd0-4bb5e1291f7a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:41.663645 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c08e3c-ed43-4ac2-afd0-4bb5e1291f7a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:41.663995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c08e3c-ed43-4ac2-afd0-4bb5e1291f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:41.702790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-59c08e3c-ed43-4ac2-afd0-4bb5e1291f7a None None] MFA Rules not processed for user `9f361e40b2ec4b7cace299a7bfaa7bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:41.704193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-59c08e3c-ed43-4ac2-afd0-4bb5e1291f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:41.813748 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1048/2082] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:41.827993 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f826797-97e8-43bf-91c7-f57912cff947 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:27:41.829995 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6f826797-97e8-43bf-91c7-f57912cff947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:41.930184 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f826797-97e8-43bf-91c7-f57912cff947 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:27:41.942628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce2119-530a-4087-b310-83a9368feabf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:27:41.944016 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce2119-530a-4087-b310-83a9368feabf service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:41.944481 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce2119-530a-4087-b310-83a9368feabf service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:41.944825 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce2119-530a-4087-b310-83a9368feabf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:41.953428 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:41.963314 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce2119-530a-4087-b310-83a9368feabf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:27:41.967597 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce2119-530a-4087-b310-83a9368feabf service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:27:41.997953 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1035/2083] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:27:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:27:43.856487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fac248-d187-4313-b3aa-1c5f515496a6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:43.858169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fac248-d187-4313-b3aa-1c5f515496a6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:43.858724 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fac248-d187-4313-b3aa-1c5f515496a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:43.885983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-79fac248-d187-4313-b3aa-1c5f515496a6 None None] MFA Rules not processed for user `9f361e40b2ec4b7cace299a7bfaa7bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:43.888493 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-79fac248-d187-4313-b3aa-1c5f515496a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:43.897802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1049/2084] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:27:51.988072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:52.819683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc20333-43ec-4033-909d-c91bc5683376 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:27:52.819973 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc20333-43ec-4033-909d-c91bc5683376 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:27:52.820252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc20333-43ec-4033-909d-c91bc5683376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:27:52.858311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-dcc20333-43ec-4033-909d-c91bc5683376 None None] MFA Rules not processed for user `69c9809662bc441f8e95bfe2e4d069f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:27:52.859554 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dcc20333-43ec-4033-909d-c91bc5683376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:27:52.955068 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1036/2085] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:27:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:27:53.876305 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:02.951417 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=37 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:03.795141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fac248-d187-4313-b3aa-1c5f515496a6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:03.798444 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-79fac248-d187-4313-b3aa-1c5f515496a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:04.199530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fac248-d187-4313-b3aa-1c5f515496a6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:04.208125 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd51a7e-c086-4d9b-a8d8-74b43011c288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:04.209686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd51a7e-c086-4d9b-a8d8-74b43011c288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:04.210181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd51a7e-c086-4d9b-a8d8-74b43011c288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:04.210728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd51a7e-c086-4d9b-a8d8-74b43011c288 admin admin] PATH_INFO: `/v3/users/e0759adbee524296b32f8401cebc6d7c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:04.213119 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd51a7e-c086-4d9b-a8d8-74b43011c288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0759adbee524296b32f8401cebc6d7c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:04.217626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd51a7e-c086-4d9b-a8d8-74b43011c288 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:04.296954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8bd51a7e-c086-4d9b-a8d8-74b43011c288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0759adbee524296b32f8401cebc6d7c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:04.305334 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8bd51a7e-c086-4d9b-a8d8-74b43011c288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0759adbee524296b32f8401cebc6d7c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:04.306163 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8bd51a7e-c086-4d9b-a8d8-74b43011c288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0759adbee524296b32f8401cebc6d7c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:04.306899 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8bd51a7e-c086-4d9b-a8d8-74b43011c288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0759adbee524296b32f8401cebc6d7c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:04.320847 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8bd51a7e-c086-4d9b-a8d8-74b43011c288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0759adbee524296b32f8401cebc6d7c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:04.335616 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1050/2086] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:28:03 2022] DELETE /identity/v3/users/e0759adbee524296b32f8401cebc6d7c => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:04.340356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634475d-7656-49ea-bb01-4864f65c9911 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:04.340853 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634475d-7656-49ea-bb01-4864f65c9911 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:04.340961 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634475d-7656-49ea-bb01-4864f65c9911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:04.371872 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0634475d-7656-49ea-bb01-4864f65c9911 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:04.373107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0634475d-7656-49ea-bb01-4864f65c9911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:04.447404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1037/2087] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:04.458277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd51a7e-c086-4d9b-a8d8-74b43011c288 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:04.460403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8bd51a7e-c086-4d9b-a8d8-74b43011c288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:04.492436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:04.603909 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd51a7e-c086-4d9b-a8d8-74b43011c288 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:04.609378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45e329-34bc-4ecf-8726-368f9c31f98f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:04.610061 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45e329-34bc-4ecf-8726-368f9c31f98f service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:04.610376 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45e329-34bc-4ecf-8726-368f9c31f98f service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:04.610678 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45e329-34bc-4ecf-8726-368f9c31f98f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:04.623601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45e329-34bc-4ecf-8726-368f9c31f98f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:04.625088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45e329-34bc-4ecf-8726-368f9c31f98f service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:04.641788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1051/2088] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:28:05.400867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634475d-7656-49ea-bb01-4864f65c9911 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:05.404130 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0634475d-7656-49ea-bb01-4864f65c9911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:05.435536 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634475d-7656-49ea-bb01-4864f65c9911 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:05.471898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06234f2-cd3d-449f-a497-0786abed25e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:05.472987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06234f2-cd3d-449f-a497-0786abed25e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:05.473276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06234f2-cd3d-449f-a497-0786abed25e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:05.473571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06234f2-cd3d-449f-a497-0786abed25e3 admin admin] PATH_INFO: `/v3/projects/1995963881cf4139a07d9554ca4dc6a9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:05.475586 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06234f2-cd3d-449f-a497-0786abed25e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1995963881cf4139a07d9554ca4dc6a9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:05.480305 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06234f2-cd3d-449f-a497-0786abed25e3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:05.559683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b06234f2-cd3d-449f-a497-0786abed25e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1995963881cf4139a07d9554ca4dc6a9', 'request_id': 'req-b06234f2-cd3d-449f-a497-0786abed25e3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:05.581877 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b06234f2-cd3d-449f-a497-0786abed25e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1995963881cf4139a07d9554ca4dc6a9', 'request_id': 'req-b06234f2-cd3d-449f-a497-0786abed25e3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:05.598020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b06234f2-cd3d-449f-a497-0786abed25e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1995963881cf4139a07d9554ca4dc6a9', 'request_id': 'req-b06234f2-cd3d-449f-a497-0786abed25e3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:05.617796 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b06234f2-cd3d-449f-a497-0786abed25e3 admin admin] The token cache is being invalidate because project 1995963881cf4139a07d9554ca4dc6a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:28:05.619132 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b06234f2-cd3d-449f-a497-0786abed25e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:05.620706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b06234f2-cd3d-449f-a497-0786abed25e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:05.624551 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1038/2089] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:28:05 2022] DELETE /identity/v3/projects/1995963881cf4139a07d9554ca4dc6a9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:05.629603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45e329-34bc-4ecf-8726-368f9c31f98f service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:05.643171 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45e329-34bc-4ecf-8726-368f9c31f98f service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:05.763151 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8734fa-06ff-4741-a35b-457e5b369562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:05.764772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8734fa-06ff-4741-a35b-457e5b369562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:05.765057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8734fa-06ff-4741-a35b-457e5b369562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:05.765335 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8734fa-06ff-4741-a35b-457e5b369562 admin admin] PATH_INFO: `/v3/users/b6f5f3fcf70042bdad8f55b1dd4b69c4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:05.767475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8734fa-06ff-4741-a35b-457e5b369562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f5f3fcf70042bdad8f55b1dd4b69c4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:05.777968 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8734fa-06ff-4741-a35b-457e5b369562 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:05.857364 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4c8734fa-06ff-4741-a35b-457e5b369562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f5f3fcf70042bdad8f55b1dd4b69c4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:05.867278 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4c8734fa-06ff-4741-a35b-457e5b369562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f5f3fcf70042bdad8f55b1dd4b69c4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:05.868633 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4c8734fa-06ff-4741-a35b-457e5b369562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f5f3fcf70042bdad8f55b1dd4b69c4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:05.870668 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4c8734fa-06ff-4741-a35b-457e5b369562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f5f3fcf70042bdad8f55b1dd4b69c4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:05.887126 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4c8734fa-06ff-4741-a35b-457e5b369562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f5f3fcf70042bdad8f55b1dd4b69c4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:05.913326 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1052/2090] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:28:05 2022] DELETE /identity/v3/users/b6f5f3fcf70042bdad8f55b1dd4b69c4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:28:06.222325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06234f2-cd3d-449f-a497-0786abed25e3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:06.225730 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b06234f2-cd3d-449f-a497-0786abed25e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:06.466487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06234f2-cd3d-449f-a497-0786abed25e3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:06.604675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:06.667098 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82008b89-da7a-406e-9a45-bdbb636d64b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:06.668794 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008b89-da7a-406e-9a45-bdbb636d64b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:06.675998 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008b89-da7a-406e-9a45-bdbb636d64b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:06.676323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008b89-da7a-406e-9a45-bdbb636d64b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:06.678749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-82008b89-da7a-406e-9a45-bdbb636d64b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:06.815381 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82008b89-da7a-406e-9a45-bdbb636d64b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:06.817131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82008b89-da7a-406e-9a45-bdbb636d64b5 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:06.826401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8734fa-06ff-4741-a35b-457e5b369562 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:06.827930 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4c8734fa-06ff-4741-a35b-457e5b369562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:06.838294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:06.852200 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1039/2091] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:28:06.937331 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8734fa-06ff-4741-a35b-457e5b369562 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:06.964187 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348756c0-3258-4397-ae02-a34b6fecb748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:06.965109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348756c0-3258-4397-ae02-a34b6fecb748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:06.965401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348756c0-3258-4397-ae02-a34b6fecb748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:06.965687 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348756c0-3258-4397-ae02-a34b6fecb748 admin admin] PATH_INFO: `/v3/projects/60e3bb647aff4fb7a76b77196230fe4d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:06.967390 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348756c0-3258-4397-ae02-a34b6fecb748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60e3bb647aff4fb7a76b77196230fe4d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:06.969392 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348756c0-3258-4397-ae02-a34b6fecb748 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:07.073721 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-348756c0-3258-4397-ae02-a34b6fecb748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60e3bb647aff4fb7a76b77196230fe4d', 'request_id': 'req-348756c0-3258-4397-ae02-a34b6fecb748'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:07.086740 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-348756c0-3258-4397-ae02-a34b6fecb748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60e3bb647aff4fb7a76b77196230fe4d', 'request_id': 'req-348756c0-3258-4397-ae02-a34b6fecb748'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:07.107618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-348756c0-3258-4397-ae02-a34b6fecb748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60e3bb647aff4fb7a76b77196230fe4d', 'request_id': 'req-348756c0-3258-4397-ae02-a34b6fecb748'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:07.132094 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-348756c0-3258-4397-ae02-a34b6fecb748 admin admin] The token cache is being invalidate because project 60e3bb647aff4fb7a76b77196230fe4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:28:07.132853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-348756c0-3258-4397-ae02-a34b6fecb748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:07.133398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-348756c0-3258-4397-ae02-a34b6fecb748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:07.136079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1053/2092] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:28:06 2022] DELETE /identity/v3/projects/60e3bb647aff4fb7a76b77196230fe4d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:07.140274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b3d5c-5bc9-424c-bc76-c6bf8bdb8bb2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:07.140561 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b3d5c-5bc9-424c-bc76-c6bf8bdb8bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:07.140842 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b3d5c-5bc9-424c-bc76-c6bf8bdb8bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:07.224775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f28b3d5c-5bc9-424c-bc76-c6bf8bdb8bb2 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:07.227096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f28b3d5c-5bc9-424c-bc76-c6bf8bdb8bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:07.312212 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1040/2093] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:07.320522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f2bd7-d0bb-4146-b373-4bfd558ec11f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:07.320803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f2bd7-d0bb-4146-b373-4bfd558ec11f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:07.321173 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f2bd7-d0bb-4146-b373-4bfd558ec11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:07.352542 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f83f2bd7-d0bb-4146-b373-4bfd558ec11f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:07.354006 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f83f2bd7-d0bb-4146-b373-4bfd558ec11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:07.374901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1054/2094] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:07.380633 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b3d5c-5bc9-424c-bc76-c6bf8bdb8bb2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:07.394398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b3d5c-5bc9-424c-bc76-c6bf8bdb8bb2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:07.401764 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14491ce3-4d71-478c-931b-7f2ce814c1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:07.402876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14491ce3-4d71-478c-931b-7f2ce814c1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:07.402876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14491ce3-4d71-478c-931b-7f2ce814c1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:07.403197 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14491ce3-4d71-478c-931b-7f2ce814c1e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:07.403811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14491ce3-4d71-478c-931b-7f2ce814c1e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:28:07.404115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14491ce3-4d71-478c-931b-7f2ce814c1e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:07.405833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14491ce3-4d71-478c-931b-7f2ce814c1e0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:07.431246 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1041/2095] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:28:07.435980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f2bd7-d0bb-4146-b373-4bfd558ec11f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:07.448741 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f2bd7-d0bb-4146-b373-4bfd558ec11f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:07.456730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078b6ff-f886-4e79-a1bb-4fef391ded83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:07.458580 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078b6ff-f886-4e79-a1bb-4fef391ded83 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:07.459046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078b6ff-f886-4e79-a1bb-4fef391ded83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:07.459524 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078b6ff-f886-4e79-a1bb-4fef391ded83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:07.460864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078b6ff-f886-4e79-a1bb-4fef391ded83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:07.464687 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078b6ff-f886-4e79-a1bb-4fef391ded83 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:07.517361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1055/2096] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:28:07 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:28:07.522347 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14491ce3-4d71-478c-931b-7f2ce814c1e0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:07.536394 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14491ce3-4d71-478c-931b-7f2ce814c1e0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:07.627150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:07.656551 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b615cb-b73f-41b9-8981-5e16d2450bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:07.657071 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b615cb-b73f-41b9-8981-5e16d2450bad admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:07.657381 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b615cb-b73f-41b9-8981-5e16d2450bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:07.657505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b615cb-b73f-41b9-8981-5e16d2450bad admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:07.658265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b615cb-b73f-41b9-8981-5e16d2450bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:07.661155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b615cb-b73f-41b9-8981-5e16d2450bad admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:07.699093 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1042/2097] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:28:07 2022] POST /identity/v3/users => generated 283 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:28:07.700509 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078b6ff-f886-4e79-a1bb-4fef391ded83 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:07.711524 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078b6ff-f886-4e79-a1bb-4fef391ded83 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:07.716361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1401913-04a2-44a0-a4f9-a0b944e44837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:07.717059 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1401913-04a2-44a0-a4f9-a0b944e44837 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:07.717363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1401913-04a2-44a0-a4f9-a0b944e44837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:07.717629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1401913-04a2-44a0-a4f9-a0b944e44837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:07.718588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1401913-04a2-44a0-a4f9-a0b944e44837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:07.720334 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1401913-04a2-44a0-a4f9-a0b944e44837 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:07.751993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1056/2098] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:28:07.756100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b615cb-b73f-41b9-8981-5e16d2450bad admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:07.778144 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b615cb-b73f-41b9-8981-5e16d2450bad admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:07.798659 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d25978-14bf-4a7a-8d9a-ccf3eea5a694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:07.799677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d25978-14bf-4a7a-8d9a-ccf3eea5a694 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:07.800031 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d25978-14bf-4a7a-8d9a-ccf3eea5a694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:07.801275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d25978-14bf-4a7a-8d9a-ccf3eea5a694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:07.802439 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d25978-14bf-4a7a-8d9a-ccf3eea5a694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:07.804151 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d25978-14bf-4a7a-8d9a-ccf3eea5a694 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:07.830329 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1043/2099] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:28:07.833775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1401913-04a2-44a0-a4f9-a0b944e44837 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:07.852050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1401913-04a2-44a0-a4f9-a0b944e44837 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:07.860084 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dade23-805c-4839-87b6-10921e6379b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:07.862064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dade23-805c-4839-87b6-10921e6379b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:07.862638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dade23-805c-4839-87b6-10921e6379b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:07.863487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dade23-805c-4839-87b6-10921e6379b5 admin admin] PATH_INFO: `/v3/projects/4f403bb5d82b456ab90651f3889fbe43/users/d3af95ab41cb4e3c9e761e6e6807f7dd/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:07.887831 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dade23-805c-4839-87b6-10921e6379b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f403bb5d82b456ab90651f3889fbe43, user_id=d3af95ab41cb4e3c9e761e6e6807f7dd, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:07.891594 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dade23-805c-4839-87b6-10921e6379b5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:07.911414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1057/2100] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:28:07 2022] PUT /identity/v3/projects/4f403bb5d82b456ab90651f3889fbe43/users/d3af95ab41cb4e3c9e761e6e6807f7dd/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:07.937281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe569c0-04ae-4f74-9a72-29429f43411d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:07.937281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe569c0-04ae-4f74-9a72-29429f43411d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:07.937677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe569c0-04ae-4f74-9a72-29429f43411d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:07.992497 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fbe569c0-04ae-4f74-9a72-29429f43411d None None] MFA Rules not processed for user `d3af95ab41cb4e3c9e761e6e6807f7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:07.994315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fbe569c0-04ae-4f74-9a72-29429f43411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:08.085846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1044/2101] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:08.090669 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dade23-805c-4839-87b6-10921e6379b5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:08.134374 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:08.174791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dade23-805c-4839-87b6-10921e6379b5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:08.180787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdb0b0-c351-4cd7-bda8-f7ce74c041f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:08.181436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdb0b0-c351-4cd7-bda8-f7ce74c041f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:08.181880 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdb0b0-c351-4cd7-bda8-f7ce74c041f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:08.182175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdb0b0-c351-4cd7-bda8-f7ce74c041f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:08.182967 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdb0b0-c351-4cd7-bda8-f7ce74c041f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:08.185030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdb0b0-c351-4cd7-bda8-f7ce74c041f9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:08.219986 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1058/2102] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:28:08 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:28:08.229303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe569c0-04ae-4f74-9a72-29429f43411d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:08.252741 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe569c0-04ae-4f74-9a72-29429f43411d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:08.423795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd0a25-9608-4ce2-84e3-8dd8aa3e90ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:08.425385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd0a25-9608-4ce2-84e3-8dd8aa3e90ae admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:08.426414 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd0a25-9608-4ce2-84e3-8dd8aa3e90ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:08.427199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd0a25-9608-4ce2-84e3-8dd8aa3e90ae admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:08.429531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd0a25-9608-4ce2-84e3-8dd8aa3e90ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:08.437049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd0a25-9608-4ce2-84e3-8dd8aa3e90ae admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:08.504933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1045/2103] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:28:08 2022] POST /identity/v3/users => generated 290 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:28:08.511579 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdb0b0-c351-4cd7-bda8-f7ce74c041f9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:08.551780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdb0b0-c351-4cd7-bda8-f7ce74c041f9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:08.580030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd3970-6d0a-4660-9a9f-0695a70fb336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:08.581443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd3970-6d0a-4660-9a9f-0695a70fb336 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:08.583456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd3970-6d0a-4660-9a9f-0695a70fb336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:08.583456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd3970-6d0a-4660-9a9f-0695a70fb336 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:08.585238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd3970-6d0a-4660-9a9f-0695a70fb336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:08.589127 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd3970-6d0a-4660-9a9f-0695a70fb336 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:08.627798 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1059/2104] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:28:08.627960 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd0a25-9608-4ce2-84e3-8dd8aa3e90ae admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:08.646151 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd0a25-9608-4ce2-84e3-8dd8aa3e90ae admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:08.657926 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43982f0-f28c-4f33-bec4-580df2094301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:08.659582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43982f0-f28c-4f33-bec4-580df2094301 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:08.659943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43982f0-f28c-4f33-bec4-580df2094301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:08.660261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43982f0-f28c-4f33-bec4-580df2094301 admin admin] PATH_INFO: `/v3/projects/8ac5406f13e244d5b32ac4c6fbeb172e/users/5b15b3c9e8f842e5be7101e0139ae020/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:08.683483 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43982f0-f28c-4f33-bec4-580df2094301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac5406f13e244d5b32ac4c6fbeb172e, user_id=5b15b3c9e8f842e5be7101e0139ae020, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:08.687395 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43982f0-f28c-4f33-bec4-580df2094301 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:08.708544 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1046/2105] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:28:08 2022] PUT /identity/v3/projects/8ac5406f13e244d5b32ac4c6fbeb172e/users/5b15b3c9e8f842e5be7101e0139ae020/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:08.713547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd3970-6d0a-4660-9a9f-0695a70fb336 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:08.726455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd3970-6d0a-4660-9a9f-0695a70fb336 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:08.808815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970bd2a-e52f-42af-b103-98e16d00b198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:08.810502 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970bd2a-e52f-42af-b103-98e16d00b198 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:08.810789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf5d74-2c83-4aa9-9140-fe0e73f10bd8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:08.811175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970bd2a-e52f-42af-b103-98e16d00b198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:08.811509 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf5d74-2c83-4aa9-9140-fe0e73f10bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:08.811931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf5d74-2c83-4aa9-9140-fe0e73f10bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:08.812153 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970bd2a-e52f-42af-b103-98e16d00b198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:08.814046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970bd2a-e52f-42af-b103-98e16d00b198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:08.826805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970bd2a-e52f-42af-b103-98e16d00b198 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:08.854628 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1060/2106] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:28:08.857090 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970bd2a-e52f-42af-b103-98e16d00b198 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:08.857566 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3daf5d74-2c83-4aa9-9140-fe0e73f10bd8 None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:08.860434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3daf5d74-2c83-4aa9-9140-fe0e73f10bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:08.873918 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:08.889771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970bd2a-e52f-42af-b103-98e16d00b198 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:08.899131 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a2202-9643-4387-b3ad-287983be1b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:08.900940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a2202-9643-4387-b3ad-287983be1b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:08.906125 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a2202-9643-4387-b3ad-287983be1b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:08.906688 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a2202-9643-4387-b3ad-287983be1b81 admin admin] PATH_INFO: `/v3/projects/8ac5406f13e244d5b32ac4c6fbeb172e/users/5b15b3c9e8f842e5be7101e0139ae020/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:08.911207 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a2202-9643-4387-b3ad-287983be1b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac5406f13e244d5b32ac4c6fbeb172e, user_id=5b15b3c9e8f842e5be7101e0139ae020, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:08.915910 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a2202-9643-4387-b3ad-287983be1b81 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:08.933322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1061/2107] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:28:08 2022] PUT /identity/v3/projects/8ac5406f13e244d5b32ac4c6fbeb172e/users/5b15b3c9e8f842e5be7101e0139ae020/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:08.946914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bada35-1754-4932-9ff5-d3826638b49b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:08.947907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bada35-1754-4932-9ff5-d3826638b49b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:08.948819 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bada35-1754-4932-9ff5-d3826638b49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:08.997381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-34bada35-1754-4932-9ff5-d3826638b49b None None] MFA Rules not processed for user `5b15b3c9e8f842e5be7101e0139ae020`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:08.998683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-34bada35-1754-4932-9ff5-d3826638b49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:09.003297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1047/2108] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 27 15:28:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:28:09.065453 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf5d74-2c83-4aa9-9140-fe0e73f10bd8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:09.068798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3daf5d74-2c83-4aa9-9140-fe0e73f10bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:09.167454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1062/2109] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:09.188391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bada35-1754-4932-9ff5-d3826638b49b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:09.191371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-34bada35-1754-4932-9ff5-d3826638b49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:09.225799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:09.333516 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf5d74-2c83-4aa9-9140-fe0e73f10bd8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:09.338927 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bada35-1754-4932-9ff5-d3826638b49b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:09.346333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882dbb36-30a5-41dc-a96c-a7fb391c7bfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:09.348151 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882dbb36-30a5-41dc-a96c-a7fb391c7bfc service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:09.349298 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882dbb36-30a5-41dc-a96c-a7fb391c7bfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:09.349907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882dbb36-30a5-41dc-a96c-a7fb391c7bfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:09.372624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882dbb36-30a5-41dc-a96c-a7fb391c7bfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:09.376880 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882dbb36-30a5-41dc-a96c-a7fb391c7bfc service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:09.406566 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1063/2110] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:28:09.485019 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b323f0-78dd-464d-ac1c-003792b9f112 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:09.485310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b323f0-78dd-464d-ac1c-003792b9f112 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:09.485641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b323f0-78dd-464d-ac1c-003792b9f112 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:09.485991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b323f0-78dd-464d-ac1c-003792b9f112 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:09.579228 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882dbb36-30a5-41dc-a96c-a7fb391c7bfc service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:09.580897 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-882dbb36-30a5-41dc-a96c-a7fb391c7bfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:09.604467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882dbb36-30a5-41dc-a96c-a7fb391c7bfc service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:09.616355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2acd-b5c3-42de-8ad7-d85d2c1a8a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:09.617046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2acd-b5c3-42de-8ad7-d85d2c1a8a24 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:09.617329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2acd-b5c3-42de-8ad7-d85d2c1a8a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:09.617606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2acd-b5c3-42de-8ad7-d85d2c1a8a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:09.644327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b323f0-78dd-464d-ac1c-003792b9f112 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:09.646239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b323f0-78dd-464d-ac1c-003792b9f112 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:09.655019 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:09.681405 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1048/2111] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:28:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:28:09.759318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f2acd-b5c3-42de-8ad7-d85d2c1a8a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:09.760602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f2acd-b5c3-42de-8ad7-d85d2c1a8a24 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:09.776571 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1064/2112] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:28:10.866213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190f3cd-bae3-44c0-8a74-e4e233d39359 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:10.866876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190f3cd-bae3-44c0-8a74-e4e233d39359 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:10.867426 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190f3cd-bae3-44c0-8a74-e4e233d39359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:10.952263 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0190f3cd-bae3-44c0-8a74-e4e233d39359 None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:10.963410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0190f3cd-bae3-44c0-8a74-e4e233d39359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:11.015507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1049/2113] 10.222.0.33 () {58 vars in 967 bytes} [Mon Jun 27 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:11.038550 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2acd-b5c3-42de-8ad7-d85d2c1a8a24 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:11.104400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2acd-b5c3-42de-8ad7-d85d2c1a8a24 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:11.129649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa40d97-3fc3-4dde-9352-8c5751c4ccc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:11.130615 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa40d97-3fc3-4dde-9352-8c5751c4ccc6 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:11.130907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa40d97-3fc3-4dde-9352-8c5751c4ccc6 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:11.131264 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa40d97-3fc3-4dde-9352-8c5751c4ccc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:11.150678 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa40d97-3fc3-4dde-9352-8c5751c4ccc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:11.155862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa40d97-3fc3-4dde-9352-8c5751c4ccc6 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:11.180455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1065/2114] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:28:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 15:28:11.843941 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446d0bd-0c0c-4baf-bc90-1b2a40bc3762 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:11.844504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446d0bd-0c0c-4baf-bc90-1b2a40bc3762 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:11.844876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446d0bd-0c0c-4baf-bc90-1b2a40bc3762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:11.955358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c446d0bd-0c0c-4baf-bc90-1b2a40bc3762 None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:11.964963 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c446d0bd-0c0c-4baf-bc90-1b2a40bc3762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:12.007639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1050/2115] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 27 15:28:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:12.022841 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa40d97-3fc3-4dde-9352-8c5751c4ccc6 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:12.045673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa40d97-3fc3-4dde-9352-8c5751c4ccc6 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:12.060842 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934c3d0-c23d-48c5-ab26-026f68e71fd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:12.062356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934c3d0-c23d-48c5-ab26-026f68e71fd4 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:12.063077 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934c3d0-c23d-48c5-ab26-026f68e71fd4 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:12.063831 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934c3d0-c23d-48c5-ab26-026f68e71fd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:12.081699 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934c3d0-c23d-48c5-ab26-026f68e71fd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:12.085276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934c3d0-c23d-48c5-ab26-026f68e71fd4 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:12.107837 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1066/2116] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:28:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 15:28:12.765430 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a37fd-0769-46cb-a20f-2fdfb2d8fd5c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:12.765927 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a37fd-0769-46cb-a20f-2fdfb2d8fd5c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:12.766466 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a37fd-0769-46cb-a20f-2fdfb2d8fd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:12.798375 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b89a37fd-0769-46cb-a20f-2fdfb2d8fd5c None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:12.800013 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b89a37fd-0769-46cb-a20f-2fdfb2d8fd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:12.810320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1051/2117] 10.222.0.33 () {58 vars in 967 bytes} [Mon Jun 27 15:28:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:12.823698 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934c3d0-c23d-48c5-ab26-026f68e71fd4 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:12.836969 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934c3d0-c23d-48c5-ab26-026f68e71fd4 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:12.845986 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4d685-99a9-4a0c-b70c-0ce8b32c48a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:12.847138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4d685-99a9-4a0c-b70c-0ce8b32c48a7 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:12.847695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4d685-99a9-4a0c-b70c-0ce8b32c48a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:12.848169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4d685-99a9-4a0c-b70c-0ce8b32c48a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:12.863254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4d685-99a9-4a0c-b70c-0ce8b32c48a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:12.866415 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4d685-99a9-4a0c-b70c-0ce8b32c48a7 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:12.893539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1067/2118] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:28:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 15:28:15.677313 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a37fd-0769-46cb-a20f-2fdfb2d8fd5c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:15.679128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b89a37fd-0769-46cb-a20f-2fdfb2d8fd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:15.762932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a37fd-0769-46cb-a20f-2fdfb2d8fd5c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:15.770411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fe492-832a-4b98-831f-c652d2cf4c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:15.772013 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fe492-832a-4b98-831f-c652d2cf4c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:15.772510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fe492-832a-4b98-831f-c652d2cf4c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:15.772984 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fe492-832a-4b98-831f-c652d2cf4c9e admin admin] PATH_INFO: `/v3/users/9f361e40b2ec4b7cace299a7bfaa7bd2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:15.775422 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fe492-832a-4b98-831f-c652d2cf4c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f361e40b2ec4b7cace299a7bfaa7bd2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:15.779670 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fe492-832a-4b98-831f-c652d2cf4c9e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:15.857735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd3fe492-832a-4b98-831f-c652d2cf4c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f361e40b2ec4b7cace299a7bfaa7bd2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:15.871334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd3fe492-832a-4b98-831f-c652d2cf4c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f361e40b2ec4b7cace299a7bfaa7bd2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:15.883705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd3fe492-832a-4b98-831f-c652d2cf4c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f361e40b2ec4b7cace299a7bfaa7bd2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:15.884682 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd3fe492-832a-4b98-831f-c652d2cf4c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f361e40b2ec4b7cace299a7bfaa7bd2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:15.912499 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd3fe492-832a-4b98-831f-c652d2cf4c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f361e40b2ec4b7cace299a7bfaa7bd2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:15.923944 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1052/2119] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:28:15 2022] DELETE /identity/v3/users/9f361e40b2ec4b7cace299a7bfaa7bd2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:15.928947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b590b-95b7-429e-aab8-f6e240be376e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:15.929765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b590b-95b7-429e-aab8-f6e240be376e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:15.929961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b590b-95b7-429e-aab8-f6e240be376e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:15.962421 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b37b590b-95b7-429e-aab8-f6e240be376e None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:15.964400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b37b590b-95b7-429e-aab8-f6e240be376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:16.060477 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fe492-832a-4b98-831f-c652d2cf4c9e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:16.060477 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cd3fe492-832a-4b98-831f-c652d2cf4c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:16.099547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1068/2120] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:16.119719 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b590b-95b7-429e-aab8-f6e240be376e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:16.122758 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b37b590b-95b7-429e-aab8-f6e240be376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:16.161600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:16.236311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fe492-832a-4b98-831f-c652d2cf4c9e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:16.244271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb635e1-af04-4c03-ac54-d0e0fd86119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:16.245650 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b590b-95b7-429e-aab8-f6e240be376e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:16.245798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb635e1-af04-4c03-ac54-d0e0fd86119c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:16.246118 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb635e1-af04-4c03-ac54-d0e0fd86119c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:16.246601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb635e1-af04-4c03-ac54-d0e0fd86119c admin admin] PATH_INFO: `/v3/users/d3af95ab41cb4e3c9e761e6e6807f7dd` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:16.248974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb635e1-af04-4c03-ac54-d0e0fd86119c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3af95ab41cb4e3c9e761e6e6807f7dd)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:16.252804 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb635e1-af04-4c03-ac54-d0e0fd86119c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:16.253034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72458ace-9b56-4bd8-bf4c-852ae5a6ccf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:16.254761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72458ace-9b56-4bd8-bf4c-852ae5a6ccf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:16.254761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72458ace-9b56-4bd8-bf4c-852ae5a6ccf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:16.255411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72458ace-9b56-4bd8-bf4c-852ae5a6ccf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:16.256898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:16.273992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72458ace-9b56-4bd8-bf4c-852ae5a6ccf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:16.276788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72458ace-9b56-4bd8-bf4c-852ae5a6ccf2 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:16.305332 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1069/2121] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:28:16.397458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0eb635e1-af04-4c03-ac54-d0e0fd86119c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3af95ab41cb4e3c9e761e6e6807f7dd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:16.412148 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0eb635e1-af04-4c03-ac54-d0e0fd86119c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3af95ab41cb4e3c9e761e6e6807f7dd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:16.427469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0eb635e1-af04-4c03-ac54-d0e0fd86119c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3af95ab41cb4e3c9e761e6e6807f7dd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:16.429069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0eb635e1-af04-4c03-ac54-d0e0fd86119c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3af95ab41cb4e3c9e761e6e6807f7dd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:16.480027 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0eb635e1-af04-4c03-ac54-d0e0fd86119c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3af95ab41cb4e3c9e761e6e6807f7dd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:16.517784 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1053/2122] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:28:16 2022] DELETE /identity/v3/users/d3af95ab41cb4e3c9e761e6e6807f7dd => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:28:16.521015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539af5d-01c4-4f1b-9252-2c401308f998 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:16.521015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539af5d-01c4-4f1b-9252-2c401308f998 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:16.521825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539af5d-01c4-4f1b-9252-2c401308f998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:16.569607 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5539af5d-01c4-4f1b-9252-2c401308f998 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:16.572371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5539af5d-01c4-4f1b-9252-2c401308f998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:16.712259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1070/2123] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:16.720543 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb635e1-af04-4c03-ac54-d0e0fd86119c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:16.723542 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0eb635e1-af04-4c03-ac54-d0e0fd86119c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:16.832667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb635e1-af04-4c03-ac54-d0e0fd86119c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:16.837962 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39852539-7245-41c3-9a84-806541f24ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:16.838700 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39852539-7245-41c3-9a84-806541f24ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:16.838990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39852539-7245-41c3-9a84-806541f24ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:16.839261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39852539-7245-41c3-9a84-806541f24ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:16.850901 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39852539-7245-41c3-9a84-806541f24ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:16.852386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39852539-7245-41c3-9a84-806541f24ee1 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:16.874248 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539af5d-01c4-4f1b-9252-2c401308f998 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:16.875868 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5539af5d-01c4-4f1b-9252-2c401308f998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:16.881237 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1054/2124] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:28:16.910745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539af5d-01c4-4f1b-9252-2c401308f998 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:16.930750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90de94b-acc9-41f1-8186-d964ac7ea2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:16.933640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90de94b-acc9-41f1-8186-d964ac7ea2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:16.938992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90de94b-acc9-41f1-8186-d964ac7ea2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:16.942105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90de94b-acc9-41f1-8186-d964ac7ea2e4 admin admin] PATH_INFO: `/v3/projects/d822293514264d25bd3232b3420f7074` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:16.955869 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90de94b-acc9-41f1-8186-d964ac7ea2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d822293514264d25bd3232b3420f7074)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:16.962550 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90de94b-acc9-41f1-8186-d964ac7ea2e4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:17.096923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c90de94b-acc9-41f1-8186-d964ac7ea2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd822293514264d25bd3232b3420f7074', 'request_id': 'req-c90de94b-acc9-41f1-8186-d964ac7ea2e4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:17.109986 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c90de94b-acc9-41f1-8186-d964ac7ea2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd822293514264d25bd3232b3420f7074', 'request_id': 'req-c90de94b-acc9-41f1-8186-d964ac7ea2e4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:17.128956 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c90de94b-acc9-41f1-8186-d964ac7ea2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd822293514264d25bd3232b3420f7074', 'request_id': 'req-c90de94b-acc9-41f1-8186-d964ac7ea2e4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:17.178728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c90de94b-acc9-41f1-8186-d964ac7ea2e4 admin admin] The token cache is being invalidate because project d822293514264d25bd3232b3420f7074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:28:17.180660 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c90de94b-acc9-41f1-8186-d964ac7ea2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:17.182398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c90de94b-acc9-41f1-8186-d964ac7ea2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:17.187576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1071/2125] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:28:16 2022] DELETE /identity/v3/projects/d822293514264d25bd3232b3420f7074 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:17.542734 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39852539-7245-41c3-9a84-806541f24ee1 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:17.545704 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-39852539-7245-41c3-9a84-806541f24ee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:17.590626 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39852539-7245-41c3-9a84-806541f24ee1 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:17.718277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d140b48-d509-4df8-b89a-c1efce3bf064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:17.720238 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d140b48-d509-4df8-b89a-c1efce3bf064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:17.720789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d140b48-d509-4df8-b89a-c1efce3bf064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:17.721661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d140b48-d509-4df8-b89a-c1efce3bf064 admin admin] PATH_INFO: `/v3/projects/4f403bb5d82b456ab90651f3889fbe43` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:17.724387 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d140b48-d509-4df8-b89a-c1efce3bf064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f403bb5d82b456ab90651f3889fbe43)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:17.728425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d140b48-d509-4df8-b89a-c1efce3bf064 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:17.774906 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:17.815263 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5d140b48-d509-4df8-b89a-c1efce3bf064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f403bb5d82b456ab90651f3889fbe43', 'request_id': 'req-5d140b48-d509-4df8-b89a-c1efce3bf064'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:17.828212 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5d140b48-d509-4df8-b89a-c1efce3bf064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f403bb5d82b456ab90651f3889fbe43', 'request_id': 'req-5d140b48-d509-4df8-b89a-c1efce3bf064'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:17.838877 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5d140b48-d509-4df8-b89a-c1efce3bf064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f403bb5d82b456ab90651f3889fbe43', 'request_id': 'req-5d140b48-d509-4df8-b89a-c1efce3bf064'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:17.860443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5d140b48-d509-4df8-b89a-c1efce3bf064 admin admin] The token cache is being invalidate because project 4f403bb5d82b456ab90651f3889fbe43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:28:17.860908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5d140b48-d509-4df8-b89a-c1efce3bf064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:17.862025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5d140b48-d509-4df8-b89a-c1efce3bf064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:17.865598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1055/2126] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:28:17 2022] DELETE /identity/v3/projects/4f403bb5d82b456ab90651f3889fbe43 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:17.871322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90de94b-acc9-41f1-8186-d964ac7ea2e4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:17.873799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c90de94b-acc9-41f1-8186-d964ac7ea2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:17.900369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90de94b-acc9-41f1-8186-d964ac7ea2e4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:17.992969 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:18.023026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce249bcc-9aeb-426c-9599-c10cc1fa1a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:18.024503 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce249bcc-9aeb-426c-9599-c10cc1fa1a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:18.024958 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce249bcc-9aeb-426c-9599-c10cc1fa1a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:18.025413 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce249bcc-9aeb-426c-9599-c10cc1fa1a8b admin admin] PATH_INFO: `/v3/users/5b15b3c9e8f842e5be7101e0139ae020` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:18.027622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce249bcc-9aeb-426c-9599-c10cc1fa1a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b15b3c9e8f842e5be7101e0139ae020)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:18.031151 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce249bcc-9aeb-426c-9599-c10cc1fa1a8b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:18.108490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ce249bcc-9aeb-426c-9599-c10cc1fa1a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b15b3c9e8f842e5be7101e0139ae020'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:18.134147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ce249bcc-9aeb-426c-9599-c10cc1fa1a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b15b3c9e8f842e5be7101e0139ae020'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:18.138202 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ce249bcc-9aeb-426c-9599-c10cc1fa1a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b15b3c9e8f842e5be7101e0139ae020'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:18.147160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ce249bcc-9aeb-426c-9599-c10cc1fa1a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b15b3c9e8f842e5be7101e0139ae020'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:18.172517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ce249bcc-9aeb-426c-9599-c10cc1fa1a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b15b3c9e8f842e5be7101e0139ae020'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:18.198369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1072/2127] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:28:17 2022] DELETE /identity/v3/users/5b15b3c9e8f842e5be7101e0139ae020 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:18.656248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d140b48-d509-4df8-b89a-c1efce3bf064 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:18.658557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5d140b48-d509-4df8-b89a-c1efce3bf064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:18.676203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d140b48-d509-4df8-b89a-c1efce3bf064 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:18.822187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bde1a-0e6c-4936-b04c-83a5dc593d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:18.823477 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bde1a-0e6c-4936-b04c-83a5dc593d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:18.823768 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bde1a-0e6c-4936-b04c-83a5dc593d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:18.824091 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bde1a-0e6c-4936-b04c-83a5dc593d6b admin admin] PATH_INFO: `/v3/projects/8ac5406f13e244d5b32ac4c6fbeb172e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:18.825947 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bde1a-0e6c-4936-b04c-83a5dc593d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ac5406f13e244d5b32ac4c6fbeb172e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:18.828334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bde1a-0e6c-4936-b04c-83a5dc593d6b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:18.914955 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f83bde1a-0e6c-4936-b04c-83a5dc593d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ac5406f13e244d5b32ac4c6fbeb172e', 'request_id': 'req-f83bde1a-0e6c-4936-b04c-83a5dc593d6b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:18.928104 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f83bde1a-0e6c-4936-b04c-83a5dc593d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ac5406f13e244d5b32ac4c6fbeb172e', 'request_id': 'req-f83bde1a-0e6c-4936-b04c-83a5dc593d6b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:18.940822 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f83bde1a-0e6c-4936-b04c-83a5dc593d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ac5406f13e244d5b32ac4c6fbeb172e', 'request_id': 'req-f83bde1a-0e6c-4936-b04c-83a5dc593d6b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:18.966079 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f83bde1a-0e6c-4936-b04c-83a5dc593d6b admin admin] The token cache is being invalidate because project 8ac5406f13e244d5b32ac4c6fbeb172e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:28:18.966686 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f83bde1a-0e6c-4936-b04c-83a5dc593d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:18.968019 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f83bde1a-0e6c-4936-b04c-83a5dc593d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:18.971284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1056/2128] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:28:18 2022] DELETE /identity/v3/projects/8ac5406f13e244d5b32ac4c6fbeb172e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:28:18.979361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77bd3b-3c62-4fe1-a4c1-f3f3fbefb942 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:18.980000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77bd3b-3c62-4fe1-a4c1-f3f3fbefb942 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:18.980637 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77bd3b-3c62-4fe1-a4c1-f3f3fbefb942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:19.011139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ff77bd3b-3c62-4fe1-a4c1-f3f3fbefb942 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:19.013923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ff77bd3b-3c62-4fe1-a4c1-f3f3fbefb942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:19.178079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1073/2129] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:19.192141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32ce24-3a45-44e9-821f-8292591b165b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:19.193024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32ce24-3a45-44e9-821f-8292591b165b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:19.194108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32ce24-3a45-44e9-821f-8292591b165b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:19.222635 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9c32ce24-3a45-44e9-821f-8292591b165b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:19.226474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9c32ce24-3a45-44e9-821f-8292591b165b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:19.250431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1057/2130] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:28:19.255392 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77bd3b-3c62-4fe1-a4c1-f3f3fbefb942 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:19.283470 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77bd3b-3c62-4fe1-a4c1-f3f3fbefb942 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:19.298542 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555abde-11af-45fd-9034-1c227296a199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:19.302100 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555abde-11af-45fd-9034-1c227296a199 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:19.303786 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555abde-11af-45fd-9034-1c227296a199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:19.304095 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555abde-11af-45fd-9034-1c227296a199 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:19.304982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555abde-11af-45fd-9034-1c227296a199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:28:19.305298 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555abde-11af-45fd-9034-1c227296a199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:19.307038 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555abde-11af-45fd-9034-1c227296a199 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:19.327790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32ce24-3a45-44e9-821f-8292591b165b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:19.335270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1074/2131] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:28:19.339522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32ce24-3a45-44e9-821f-8292591b165b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:19.345828 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25117678-5462-4e04-9af8-68db10f10250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:19.346900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25117678-5462-4e04-9af8-68db10f10250 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:19.347873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25117678-5462-4e04-9af8-68db10f10250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:19.347873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25117678-5462-4e04-9af8-68db10f10250 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:19.349714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25117678-5462-4e04-9af8-68db10f10250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:19.350776 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25117678-5462-4e04-9af8-68db10f10250 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:19.411904 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1058/2132] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:28:19 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:28:19.419048 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555abde-11af-45fd-9034-1c227296a199 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:19.436635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555abde-11af-45fd-9034-1c227296a199 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:19.557037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:19.595911 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1206b6-2cc0-47b7-8505-e30c95ef1843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:19.597829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1206b6-2cc0-47b7-8505-e30c95ef1843 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:19.598752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1206b6-2cc0-47b7-8505-e30c95ef1843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:19.599556 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1206b6-2cc0-47b7-8505-e30c95ef1843 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:19.600906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1206b6-2cc0-47b7-8505-e30c95ef1843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:19.606432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1206b6-2cc0-47b7-8505-e30c95ef1843 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:19.654627 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1075/2133] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:28:19 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:28:19.656583 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25117678-5462-4e04-9af8-68db10f10250 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:19.678302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25117678-5462-4e04-9af8-68db10f10250 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:19.686685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f52e6-8888-4362-aacd-65b13e374385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:19.688237 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f52e6-8888-4362-aacd-65b13e374385 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:19.689994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f52e6-8888-4362-aacd-65b13e374385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:19.690725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f52e6-8888-4362-aacd-65b13e374385 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:19.693715 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f52e6-8888-4362-aacd-65b13e374385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:19.696583 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f52e6-8888-4362-aacd-65b13e374385 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:19.726047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1059/2134] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:28:19.734642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1206b6-2cc0-47b7-8505-e30c95ef1843 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:19.756090 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1206b6-2cc0-47b7-8505-e30c95ef1843 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:19.770823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca94f60-7d5a-4264-9878-9c4524c54d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:19.772170 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca94f60-7d5a-4264-9878-9c4524c54d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:19.772656 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca94f60-7d5a-4264-9878-9c4524c54d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:19.773131 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca94f60-7d5a-4264-9878-9c4524c54d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:19.774720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca94f60-7d5a-4264-9878-9c4524c54d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:19.778640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca94f60-7d5a-4264-9878-9c4524c54d00 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:19.810766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f52e6-8888-4362-aacd-65b13e374385 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:19.819917 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1076/2135] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:28:19.822760 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:19.841808 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f52e6-8888-4362-aacd-65b13e374385 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:19.859087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf659e2-a8d6-4382-9785-521c5aa59446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:19.861529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf659e2-a8d6-4382-9785-521c5aa59446 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:19.862425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf659e2-a8d6-4382-9785-521c5aa59446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:19.863152 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf659e2-a8d6-4382-9785-521c5aa59446 admin admin] PATH_INFO: `/v3/projects/82f5bd16694347308242ec6a48d7f3c2/users/693d9657e9314121a91afda62cee4ad4/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:19.899594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf659e2-a8d6-4382-9785-521c5aa59446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f5bd16694347308242ec6a48d7f3c2, user_id=693d9657e9314121a91afda62cee4ad4, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:19.906075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf659e2-a8d6-4382-9785-521c5aa59446 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:19.945131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1060/2136] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:28:19 2022] PUT /identity/v3/projects/82f5bd16694347308242ec6a48d7f3c2/users/693d9657e9314121a91afda62cee4ad4/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:19.966056 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ab9b7-3070-4aa2-9ccc-dfa17461b0cd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:19.967613 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ab9b7-3070-4aa2-9ccc-dfa17461b0cd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:19.968291 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ab9b7-3070-4aa2-9ccc-dfa17461b0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:20.044731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-467ab9b7-3070-4aa2-9ccc-dfa17461b0cd None None] MFA Rules not processed for user `693d9657e9314121a91afda62cee4ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:20.047134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-467ab9b7-3070-4aa2-9ccc-dfa17461b0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:20.255925 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1077/2137] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:20.264905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf659e2-a8d6-4382-9785-521c5aa59446 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:20.458403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf659e2-a8d6-4382-9785-521c5aa59446 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:20.471299 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3d652-e7e1-4d23-b81f-8d66d1be7b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:20.471769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3d652-e7e1-4d23-b81f-8d66d1be7b71 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:20.472431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3d652-e7e1-4d23-b81f-8d66d1be7b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:20.474057 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3d652-e7e1-4d23-b81f-8d66d1be7b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:20.474785 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3d652-e7e1-4d23-b81f-8d66d1be7b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:20.480051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3d652-e7e1-4d23-b81f-8d66d1be7b71 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:20.558857 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1061/2138] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:28:20 2022] POST /identity/v3/projects => generated 379 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:28:20.564950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ab9b7-3070-4aa2-9ccc-dfa17461b0cd None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:20.577623 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ab9b7-3070-4aa2-9ccc-dfa17461b0cd None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:20.693530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab1269-c630-41f1-88d4-743252617dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:20.694550 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab1269-c630-41f1-88d4-743252617dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:20.695030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab1269-c630-41f1-88d4-743252617dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:20.695512 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab1269-c630-41f1-88d4-743252617dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:20.696444 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab1269-c630-41f1-88d4-743252617dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:20.699350 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab1269-c630-41f1-88d4-743252617dc4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:20.743257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1078/2139] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:28:20 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:28:20.745344 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3d652-e7e1-4d23-b81f-8d66d1be7b71 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:20.764574 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3d652-e7e1-4d23-b81f-8d66d1be7b71 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:20.776541 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3e7ad-6b04-449c-9127-4229f88b4770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:20.778660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3e7ad-6b04-449c-9127-4229f88b4770 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:20.779189 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3e7ad-6b04-449c-9127-4229f88b4770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:20.779600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3e7ad-6b04-449c-9127-4229f88b4770 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:20.781264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3e7ad-6b04-449c-9127-4229f88b4770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:20.783856 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3e7ad-6b04-449c-9127-4229f88b4770 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:20.801113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1062/2140] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:28:20.803624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab1269-c630-41f1-88d4-743252617dc4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:20.817596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab1269-c630-41f1-88d4-743252617dc4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:20.823548 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2370c83-a98e-4e16-9b70-d113d0aff2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:20.824547 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2370c83-a98e-4e16-9b70-d113d0aff2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:20.824840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2370c83-a98e-4e16-9b70-d113d0aff2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:20.825122 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2370c83-a98e-4e16-9b70-d113d0aff2a9 admin admin] PATH_INFO: `/v3/projects/01bb3b5ff9ec48afbed260c1d94df4c0/users/c2c97971edc84a6583695e472f2c8bff/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:20.834883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1b59d-eb2d-4e7f-b425-7cf25d600677 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:20.835464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1b59d-eb2d-4e7f-b425-7cf25d600677 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:20.835464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1b59d-eb2d-4e7f-b425-7cf25d600677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:20.872167 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-50a1b59d-eb2d-4e7f-b425-7cf25d600677 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:20.874505 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2370c83-a98e-4e16-9b70-d113d0aff2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bb3b5ff9ec48afbed260c1d94df4c0, user_id=c2c97971edc84a6583695e472f2c8bff, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:20.879780 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-50a1b59d-eb2d-4e7f-b425-7cf25d600677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:20.880830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2370c83-a98e-4e16-9b70-d113d0aff2a9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:20.894140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1063/2141] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Jun 27 15:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:20.922391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1b59d-eb2d-4e7f-b425-7cf25d600677 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:20.924297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-50a1b59d-eb2d-4e7f-b425-7cf25d600677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:20.926578 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1079/2142] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:28:20 2022] PUT /identity/v3/projects/01bb3b5ff9ec48afbed260c1d94df4c0/users/c2c97971edc84a6583695e472f2c8bff/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:20.932747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2370c83-a98e-4e16-9b70-d113d0aff2a9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:21.036965 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:21.137772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2370c83-a98e-4e16-9b70-d113d0aff2a9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:21.159648 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588f74d-da85-4e39-bf81-49fe9e95faac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:21.161292 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588f74d-da85-4e39-bf81-49fe9e95faac admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:21.161832 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588f74d-da85-4e39-bf81-49fe9e95faac admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:21.163689 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588f74d-da85-4e39-bf81-49fe9e95faac admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:21.164775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588f74d-da85-4e39-bf81-49fe9e95faac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:21.169512 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588f74d-da85-4e39-bf81-49fe9e95faac admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:21.174996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1b59d-eb2d-4e7f-b425-7cf25d600677 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:21.208964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:21.214273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1080/2143] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:28:21.226022 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588f74d-da85-4e39-bf81-49fe9e95faac admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:21.252049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588f74d-da85-4e39-bf81-49fe9e95faac admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:21.261393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae827645-24ec-4384-acf2-1b5c5e2adfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:21.263494 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae827645-24ec-4384-acf2-1b5c5e2adfcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:21.264290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae827645-24ec-4384-acf2-1b5c5e2adfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:21.264999 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae827645-24ec-4384-acf2-1b5c5e2adfcd admin admin] PATH_INFO: `/v3/projects/01bb3b5ff9ec48afbed260c1d94df4c0/users/c2c97971edc84a6583695e472f2c8bff/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:21.269974 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae827645-24ec-4384-acf2-1b5c5e2adfcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bb3b5ff9ec48afbed260c1d94df4c0, user_id=c2c97971edc84a6583695e472f2c8bff, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:21.275839 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae827645-24ec-4384-acf2-1b5c5e2adfcd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:21.298342 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1081/2144] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:28:21 2022] PUT /identity/v3/projects/01bb3b5ff9ec48afbed260c1d94df4c0/users/c2c97971edc84a6583695e472f2c8bff/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:21.316061 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b5c71-e37c-455a-b5c4-49b9278bfda4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:21.316559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b5c71-e37c-455a-b5c4-49b9278bfda4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:21.317045 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b5c71-e37c-455a-b5c4-49b9278bfda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:21.380235 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c3ab6-744c-4ec6-b297-d61d474c4ecd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:21.380545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c3ab6-744c-4ec6-b297-d61d474c4ecd service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:21.380875 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c3ab6-744c-4ec6-b297-d61d474c4ecd service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:21.381116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c3ab6-744c-4ec6-b297-d61d474c4ecd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:21.405390 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c3ab6-744c-4ec6-b297-d61d474c4ecd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:21.406728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5b0b5c71-e37c-455a-b5c4-49b9278bfda4 None None] MFA Rules not processed for user `c2c97971edc84a6583695e472f2c8bff`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:21.408037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5b0b5c71-e37c-455a-b5c4-49b9278bfda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:21.408341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c3ab6-744c-4ec6-b297-d61d474c4ecd service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:21.425450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1064/2145] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:28:21.428081 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c04ae-95c5-4170-a875-4ec979d2f037 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:21.428567 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c04ae-95c5-4170-a875-4ec979d2f037 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:21.429042 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c04ae-95c5-4170-a875-4ec979d2f037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:21.463764 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fd8c04ae-95c5-4170-a875-4ec979d2f037 None None] MFA Rules not processed for user `c5ebe5c2142f49ab8f2455bf1ae952d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:21.465363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fd8c04ae-95c5-4170-a875-4ec979d2f037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:21.564983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1082/2146] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:28:21.586680 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b5c71-e37c-455a-b5c4-49b9278bfda4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:21.590049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5b0b5c71-e37c-455a-b5c4-49b9278bfda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:21.601076 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1065/2147] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:21.694486 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b5c71-e37c-455a-b5c4-49b9278bfda4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:21.699632 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00bcd0-3b43-4d03-8fa9-175badd04769 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:21.700327 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00bcd0-3b43-4d03-8fa9-175badd04769 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:21.700636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00bcd0-3b43-4d03-8fa9-175badd04769 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:21.701078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00bcd0-3b43-4d03-8fa9-175badd04769 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:21.715405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00bcd0-3b43-4d03-8fa9-175badd04769 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:21.717786 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00bcd0-3b43-4d03-8fa9-175badd04769 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:21.731800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1083/2148] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:28:21.907418 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c04ae-95c5-4170-a875-4ec979d2f037 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:21.929303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c04ae-95c5-4170-a875-4ec979d2f037 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:21.943607 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8ae2f-502e-47bc-97f3-3dfdb566cd48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:21.947260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8ae2f-502e-47bc-97f3-3dfdb566cd48 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:21.947747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8ae2f-502e-47bc-97f3-3dfdb566cd48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:21.948283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8ae2f-502e-47bc-97f3-3dfdb566cd48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:22.086493 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8ae2f-502e-47bc-97f3-3dfdb566cd48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:22.089954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8ae2f-502e-47bc-97f3-3dfdb566cd48 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:22.123392 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1066/2149] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:28:22.622659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00bcd0-3b43-4d03-8fa9-175badd04769 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:22.670793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:22.737503 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00bcd0-3b43-4d03-8fa9-175badd04769 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:22.748000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351c882-ebf0-406c-b398-a6d3b859086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:22.750732 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351c882-ebf0-406c-b398-a6d3b859086b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:22.751888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351c882-ebf0-406c-b398-a6d3b859086b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:22.752928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351c882-ebf0-406c-b398-a6d3b859086b admin admin] PATH_INFO: `/v3/users/693d9657e9314121a91afda62cee4ad4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:22.755762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351c882-ebf0-406c-b398-a6d3b859086b admin admin] RBAC: Authorizing `identity:delete_user(user_id=693d9657e9314121a91afda62cee4ad4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:22.757940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351c882-ebf0-406c-b398-a6d3b859086b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:22.834647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6351c882-ebf0-406c-b398-a6d3b859086b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693d9657e9314121a91afda62cee4ad4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:22.844919 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6351c882-ebf0-406c-b398-a6d3b859086b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693d9657e9314121a91afda62cee4ad4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:22.846056 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6351c882-ebf0-406c-b398-a6d3b859086b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693d9657e9314121a91afda62cee4ad4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:22.847213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6351c882-ebf0-406c-b398-a6d3b859086b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693d9657e9314121a91afda62cee4ad4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:22.873923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6351c882-ebf0-406c-b398-a6d3b859086b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693d9657e9314121a91afda62cee4ad4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:22.901517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1084/2150] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:28:22 2022] DELETE /identity/v3/users/693d9657e9314121a91afda62cee4ad4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:22.908753 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc6172-5dc7-4d39-855b-56566ecf0bcd None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:22.909483 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc6172-5dc7-4d39-855b-56566ecf0bcd None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:22.909962 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc6172-5dc7-4d39-855b-56566ecf0bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:22.944969 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-43bc6172-5dc7-4d39-855b-56566ecf0bcd None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:22.947404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-43bc6172-5dc7-4d39-855b-56566ecf0bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:23.044624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:23.076011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1067/2151] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:23.089603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351c882-ebf0-406c-b398-a6d3b859086b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:23.091174 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6351c882-ebf0-406c-b398-a6d3b859086b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:23.192788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351c882-ebf0-406c-b398-a6d3b859086b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:23.196913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30262b-b0f5-4769-9452-5d4c5ea1df93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:23.197607 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30262b-b0f5-4769-9452-5d4c5ea1df93 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:23.197887 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30262b-b0f5-4769-9452-5d4c5ea1df93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:23.198172 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30262b-b0f5-4769-9452-5d4c5ea1df93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:23.210463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30262b-b0f5-4769-9452-5d4c5ea1df93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:23.212695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30262b-b0f5-4769-9452-5d4c5ea1df93 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:23.228744 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1085/2152] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:28:23.590986 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc6172-5dc7-4d39-855b-56566ecf0bcd None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:23.592730 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-43bc6172-5dc7-4d39-855b-56566ecf0bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:23.611864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc6172-5dc7-4d39-855b-56566ecf0bcd None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:23.618764 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fed65-e0c7-4d57-88fc-4f76e769fffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:23.620389 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fed65-e0c7-4d57-88fc-4f76e769fffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:23.620759 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fed65-e0c7-4d57-88fc-4f76e769fffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:23.621105 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fed65-e0c7-4d57-88fc-4f76e769fffd admin admin] PATH_INFO: `/v3/projects/82f5bd16694347308242ec6a48d7f3c2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:23.623226 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fed65-e0c7-4d57-88fc-4f76e769fffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=82f5bd16694347308242ec6a48d7f3c2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:23.625518 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fed65-e0c7-4d57-88fc-4f76e769fffd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:23.697427 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-373fed65-e0c7-4d57-88fc-4f76e769fffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82f5bd16694347308242ec6a48d7f3c2', 'request_id': 'req-373fed65-e0c7-4d57-88fc-4f76e769fffd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:23.710326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-373fed65-e0c7-4d57-88fc-4f76e769fffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82f5bd16694347308242ec6a48d7f3c2', 'request_id': 'req-373fed65-e0c7-4d57-88fc-4f76e769fffd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:23.717892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-373fed65-e0c7-4d57-88fc-4f76e769fffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82f5bd16694347308242ec6a48d7f3c2', 'request_id': 'req-373fed65-e0c7-4d57-88fc-4f76e769fffd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:23.741182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-373fed65-e0c7-4d57-88fc-4f76e769fffd admin admin] The token cache is being invalidate because project 82f5bd16694347308242ec6a48d7f3c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:28:23.741672 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-373fed65-e0c7-4d57-88fc-4f76e769fffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:23.742882 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-373fed65-e0c7-4d57-88fc-4f76e769fffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:23.745534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1068/2153] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:28:23 2022] DELETE /identity/v3/projects/82f5bd16694347308242ec6a48d7f3c2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:23.751789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30262b-b0f5-4769-9452-5d4c5ea1df93 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:23.769302 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30262b-b0f5-4769-9452-5d4c5ea1df93 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:23.869829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:23.884393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e6c0c-c295-46fa-91cb-370926283bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:23.885409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e6c0c-c295-46fa-91cb-370926283bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:23.885700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e6c0c-c295-46fa-91cb-370926283bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:23.886053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e6c0c-c295-46fa-91cb-370926283bf8 admin admin] PATH_INFO: `/v3/users/c2c97971edc84a6583695e472f2c8bff` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:23.889902 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e6c0c-c295-46fa-91cb-370926283bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c97971edc84a6583695e472f2c8bff)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:23.892139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e6c0c-c295-46fa-91cb-370926283bf8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:24.022541 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-230e6c0c-c295-46fa-91cb-370926283bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c97971edc84a6583695e472f2c8bff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:24.046177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-230e6c0c-c295-46fa-91cb-370926283bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c97971edc84a6583695e472f2c8bff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:24.048617 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-230e6c0c-c295-46fa-91cb-370926283bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c97971edc84a6583695e472f2c8bff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:24.049790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-230e6c0c-c295-46fa-91cb-370926283bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c97971edc84a6583695e472f2c8bff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:24.084776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-230e6c0c-c295-46fa-91cb-370926283bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c97971edc84a6583695e472f2c8bff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:24.111821 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1086/2154] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:28:23 2022] DELETE /identity/v3/users/c2c97971edc84a6583695e472f2c8bff => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:24.488210 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fed65-e0c7-4d57-88fc-4f76e769fffd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:24.490593 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-373fed65-e0c7-4d57-88fc-4f76e769fffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:24.513515 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fed65-e0c7-4d57-88fc-4f76e769fffd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:24.617328 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdea56a-2850-41e4-9d18-91ddc5de3d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:24.618443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdea56a-2850-41e4-9d18-91ddc5de3d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:24.618921 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdea56a-2850-41e4-9d18-91ddc5de3d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:24.619290 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdea56a-2850-41e4-9d18-91ddc5de3d78 admin admin] PATH_INFO: `/v3/projects/01bb3b5ff9ec48afbed260c1d94df4c0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:24.621504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdea56a-2850-41e4-9d18-91ddc5de3d78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01bb3b5ff9ec48afbed260c1d94df4c0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:24.623229 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdea56a-2850-41e4-9d18-91ddc5de3d78 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:24.706598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5cdea56a-2850-41e4-9d18-91ddc5de3d78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01bb3b5ff9ec48afbed260c1d94df4c0', 'request_id': 'req-5cdea56a-2850-41e4-9d18-91ddc5de3d78'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:24.723128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5cdea56a-2850-41e4-9d18-91ddc5de3d78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01bb3b5ff9ec48afbed260c1d94df4c0', 'request_id': 'req-5cdea56a-2850-41e4-9d18-91ddc5de3d78'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:24.738832 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5cdea56a-2850-41e4-9d18-91ddc5de3d78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01bb3b5ff9ec48afbed260c1d94df4c0', 'request_id': 'req-5cdea56a-2850-41e4-9d18-91ddc5de3d78'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:24.757554 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:24.767327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5cdea56a-2850-41e4-9d18-91ddc5de3d78 admin admin] The token cache is being invalidate because project 01bb3b5ff9ec48afbed260c1d94df4c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:28:24.767857 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5cdea56a-2850-41e4-9d18-91ddc5de3d78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:24.770668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5cdea56a-2850-41e4-9d18-91ddc5de3d78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:24.774331 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1069/2155] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:28:24 2022] DELETE /identity/v3/projects/01bb3b5ff9ec48afbed260c1d94df4c0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:28:24.780019 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8aca3-732d-419f-8af9-bd48426eff96 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:24.783042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8aca3-732d-419f-8af9-bd48426eff96 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:24.783673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8aca3-732d-419f-8af9-bd48426eff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:24.828194 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7fc8aca3-732d-419f-8af9-bd48426eff96 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:24.830992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7fc8aca3-732d-419f-8af9-bd48426eff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:24.986327 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1087/2156] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:24.995410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff2219-7217-4a4b-9054-f4254b88518b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:24.995877 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff2219-7217-4a4b-9054-f4254b88518b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:24.996371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff2219-7217-4a4b-9054-f4254b88518b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:25.030113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-02ff2219-7217-4a4b-9054-f4254b88518b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:25.031972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-02ff2219-7217-4a4b-9054-f4254b88518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:25.057823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1070/2157] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:25.062823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8aca3-732d-419f-8af9-bd48426eff96 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:25.084642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8aca3-732d-419f-8af9-bd48426eff96 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:25.107554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3917ae-1aa5-4636-9a5f-87c2e8d49943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:25.108877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3917ae-1aa5-4636-9a5f-87c2e8d49943 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:25.109542 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3917ae-1aa5-4636-9a5f-87c2e8d49943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:25.110011 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3917ae-1aa5-4636-9a5f-87c2e8d49943 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:25.117828 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3917ae-1aa5-4636-9a5f-87c2e8d49943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:28:25.117828 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3917ae-1aa5-4636-9a5f-87c2e8d49943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:25.117828 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3917ae-1aa5-4636-9a5f-87c2e8d49943 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:25.136492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1088/2158] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:28:25.143790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff2219-7217-4a4b-9054-f4254b88518b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:25.163135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff2219-7217-4a4b-9054-f4254b88518b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:25.172015 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d6eb1-55fe-4e57-a353-3b7a4e8fd30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:25.173110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d6eb1-55fe-4e57-a353-3b7a4e8fd30c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:25.173580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d6eb1-55fe-4e57-a353-3b7a4e8fd30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:25.174028 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d6eb1-55fe-4e57-a353-3b7a4e8fd30c admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:25.175252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d6eb1-55fe-4e57-a353-3b7a4e8fd30c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:25.178570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d6eb1-55fe-4e57-a353-3b7a4e8fd30c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:25.270908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1071/2159] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:28:25 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:28:25.276733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3917ae-1aa5-4636-9a5f-87c2e8d49943 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:25.320934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3917ae-1aa5-4636-9a5f-87c2e8d49943 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:25.461011 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a6624-926b-495f-9491-278df71729c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:25.462204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a6624-926b-495f-9491-278df71729c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:25.462726 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a6624-926b-495f-9491-278df71729c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:25.463208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a6624-926b-495f-9491-278df71729c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:25.465835 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a6624-926b-495f-9491-278df71729c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:25.471118 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a6624-926b-495f-9491-278df71729c0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:25.493459 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:25.519892 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1089/2160] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:28:25 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:28:25.526244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d6eb1-55fe-4e57-a353-3b7a4e8fd30c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:25.549605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d6eb1-55fe-4e57-a353-3b7a4e8fd30c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:25.559107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf88ee-525f-4ff9-80fe-5f34b6a56250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:25.560138 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf88ee-525f-4ff9-80fe-5f34b6a56250 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:25.560812 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf88ee-525f-4ff9-80fe-5f34b6a56250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:25.561549 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf88ee-525f-4ff9-80fe-5f34b6a56250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:25.562994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf88ee-525f-4ff9-80fe-5f34b6a56250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:25.566723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf88ee-525f-4ff9-80fe-5f34b6a56250 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:25.582918 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1072/2161] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:28:25.588159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a6624-926b-495f-9491-278df71729c0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:25.605070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a6624-926b-495f-9491-278df71729c0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:25.613507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0697835-5c96-4a93-b431-3790253ea219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:25.614908 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0697835-5c96-4a93-b431-3790253ea219 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:25.615431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0697835-5c96-4a93-b431-3790253ea219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:25.615905 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0697835-5c96-4a93-b431-3790253ea219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:25.617066 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0697835-5c96-4a93-b431-3790253ea219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:25.619562 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0697835-5c96-4a93-b431-3790253ea219 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:25.641369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1090/2162] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:28:25.646424 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf88ee-525f-4ff9-80fe-5f34b6a56250 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:25.668298 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf88ee-525f-4ff9-80fe-5f34b6a56250 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:25.678452 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4976ce-11ff-494d-bbc3-063266a72e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:25.681088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4976ce-11ff-494d-bbc3-063266a72e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:25.681625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4976ce-11ff-494d-bbc3-063266a72e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:25.682208 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4976ce-11ff-494d-bbc3-063266a72e93 admin admin] PATH_INFO: `/v3/projects/00ad67281c904525a07d270d65d499a3/users/7c59daf4040a4155aebac76a0dcab714/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:25.733426 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4976ce-11ff-494d-bbc3-063266a72e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ad67281c904525a07d270d65d499a3, user_id=7c59daf4040a4155aebac76a0dcab714, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:25.744359 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4976ce-11ff-494d-bbc3-063266a72e93 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:25.773673 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1073/2163] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:28:25 2022] PUT /identity/v3/projects/00ad67281c904525a07d270d65d499a3/users/7c59daf4040a4155aebac76a0dcab714/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:28:25.793106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4e23-7d6a-4b97-8926-b743cd6beeb0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:25.794007 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4e23-7d6a-4b97-8926-b743cd6beeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:25.794175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4e23-7d6a-4b97-8926-b743cd6beeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:25.868287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b0aa4e23-7d6a-4b97-8926-b743cd6beeb0 None None] MFA Rules not processed for user `7c59daf4040a4155aebac76a0dcab714`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:25.871209 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b0aa4e23-7d6a-4b97-8926-b743cd6beeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:26.042397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1091/2164] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:26.047705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4976ce-11ff-494d-bbc3-063266a72e93 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:26.181920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4976ce-11ff-494d-bbc3-063266a72e93 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:26.191632 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79f17a-c13f-47fd-987e-7e940c8b6f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:26.193000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79f17a-c13f-47fd-987e-7e940c8b6f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:26.193510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79f17a-c13f-47fd-987e-7e940c8b6f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:26.194096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79f17a-c13f-47fd-987e-7e940c8b6f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:26.195754 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79f17a-c13f-47fd-987e-7e940c8b6f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:26.200163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79f17a-c13f-47fd-987e-7e940c8b6f51 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:26.223081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1a7aa-e27f-4d33-b4be-ddf9abe79b1e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:26.224186 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1a7aa-e27f-4d33-b4be-ddf9abe79b1e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:26.224549 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1a7aa-e27f-4d33-b4be-ddf9abe79b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:26.260832 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1074/2165] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:28:26 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:28:26.261151 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-34c1a7aa-e27f-4d33-b4be-ddf9abe79b1e None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:26.262123 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-34c1a7aa-e27f-4d33-b4be-ddf9abe79b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:26.263867 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79f17a-c13f-47fd-987e-7e940c8b6f51 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:26.390733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1092/2166] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Jun 27 15:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:28:26.417909 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1a7aa-e27f-4d33-b4be-ddf9abe79b1e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:26.419788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-34c1a7aa-e27f-4d33-b4be-ddf9abe79b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:26.423712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79f17a-c13f-47fd-987e-7e940c8b6f51 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:26.432077 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f688d94-9b01-4f60-ba83-185c175bc46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:26.432875 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f688d94-9b01-4f60-ba83-185c175bc46f admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:26.433391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f688d94-9b01-4f60-ba83-185c175bc46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:26.433906 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f688d94-9b01-4f60-ba83-185c175bc46f admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:26.435304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f688d94-9b01-4f60-ba83-185c175bc46f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:26.442041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f688d94-9b01-4f60-ba83-185c175bc46f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:26.485288 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1075/2167] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:28:26 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:28:26.487387 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f688d94-9b01-4f60-ba83-185c175bc46f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:26.522645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f688d94-9b01-4f60-ba83-185c175bc46f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:26.537211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db59acd-4e85-4f79-836b-ba56575772c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:26.538307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db59acd-4e85-4f79-836b-ba56575772c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:26.538788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db59acd-4e85-4f79-836b-ba56575772c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:26.539411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db59acd-4e85-4f79-836b-ba56575772c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:26.540402 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db59acd-4e85-4f79-836b-ba56575772c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:26.542727 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db59acd-4e85-4f79-836b-ba56575772c5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:26.563491 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1a7aa-e27f-4d33-b4be-ddf9abe79b1e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:26.570067 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9f14a-9cd0-4e95-ac0e-bd04c769f1ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:26.576697 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:26.586586 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1076/2168] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:28:26.589681 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9f14a-9cd0-4e95-ac0e-bd04c769f1ef service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:26.590136 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9f14a-9cd0-4e95-ac0e-bd04c769f1ef service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:26.590606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9f14a-9cd0-4e95-ac0e-bd04c769f1ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:26.594947 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db59acd-4e85-4f79-836b-ba56575772c5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:26.606901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:26.609789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9f14a-9cd0-4e95-ac0e-bd04c769f1ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:26.612077 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9f14a-9cd0-4e95-ac0e-bd04c769f1ef service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:26.617645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db59acd-4e85-4f79-836b-ba56575772c5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:26.628032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61d0e8-cb64-4237-9b0a-f9aa4ead7d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:26.629593 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61d0e8-cb64-4237-9b0a-f9aa4ead7d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:26.630096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61d0e8-cb64-4237-9b0a-f9aa4ead7d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:26.630671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61d0e8-cb64-4237-9b0a-f9aa4ead7d8d admin admin] PATH_INFO: `/v3/projects/ea09a4b935b54fcb9e784254aa09122c/users/6e7b4493d70d4893834d5df683920993/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:26.646338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1093/2169] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:28:26.663302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61d0e8-cb64-4237-9b0a-f9aa4ead7d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea09a4b935b54fcb9e784254aa09122c, user_id=6e7b4493d70d4893834d5df683920993, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:26.666522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61d0e8-cb64-4237-9b0a-f9aa4ead7d8d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:26.688143 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1077/2170] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:28:26 2022] PUT /identity/v3/projects/ea09a4b935b54fcb9e784254aa09122c/users/6e7b4493d70d4893834d5df683920993/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:28:26.692929 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9f14a-9cd0-4e95-ac0e-bd04c769f1ef service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:26.718827 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9f14a-9cd0-4e95-ac0e-bd04c769f1ef service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:26.851646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e139c0b-8164-43d1-9b4d-f4a8b788b5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:26.852683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e139c0b-8164-43d1-9b4d-f4a8b788b5ed admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:26.852870 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e139c0b-8164-43d1-9b4d-f4a8b788b5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:26.853240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e139c0b-8164-43d1-9b4d-f4a8b788b5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:26.854797 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e139c0b-8164-43d1-9b4d-f4a8b788b5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:26.856233 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e139c0b-8164-43d1-9b4d-f4a8b788b5ed admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:26.870296 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1094/2171] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:28:26.874701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61d0e8-cb64-4237-9b0a-f9aa4ead7d8d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:26.887599 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61d0e8-cb64-4237-9b0a-f9aa4ead7d8d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:26.896979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a839872-a450-4905-b0f7-f62bced8a4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:26.897345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a839872-a450-4905-b0f7-f62bced8a4f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:26.897749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a839872-a450-4905-b0f7-f62bced8a4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:26.898247 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a839872-a450-4905-b0f7-f62bced8a4f3 admin admin] PATH_INFO: `/v3/projects/ea09a4b935b54fcb9e784254aa09122c/users/6e7b4493d70d4893834d5df683920993/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:26.901814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a839872-a450-4905-b0f7-f62bced8a4f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea09a4b935b54fcb9e784254aa09122c, user_id=6e7b4493d70d4893834d5df683920993, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:26.905137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a839872-a450-4905-b0f7-f62bced8a4f3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:26.926489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1078/2172] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:28:26 2022] PUT /identity/v3/projects/ea09a4b935b54fcb9e784254aa09122c/users/6e7b4493d70d4893834d5df683920993/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:26.936482 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b6686-9747-4f5d-9450-7c39c984401e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:26.939274 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b6686-9747-4f5d-9450-7c39c984401e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:26.940352 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b6686-9747-4f5d-9450-7c39c984401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:27.010718 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-021b6686-9747-4f5d-9450-7c39c984401e None None] MFA Rules not processed for user `6e7b4493d70d4893834d5df683920993`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:27.012797 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-021b6686-9747-4f5d-9450-7c39c984401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:27.135005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1095/2173] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:28:27.148755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a839872-a450-4905-b0f7-f62bced8a4f3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:27.152706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8a839872-a450-4905-b0f7-f62bced8a4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:27.294207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a839872-a450-4905-b0f7-f62bced8a4f3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:27.299156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439bd07-905a-4468-a340-af9291c98bff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:27.300086 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439bd07-905a-4468-a340-af9291c98bff service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:27.300570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439bd07-905a-4468-a340-af9291c98bff service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:27.300992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439bd07-905a-4468-a340-af9291c98bff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:27.397550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439bd07-905a-4468-a340-af9291c98bff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:27.400295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439bd07-905a-4468-a340-af9291c98bff service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:27.455819 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1079/2174] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:28:29.145184 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e36d77-c791-4e7a-9da4-2799e5899d56 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:29.145897 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e36d77-c791-4e7a-9da4-2799e5899d56 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:29.146656 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e36d77-c791-4e7a-9da4-2799e5899d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:29.224664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-05e36d77-c791-4e7a-9da4-2799e5899d56 None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:29.226733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-05e36d77-c791-4e7a-9da4-2799e5899d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:29.409951 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1096/2175] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 27 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:28:29.445918 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439bd07-905a-4468-a340-af9291c98bff service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:29.448433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b439bd07-905a-4468-a340-af9291c98bff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:29.634899 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:29.669334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439bd07-905a-4468-a340-af9291c98bff service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:29.686050 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0b5f2-a121-4d01-ac07-cba0307c19c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:29.687047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0b5f2-a121-4d01-ac07-cba0307c19c4 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:29.687628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0b5f2-a121-4d01-ac07-cba0307c19c4 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:29.687912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0b5f2-a121-4d01-ac07-cba0307c19c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:29.705357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0b5f2-a121-4d01-ac07-cba0307c19c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:29.707287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0b5f2-a121-4d01-ac07-cba0307c19c4 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:29.723268 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1080/2176] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:28:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 15:28:29.815722 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc75e46-2e16-4847-8ebe-c60813905e3a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:29.816506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc75e46-2e16-4847-8ebe-c60813905e3a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:29.817770 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc75e46-2e16-4847-8ebe-c60813905e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:29.885632 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-dbc75e46-2e16-4847-8ebe-c60813905e3a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:29.888254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dbc75e46-2e16-4847-8ebe-c60813905e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:29.947522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:30.025704 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1097/2177] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Jun 27 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:30.046455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0b5f2-a121-4d01-ac07-cba0307c19c4 service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:30.274336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0b5f2-a121-4d01-ac07-cba0307c19c4 service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:30.302985 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf4d0a-9680-4230-8fab-ae09b3b50376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:30.303679 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf4d0a-9680-4230-8fab-ae09b3b50376 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:30.304078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf4d0a-9680-4230-8fab-ae09b3b50376 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:30.304248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf4d0a-9680-4230-8fab-ae09b3b50376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:30.326389 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf4d0a-9680-4230-8fab-ae09b3b50376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:30.330359 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf4d0a-9680-4230-8fab-ae09b3b50376 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:30.348118 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1081/2178] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:28:30.612478 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc75e46-2e16-4847-8ebe-c60813905e3a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:30.626404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc75e46-2e16-4847-8ebe-c60813905e3a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:30.637499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c32706-7596-4eb7-8245-6db571892a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:30.638839 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c32706-7596-4eb7-8245-6db571892a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:30.639277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c32706-7596-4eb7-8245-6db571892a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:30.640074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c32706-7596-4eb7-8245-6db571892a95 admin admin] PATH_INFO: `/v3/users/7c59daf4040a4155aebac76a0dcab714` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:30.642683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c32706-7596-4eb7-8245-6db571892a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c59daf4040a4155aebac76a0dcab714)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:30.646539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c32706-7596-4eb7-8245-6db571892a95 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:30.790979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5c32706-7596-4eb7-8245-6db571892a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c59daf4040a4155aebac76a0dcab714'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:30.806838 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5c32706-7596-4eb7-8245-6db571892a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c59daf4040a4155aebac76a0dcab714'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:30.808050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5c32706-7596-4eb7-8245-6db571892a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c59daf4040a4155aebac76a0dcab714'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:30.809034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5c32706-7596-4eb7-8245-6db571892a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c59daf4040a4155aebac76a0dcab714'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:30.839233 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5c32706-7596-4eb7-8245-6db571892a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c59daf4040a4155aebac76a0dcab714'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:30.862296 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1098/2179] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:28:30 2022] DELETE /identity/v3/users/7c59daf4040a4155aebac76a0dcab714 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:30.865242 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af655b-0348-4491-b656-732607398da0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:30.865833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af655b-0348-4491-b656-732607398da0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:30.866295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af655b-0348-4491-b656-732607398da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:30.887731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-17af655b-0348-4491-b656-732607398da0 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:30.889259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-17af655b-0348-4491-b656-732607398da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:30.986083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1082/2180] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:31.004425 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c32706-7596-4eb7-8245-6db571892a95 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:31.007018 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a5c32706-7596-4eb7-8245-6db571892a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:31.107037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c32706-7596-4eb7-8245-6db571892a95 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:31.111835 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54414132-2aa3-4234-b07f-10293da9e8f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:31.113205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54414132-2aa3-4234-b07f-10293da9e8f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:31.113606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54414132-2aa3-4234-b07f-10293da9e8f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:31.114003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54414132-2aa3-4234-b07f-10293da9e8f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:31.125917 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54414132-2aa3-4234-b07f-10293da9e8f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:31.128202 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54414132-2aa3-4234-b07f-10293da9e8f7 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:31.142571 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1099/2181] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:28:31.702140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af655b-0348-4491-b656-732607398da0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:31.704103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-17af655b-0348-4491-b656-732607398da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:31.720503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af655b-0348-4491-b656-732607398da0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:31.736483 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:31.738442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:31.739248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:31.739373 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b admin admin] PATH_INFO: `/v3/projects/00ad67281c904525a07d270d65d499a3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:31.742664 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ad67281c904525a07d270d65d499a3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:31.748870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:31.867992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ad67281c904525a07d270d65d499a3', 'request_id': 'req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:31.882923 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ad67281c904525a07d270d65d499a3', 'request_id': 'req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:31.891660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ad67281c904525a07d270d65d499a3', 'request_id': 'req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:31.894938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:31.912996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b admin admin] The token cache is being invalidate because project 00ad67281c904525a07d270d65d499a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:28:31.913285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:31.914010 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:31.918659 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1083/2182] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:28:31 2022] DELETE /identity/v3/projects/00ad67281c904525a07d270d65d499a3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:31.924214 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54414132-2aa3-4234-b07f-10293da9e8f7 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:31.938667 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54414132-2aa3-4234-b07f-10293da9e8f7 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:31.988721 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:32.043053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f94736-d32c-4a99-9376-f431cd84b7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:32.044664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f94736-d32c-4a99-9376-f431cd84b7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:32.045940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f94736-d32c-4a99-9376-f431cd84b7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:32.046529 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f94736-d32c-4a99-9376-f431cd84b7e7 admin admin] PATH_INFO: `/v3/users/6e7b4493d70d4893834d5df683920993` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:32.049098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f94736-d32c-4a99-9376-f431cd84b7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e7b4493d70d4893834d5df683920993)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:32.053809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f94736-d32c-4a99-9376-f431cd84b7e7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:32.184531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-87f94736-d32c-4a99-9376-f431cd84b7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e7b4493d70d4893834d5df683920993'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:32.199924 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-87f94736-d32c-4a99-9376-f431cd84b7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e7b4493d70d4893834d5df683920993'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:32.201129 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-87f94736-d32c-4a99-9376-f431cd84b7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e7b4493d70d4893834d5df683920993'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:32.202071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-87f94736-d32c-4a99-9376-f431cd84b7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e7b4493d70d4893834d5df683920993'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:32.231653 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-87f94736-d32c-4a99-9376-f431cd84b7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e7b4493d70d4893834d5df683920993'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:32.261212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1100/2183] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:28:31 2022] DELETE /identity/v3/users/6e7b4493d70d4893834d5df683920993 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:33.157977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:33.161708 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:33.260682 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a0288-21eb-492b-ac95-6b9ff5c5ed8b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:33.452072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b93a4-1a87-4788-818a-095f6547cf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:33.454565 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b93a4-1a87-4788-818a-095f6547cf6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:33.455214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b93a4-1a87-4788-818a-095f6547cf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:33.455816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b93a4-1a87-4788-818a-095f6547cf6d admin admin] PATH_INFO: `/v3/projects/ea09a4b935b54fcb9e784254aa09122c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:33.459658 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b93a4-1a87-4788-818a-095f6547cf6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea09a4b935b54fcb9e784254aa09122c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:33.462058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b93a4-1a87-4788-818a-095f6547cf6d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:33.588653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b97b93a4-1a87-4788-818a-095f6547cf6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea09a4b935b54fcb9e784254aa09122c', 'request_id': 'req-b97b93a4-1a87-4788-818a-095f6547cf6d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:33.604486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b97b93a4-1a87-4788-818a-095f6547cf6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea09a4b935b54fcb9e784254aa09122c', 'request_id': 'req-b97b93a4-1a87-4788-818a-095f6547cf6d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:33.618401 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b97b93a4-1a87-4788-818a-095f6547cf6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea09a4b935b54fcb9e784254aa09122c', 'request_id': 'req-b97b93a4-1a87-4788-818a-095f6547cf6d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:33.651476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b97b93a4-1a87-4788-818a-095f6547cf6d admin admin] The token cache is being invalidate because project ea09a4b935b54fcb9e784254aa09122c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:28:33.652086 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b97b93a4-1a87-4788-818a-095f6547cf6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:33.653409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b97b93a4-1a87-4788-818a-095f6547cf6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:33.658186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1084/2184] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:28:33 2022] DELETE /identity/v3/projects/ea09a4b935b54fcb9e784254aa09122c => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:33.671102 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5c3d3-de16-4ea3-89b4-c22e19e2b1e2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:33.671816 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5c3d3-de16-4ea3-89b4-c22e19e2b1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:33.672325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5c3d3-de16-4ea3-89b4-c22e19e2b1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:33.714604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9cb5c3d3-de16-4ea3-89b4-c22e19e2b1e2 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:33.721068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9cb5c3d3-de16-4ea3-89b4-c22e19e2b1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:33.863105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1101/2185] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:33.867713 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3671ab-e988-44fe-884d-895440f6bb21 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:33.868241 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3671ab-e988-44fe-884d-895440f6bb21 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:33.868768 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3671ab-e988-44fe-884d-895440f6bb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:33.904634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3d3671ab-e988-44fe-884d-895440f6bb21 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:33.922533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3d3671ab-e988-44fe-884d-895440f6bb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:33.932826 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1085/2186] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:33.939456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5c3d3-de16-4ea3-89b4-c22e19e2b1e2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:33.952011 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5c3d3-de16-4ea3-89b4-c22e19e2b1e2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:33.964247 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff680ef-145e-496d-9fe9-802a40980e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:33.964954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff680ef-145e-496d-9fe9-802a40980e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:33.965204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff680ef-145e-496d-9fe9-802a40980e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:33.965484 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff680ef-145e-496d-9fe9-802a40980e3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:33.967133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff680ef-145e-496d-9fe9-802a40980e3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:28:33.967447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff680ef-145e-496d-9fe9-802a40980e3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:33.969182 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff680ef-145e-496d-9fe9-802a40980e3d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:33.986317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1102/2187] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:28:33.992165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3671ab-e988-44fe-884d-895440f6bb21 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:34.013260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3671ab-e988-44fe-884d-895440f6bb21 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:34.031943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d684c85-ab6b-49db-8798-4be6c5bde84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:34.033005 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d684c85-ab6b-49db-8798-4be6c5bde84d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:34.033353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d684c85-ab6b-49db-8798-4be6c5bde84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:34.033639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d684c85-ab6b-49db-8798-4be6c5bde84d admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:34.034646 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d684c85-ab6b-49db-8798-4be6c5bde84d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:34.038576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d684c85-ab6b-49db-8798-4be6c5bde84d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:34.113643 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1086/2188] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:28:33 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:28:34.121299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff680ef-145e-496d-9fe9-802a40980e3d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:34.179845 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff680ef-145e-496d-9fe9-802a40980e3d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:34.258840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:34.317569 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70117347-d707-4687-a516-b446f603ec88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:34.322144 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70117347-d707-4687-a516-b446f603ec88 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:34.327556 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70117347-d707-4687-a516-b446f603ec88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:34.328794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70117347-d707-4687-a516-b446f603ec88 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:34.336984 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70117347-d707-4687-a516-b446f603ec88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:34.347204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70117347-d707-4687-a516-b446f603ec88 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:34.404929 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1103/2189] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:28:34 2022] POST /identity/v3/users => generated 289 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:28:34.407680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d684c85-ab6b-49db-8798-4be6c5bde84d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:34.427284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d684c85-ab6b-49db-8798-4be6c5bde84d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:34.441390 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf04c1-a799-4ddf-b11d-ab1f73b22a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:34.443681 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf04c1-a799-4ddf-b11d-ab1f73b22a21 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:34.444453 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf04c1-a799-4ddf-b11d-ab1f73b22a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:34.445365 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf04c1-a799-4ddf-b11d-ab1f73b22a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:34.447123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf04c1-a799-4ddf-b11d-ab1f73b22a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:34.451802 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf04c1-a799-4ddf-b11d-ab1f73b22a21 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:34.479606 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1087/2190] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:28:34.486387 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70117347-d707-4687-a516-b446f603ec88 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:34.500857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70117347-d707-4687-a516-b446f603ec88 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:34.512949 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ac8a3-0887-402e-bd1e-6eba641e270e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:34.513972 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ac8a3-0887-402e-bd1e-6eba641e270e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:34.514462 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ac8a3-0887-402e-bd1e-6eba641e270e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:34.514859 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ac8a3-0887-402e-bd1e-6eba641e270e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:34.516558 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ac8a3-0887-402e-bd1e-6eba641e270e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:34.517890 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ac8a3-0887-402e-bd1e-6eba641e270e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:34.538380 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1104/2191] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:28:34.544407 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf04c1-a799-4ddf-b11d-ab1f73b22a21 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:34.559239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf04c1-a799-4ddf-b11d-ab1f73b22a21 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:34.571177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c10c36-15ba-4aff-ad39-f0442e51687a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:34.572456 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c10c36-15ba-4aff-ad39-f0442e51687a admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:34.573085 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c10c36-15ba-4aff-ad39-f0442e51687a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:34.573567 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c10c36-15ba-4aff-ad39-f0442e51687a admin admin] PATH_INFO: `/v3/projects/0f16496aa746472fb8eb10da6c5e0b5e/users/bafd695fb63447528db8a036e2ab2965/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:34.625970 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c10c36-15ba-4aff-ad39-f0442e51687a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f16496aa746472fb8eb10da6c5e0b5e, user_id=bafd695fb63447528db8a036e2ab2965, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:34.638744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c10c36-15ba-4aff-ad39-f0442e51687a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:34.692212 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1088/2192] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:28:34 2022] PUT /identity/v3/projects/0f16496aa746472fb8eb10da6c5e0b5e/users/bafd695fb63447528db8a036e2ab2965/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:34.695467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef4d62-eb6d-4512-a7c3-aa1f24968373 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:34.696219 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef4d62-eb6d-4512-a7c3-aa1f24968373 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:34.696618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef4d62-eb6d-4512-a7c3-aa1f24968373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:34.771430 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7bef4d62-eb6d-4512-a7c3-aa1f24968373 None None] MFA Rules not processed for user `bafd695fb63447528db8a036e2ab2965`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:34.772713 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7bef4d62-eb6d-4512-a7c3-aa1f24968373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:34.943705 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1105/2193] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:28:34.949043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c10c36-15ba-4aff-ad39-f0442e51687a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:35.003259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:35.067621 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c10c36-15ba-4aff-ad39-f0442e51687a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:35.080467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774d13c-4ff0-4a3e-a14b-4b4a16a149a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:35.081577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d13c-4ff0-4a3e-a14b-4b4a16a149a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:35.082070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d13c-4ff0-4a3e-a14b-4b4a16a149a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:35.082717 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d13c-4ff0-4a3e-a14b-4b4a16a149a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:35.083594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774d13c-4ff0-4a3e-a14b-4b4a16a149a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:35.087715 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774d13c-4ff0-4a3e-a14b-4b4a16a149a9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:35.121308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f45470-10c3-4e8a-91f4-e16c67d697ec None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:35.121664 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f45470-10c3-4e8a-91f4-e16c67d697ec None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:35.122024 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f45470-10c3-4e8a-91f4-e16c67d697ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:35.132634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1089/2194] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:28:34 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:28:35.136873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774d13c-4ff0-4a3e-a14b-4b4a16a149a9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:35.188989 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d2f45470-10c3-4e8a-91f4-e16c67d697ec None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:35.190320 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d2f45470-10c3-4e8a-91f4-e16c67d697ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:35.223861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774d13c-4ff0-4a3e-a14b-4b4a16a149a9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:35.227460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a529d8b-62cb-4438-87b8-63f7902571ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:35.228262 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a529d8b-62cb-4438-87b8-63f7902571ae admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:35.228619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a529d8b-62cb-4438-87b8-63f7902571ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:35.229001 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a529d8b-62cb-4438-87b8-63f7902571ae admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:35.229792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a529d8b-62cb-4438-87b8-63f7902571ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:35.231981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a529d8b-62cb-4438-87b8-63f7902571ae admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:35.275278 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1090/2195] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:28:35 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:28:35.276333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a529d8b-62cb-4438-87b8-63f7902571ae admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:35.291653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a529d8b-62cb-4438-87b8-63f7902571ae admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:35.301237 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc2ab9-fe8c-40f2-b233-a2f210ca7299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:35.302957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc2ab9-fe8c-40f2-b233-a2f210ca7299 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:35.303271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc2ab9-fe8c-40f2-b233-a2f210ca7299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:35.303701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc2ab9-fe8c-40f2-b233-a2f210ca7299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:35.304507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc2ab9-fe8c-40f2-b233-a2f210ca7299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:35.306831 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc2ab9-fe8c-40f2-b233-a2f210ca7299 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:35.323887 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1106/2196] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Jun 27 15:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:35.325028 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1091/2197] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:28:35.329215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f45470-10c3-4e8a-91f4-e16c67d697ec None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:35.343076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f45470-10c3-4e8a-91f4-e16c67d697ec None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:35.347958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc2ab9-fe8c-40f2-b233-a2f210ca7299 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:35.349293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf735d1-1962-49fc-8b3f-a042331249af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:35.350327 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf735d1-1962-49fc-8b3f-a042331249af admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:35.350695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf735d1-1962-49fc-8b3f-a042331249af admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:35.351047 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf735d1-1962-49fc-8b3f-a042331249af admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:35.351678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a9bc2ab9-fe8c-40f2-b233-a2f210ca7299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:35.351958 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf735d1-1962-49fc-8b3f-a042331249af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:35.353705 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf735d1-1962-49fc-8b3f-a042331249af admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:35.367439 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1107/2198] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:28:35.372031 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf735d1-1962-49fc-8b3f-a042331249af admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:35.383550 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf735d1-1962-49fc-8b3f-a042331249af admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:35.393109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70938171-4169-47b9-91d6-d4c6fd57100c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:35.394090 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70938171-4169-47b9-91d6-d4c6fd57100c admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:35.394427 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70938171-4169-47b9-91d6-d4c6fd57100c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:35.394723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70938171-4169-47b9-91d6-d4c6fd57100c admin admin] PATH_INFO: `/v3/projects/1cd059ce21e54185ae1aacdfad7f8dd3/users/c8f247d163794434a4c4e9bc3e3d11d3/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:35.416038 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70938171-4169-47b9-91d6-d4c6fd57100c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd059ce21e54185ae1aacdfad7f8dd3, user_id=c8f247d163794434a4c4e9bc3e3d11d3, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:35.418942 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70938171-4169-47b9-91d6-d4c6fd57100c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:35.442812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1108/2199] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:28:35 2022] PUT /identity/v3/projects/1cd059ce21e54185ae1aacdfad7f8dd3/users/c8f247d163794434a4c4e9bc3e3d11d3/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:35.455971 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e98da-9d8b-4d6d-bcb6-cd4d88e9a2e3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:35.457779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e98da-9d8b-4d6d-bcb6-cd4d88e9a2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:35.458054 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e98da-9d8b-4d6d-bcb6-cd4d88e9a2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:35.483658 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc2ab9-fe8c-40f2-b233-a2f210ca7299 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:35.496422 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-831e98da-9d8b-4d6d-bcb6-cd4d88e9a2e3 None None] MFA Rules not processed for user `c8f247d163794434a4c4e9bc3e3d11d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:35.497989 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-831e98da-9d8b-4d6d-bcb6-cd4d88e9a2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:35.507139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:35.511778 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:35.570360 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dafba8-9543-4e3c-b677-2fc68f9a91c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:35.571058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dafba8-9543-4e3c-b677-2fc68f9a91c7 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:35.571367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dafba8-9543-4e3c-b677-2fc68f9a91c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:35.571628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dafba8-9543-4e3c-b677-2fc68f9a91c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:35.616927 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1109/2200] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:28:35.619468 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e98da-9d8b-4d6d-bcb6-cd4d88e9a2e3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:35.683571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dafba8-9543-4e3c-b677-2fc68f9a91c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:35.685466 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dafba8-9543-4e3c-b677-2fc68f9a91c7 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:35.700315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1092/2201] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:28:35.782125 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e98da-9d8b-4d6d-bcb6-cd4d88e9a2e3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:35.802356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4095a89-5c49-4571-8493-9ce861a53a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:35.803093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4095a89-5c49-4571-8493-9ce861a53a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:35.803392 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4095a89-5c49-4571-8493-9ce861a53a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:35.806027 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4095a89-5c49-4571-8493-9ce861a53a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:35.806895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4095a89-5c49-4571-8493-9ce861a53a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:35.818280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4095a89-5c49-4571-8493-9ce861a53a8f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:35.900453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1110/2202] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:28:35 2022] POST /identity/v3/projects => generated 377 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:28:35.904932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dafba8-9543-4e3c-b677-2fc68f9a91c7 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:35.921462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dafba8-9543-4e3c-b677-2fc68f9a91c7 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:36.071202 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876a050-d4d1-4852-9c80-9f787e85d2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:36.071202 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876a050-d4d1-4852-9c80-9f787e85d2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:36.071202 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876a050-d4d1-4852-9c80-9f787e85d2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:36.071202 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876a050-d4d1-4852-9c80-9f787e85d2d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:36.072061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876a050-d4d1-4852-9c80-9f787e85d2d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:36.072061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876a050-d4d1-4852-9c80-9f787e85d2d4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:36.111885 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4095a89-5c49-4571-8493-9ce861a53a8f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:36.112779 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1093/2203] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:28:35 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:28:36.134823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4095a89-5c49-4571-8493-9ce861a53a8f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:36.147911 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36358c2c-a937-4295-8884-d5a9d9c938d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:36.152910 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36358c2c-a937-4295-8884-d5a9d9c938d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:36.153195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36358c2c-a937-4295-8884-d5a9d9c938d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:36.153523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36358c2c-a937-4295-8884-d5a9d9c938d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:36.154572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36358c2c-a937-4295-8884-d5a9d9c938d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:36.165477 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36358c2c-a937-4295-8884-d5a9d9c938d5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:36.195755 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1111/2204] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:28:36.202194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876a050-d4d1-4852-9c80-9f787e85d2d4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:36.227445 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876a050-d4d1-4852-9c80-9f787e85d2d4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:36.244319 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463ad5d-1c5b-4a8f-a7b1-08d41e754fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:36.245559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463ad5d-1c5b-4a8f-a7b1-08d41e754fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:36.246776 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463ad5d-1c5b-4a8f-a7b1-08d41e754fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:36.247104 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463ad5d-1c5b-4a8f-a7b1-08d41e754fb1 admin admin] PATH_INFO: `/v3/projects/6dcc28e35495421eb807c2d253dd76ec/users/0970e9bad33f4c989a858853019e4edc/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:36.280385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463ad5d-1c5b-4a8f-a7b1-08d41e754fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dcc28e35495421eb807c2d253dd76ec, user_id=0970e9bad33f4c989a858853019e4edc, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:36.284896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463ad5d-1c5b-4a8f-a7b1-08d41e754fb1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:36.309104 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1094/2205] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:28:36 2022] PUT /identity/v3/projects/6dcc28e35495421eb807c2d253dd76ec/users/0970e9bad33f4c989a858853019e4edc/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:36.314715 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36358c2c-a937-4295-8884-d5a9d9c938d5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:36.358991 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36358c2c-a937-4295-8884-d5a9d9c938d5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:36.605821 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35065739-690f-4b15-8d4f-3ec6a8a7e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:36.607270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35065739-690f-4b15-8d4f-3ec6a8a7e97d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:36.607625 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35065739-690f-4b15-8d4f-3ec6a8a7e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:36.608323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35065739-690f-4b15-8d4f-3ec6a8a7e97d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:36.609748 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35065739-690f-4b15-8d4f-3ec6a8a7e97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:36.613207 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35065739-690f-4b15-8d4f-3ec6a8a7e97d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:36.640089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1112/2206] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:28:36.646902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463ad5d-1c5b-4a8f-a7b1-08d41e754fb1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:36.666520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463ad5d-1c5b-4a8f-a7b1-08d41e754fb1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:36.686654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f7cc0-297c-4007-9575-468818768b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:36.688883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7cc0-297c-4007-9575-468818768b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:36.689350 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7cc0-297c-4007-9575-468818768b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:36.689798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7cc0-297c-4007-9575-468818768b46 admin admin] PATH_INFO: `/v3/projects/6dcc28e35495421eb807c2d253dd76ec/users/0970e9bad33f4c989a858853019e4edc/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:36.694007 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f7cc0-297c-4007-9575-468818768b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dcc28e35495421eb807c2d253dd76ec, user_id=0970e9bad33f4c989a858853019e4edc, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:36.700170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f7cc0-297c-4007-9575-468818768b46 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:36.733638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1095/2207] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:28:36 2022] PUT /identity/v3/projects/6dcc28e35495421eb807c2d253dd76ec/users/0970e9bad33f4c989a858853019e4edc/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:36.751673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930811d-f9d2-42bd-93a7-ecec921db8ae None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:36.752402 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930811d-f9d2-42bd-93a7-ecec921db8ae None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:36.753011 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930811d-f9d2-42bd-93a7-ecec921db8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:36.811898 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e930811d-f9d2-42bd-93a7-ecec921db8ae None None] MFA Rules not processed for user `0970e9bad33f4c989a858853019e4edc`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:36.813554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e930811d-f9d2-42bd-93a7-ecec921db8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:36.821326 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:36.950990 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1113/2208] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:36.962648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f7cc0-297c-4007-9575-468818768b46 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:36.964698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-502f7cc0-297c-4007-9575-468818768b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:36.979247 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:37.051923 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f7cc0-297c-4007-9575-468818768b46 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:37.058356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1b01c-2465-4647-bd55-e506d808b387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:37.059393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1b01c-2465-4647-bd55-e506d808b387 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:37.059828 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1b01c-2465-4647-bd55-e506d808b387 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:37.060287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1b01c-2465-4647-bd55-e506d808b387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:37.166742 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1b01c-2465-4647-bd55-e506d808b387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:37.169186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1b01c-2465-4647-bd55-e506d808b387 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:37.188172 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1096/2209] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:28:39.376583 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930811d-f9d2-42bd-93a7-ecec921db8ae None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:39.379592 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e930811d-f9d2-42bd-93a7-ecec921db8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:39.397815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930811d-f9d2-42bd-93a7-ecec921db8ae None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:39.403916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebf776-eaac-47eb-88d4-0ad55bfaf41f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:39.405665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebf776-eaac-47eb-88d4-0ad55bfaf41f service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:39.406118 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebf776-eaac-47eb-88d4-0ad55bfaf41f service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:39.406904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebf776-eaac-47eb-88d4-0ad55bfaf41f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:39.489514 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58202d88-e18a-491f-9645-c4a229772525 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:39.490551 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58202d88-e18a-491f-9645-c4a229772525 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:39.491278 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebf776-eaac-47eb-88d4-0ad55bfaf41f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:39.491899 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58202d88-e18a-491f-9645-c4a229772525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:39.492757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebf776-eaac-47eb-88d4-0ad55bfaf41f service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:39.504967 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1114/2210] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:28:39.540090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-58202d88-e18a-491f-9645-c4a229772525 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:39.543105 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-58202d88-e18a-491f-9645-c4a229772525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:39.708798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1097/2211] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Jun 27 15:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:39.744091 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebf776-eaac-47eb-88d4-0ad55bfaf41f service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:39.913755 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebf776-eaac-47eb-88d4-0ad55bfaf41f service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:39.928085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbdf01-f617-43f8-a3ac-4bf57e42a603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:39.929194 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbdf01-f617-43f8-a3ac-4bf57e42a603 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:39.929665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbdf01-f617-43f8-a3ac-4bf57e42a603 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:39.930115 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbdf01-f617-43f8-a3ac-4bf57e42a603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:39.947100 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbdf01-f617-43f8-a3ac-4bf57e42a603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:39.950262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbdf01-f617-43f8-a3ac-4bf57e42a603 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:39.968145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1115/2212] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:28:40.625398 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58202d88-e18a-491f-9645-c4a229772525 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:40.649527 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58202d88-e18a-491f-9645-c4a229772525 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:40.657107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e226e-82c1-46fb-bc21-1b57eaf92be9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:40.658754 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e226e-82c1-46fb-bc21-1b57eaf92be9 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:40.659989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e226e-82c1-46fb-bc21-1b57eaf92be9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:40.660672 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e226e-82c1-46fb-bc21-1b57eaf92be9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:40.720035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e226e-82c1-46fb-bc21-1b57eaf92be9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:40.727943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e226e-82c1-46fb-bc21-1b57eaf92be9 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:40.760483 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1098/2213] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:28:43.868893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb3fbe-19e0-4315-8ea0-ae37d19640de None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:43.869465 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb3fbe-19e0-4315-8ea0-ae37d19640de None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:43.869817 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb3fbe-19e0-4315-8ea0-ae37d19640de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:43.904580 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6edb3fbe-19e0-4315-8ea0-ae37d19640de None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:43.907599 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6edb3fbe-19e0-4315-8ea0-ae37d19640de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:43.922212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1116/2214] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Jun 27 15:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:28:43.947995 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e226e-82c1-46fb-bc21-1b57eaf92be9 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:43.951524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-770e226e-82c1-46fb-bc21-1b57eaf92be9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:43.974773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e226e-82c1-46fb-bc21-1b57eaf92be9 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:43.983926 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211b44c-19ec-486d-8908-aa701d9b024f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:43.984938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211b44c-19ec-486d-8908-aa701d9b024f service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:43.985299 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211b44c-19ec-486d-8908-aa701d9b024f service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:43.985651 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211b44c-19ec-486d-8908-aa701d9b024f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:44.005035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211b44c-19ec-486d-8908-aa701d9b024f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:44.007343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211b44c-19ec-486d-8908-aa701d9b024f service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:44.023445 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1099/2215] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:28:45.480448 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb3fbe-19e0-4315-8ea0-ae37d19640de None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:45.499559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb3fbe-19e0-4315-8ea0-ae37d19640de None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:45.508745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6ca21-90e2-4424-ac4d-78af47dcb400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:45.510276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6ca21-90e2-4424-ac4d-78af47dcb400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:45.510796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6ca21-90e2-4424-ac4d-78af47dcb400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:45.511317 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6ca21-90e2-4424-ac4d-78af47dcb400 admin admin] PATH_INFO: `/v3/users/bafd695fb63447528db8a036e2ab2965` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:45.513446 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6ca21-90e2-4424-ac4d-78af47dcb400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bafd695fb63447528db8a036e2ab2965)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:45.517324 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6ca21-90e2-4424-ac4d-78af47dcb400 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:45.546856 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:45.602324 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ced6ca21-90e2-4424-ac4d-78af47dcb400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bafd695fb63447528db8a036e2ab2965'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:45.612017 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ced6ca21-90e2-4424-ac4d-78af47dcb400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bafd695fb63447528db8a036e2ab2965'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:45.612865 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ced6ca21-90e2-4424-ac4d-78af47dcb400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bafd695fb63447528db8a036e2ab2965'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:45.613675 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ced6ca21-90e2-4424-ac4d-78af47dcb400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bafd695fb63447528db8a036e2ab2965'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:45.628793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ced6ca21-90e2-4424-ac4d-78af47dcb400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bafd695fb63447528db8a036e2ab2965'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:45.650333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1117/2216] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:28:45 2022] DELETE /identity/v3/users/bafd695fb63447528db8a036e2ab2965 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:45.654677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438aa5f-96c5-4a8f-9a78-b2f0e5368df6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:45.655341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438aa5f-96c5-4a8f-9a78-b2f0e5368df6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:45.655642 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438aa5f-96c5-4a8f-9a78-b2f0e5368df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:45.689488 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2438aa5f-96c5-4a8f-9a78-b2f0e5368df6 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:45.692296 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2438aa5f-96c5-4a8f-9a78-b2f0e5368df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:45.739802 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:45.776805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1100/2217] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:45.787669 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6ca21-90e2-4424-ac4d-78af47dcb400 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:45.789820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ced6ca21-90e2-4424-ac4d-78af47dcb400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:45.863708 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6ca21-90e2-4424-ac4d-78af47dcb400 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:45.868102 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99835080-cf05-4fb7-8f13-9025cbdac4a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:45.868787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99835080-cf05-4fb7-8f13-9025cbdac4a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:45.869118 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99835080-cf05-4fb7-8f13-9025cbdac4a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:45.869381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99835080-cf05-4fb7-8f13-9025cbdac4a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:45.882442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99835080-cf05-4fb7-8f13-9025cbdac4a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:45.883945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99835080-cf05-4fb7-8f13-9025cbdac4a0 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:45.896265 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1118/2218] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:28:46.390492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438aa5f-96c5-4a8f-9a78-b2f0e5368df6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:46.392206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2438aa5f-96c5-4a8f-9a78-b2f0e5368df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:46.405823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438aa5f-96c5-4a8f-9a78-b2f0e5368df6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:46.412964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd92f8b-9e80-4218-ada0-b83525e366a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:46.413314 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd92f8b-9e80-4218-ada0-b83525e366a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:46.413480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd92f8b-9e80-4218-ada0-b83525e366a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:46.413790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd92f8b-9e80-4218-ada0-b83525e366a8 admin admin] PATH_INFO: `/v3/projects/0f16496aa746472fb8eb10da6c5e0b5e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:46.415346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd92f8b-9e80-4218-ada0-b83525e366a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f16496aa746472fb8eb10da6c5e0b5e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:46.417355 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd92f8b-9e80-4218-ada0-b83525e366a8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:46.490017 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-edd92f8b-9e80-4218-ada0-b83525e366a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f16496aa746472fb8eb10da6c5e0b5e', 'request_id': 'req-edd92f8b-9e80-4218-ada0-b83525e366a8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:46.501719 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-edd92f8b-9e80-4218-ada0-b83525e366a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f16496aa746472fb8eb10da6c5e0b5e', 'request_id': 'req-edd92f8b-9e80-4218-ada0-b83525e366a8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:46.511207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-edd92f8b-9e80-4218-ada0-b83525e366a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f16496aa746472fb8eb10da6c5e0b5e', 'request_id': 'req-edd92f8b-9e80-4218-ada0-b83525e366a8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:46.529564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-edd92f8b-9e80-4218-ada0-b83525e366a8 admin admin] The token cache is being invalidate because project 0f16496aa746472fb8eb10da6c5e0b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:28:46.530063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-edd92f8b-9e80-4218-ada0-b83525e366a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:46.530962 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-edd92f8b-9e80-4218-ada0-b83525e366a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:46.532770 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1101/2219] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:28:46 2022] DELETE /identity/v3/projects/0f16496aa746472fb8eb10da6c5e0b5e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:28:46.537780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99835080-cf05-4fb7-8f13-9025cbdac4a0 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:46.552553 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99835080-cf05-4fb7-8f13-9025cbdac4a0 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:46.636582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6784d4-60a6-46d6-8bca-9e4f13c7a1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:46.638193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6784d4-60a6-46d6-8bca-9e4f13c7a1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:46.638567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6784d4-60a6-46d6-8bca-9e4f13c7a1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:46.638896 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6784d4-60a6-46d6-8bca-9e4f13c7a1eb admin admin] PATH_INFO: `/v3/users/c8f247d163794434a4c4e9bc3e3d11d3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:46.640257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6784d4-60a6-46d6-8bca-9e4f13c7a1eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f247d163794434a4c4e9bc3e3d11d3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:46.642283 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6784d4-60a6-46d6-8bca-9e4f13c7a1eb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:46.694350 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:46.707262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd6784d4-60a6-46d6-8bca-9e4f13c7a1eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f247d163794434a4c4e9bc3e3d11d3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:46.716941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd6784d4-60a6-46d6-8bca-9e4f13c7a1eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f247d163794434a4c4e9bc3e3d11d3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:46.717717 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd6784d4-60a6-46d6-8bca-9e4f13c7a1eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f247d163794434a4c4e9bc3e3d11d3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:46.718369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd6784d4-60a6-46d6-8bca-9e4f13c7a1eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f247d163794434a4c4e9bc3e3d11d3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:46.735469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd6784d4-60a6-46d6-8bca-9e4f13c7a1eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f247d163794434a4c4e9bc3e3d11d3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:46.755252 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1119/2220] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:28:46 2022] DELETE /identity/v3/users/c8f247d163794434a4c4e9bc3e3d11d3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:47.152403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd92f8b-9e80-4218-ada0-b83525e366a8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:47.155109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-edd92f8b-9e80-4218-ada0-b83525e366a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:47.178132 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd92f8b-9e80-4218-ada0-b83525e366a8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:47.281110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd672009-2c10-4e7d-bc2c-387f097c1c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:47.282735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd672009-2c10-4e7d-bc2c-387f097c1c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:47.283226 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd672009-2c10-4e7d-bc2c-387f097c1c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:47.283683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd672009-2c10-4e7d-bc2c-387f097c1c14 admin admin] PATH_INFO: `/v3/projects/1cd059ce21e54185ae1aacdfad7f8dd3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:47.286103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd672009-2c10-4e7d-bc2c-387f097c1c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cd059ce21e54185ae1aacdfad7f8dd3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:47.289814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd672009-2c10-4e7d-bc2c-387f097c1c14 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:47.380167 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd672009-2c10-4e7d-bc2c-387f097c1c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cd059ce21e54185ae1aacdfad7f8dd3', 'request_id': 'req-cd672009-2c10-4e7d-bc2c-387f097c1c14'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:47.391132 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd672009-2c10-4e7d-bc2c-387f097c1c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cd059ce21e54185ae1aacdfad7f8dd3', 'request_id': 'req-cd672009-2c10-4e7d-bc2c-387f097c1c14'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:47.401283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:47.403011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd672009-2c10-4e7d-bc2c-387f097c1c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cd059ce21e54185ae1aacdfad7f8dd3', 'request_id': 'req-cd672009-2c10-4e7d-bc2c-387f097c1c14'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:47.429653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd672009-2c10-4e7d-bc2c-387f097c1c14 admin admin] The token cache is being invalidate because project 1cd059ce21e54185ae1aacdfad7f8dd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:28:47.430271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd672009-2c10-4e7d-bc2c-387f097c1c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:47.431607 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd672009-2c10-4e7d-bc2c-387f097c1c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:47.434190 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1102/2221] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:28:47 2022] DELETE /identity/v3/projects/1cd059ce21e54185ae1aacdfad7f8dd3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:47.439888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6784d4-60a6-46d6-8bca-9e4f13c7a1eb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:47.442888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bd6784d4-60a6-46d6-8bca-9e4f13c7a1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:47.457931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6784d4-60a6-46d6-8bca-9e4f13c7a1eb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:47.528616 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14521564-fd27-4113-8068-7d4804b57227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:47.529538 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14521564-fd27-4113-8068-7d4804b57227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:47.529825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14521564-fd27-4113-8068-7d4804b57227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:47.530128 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14521564-fd27-4113-8068-7d4804b57227 admin admin] PATH_INFO: `/v3/users/0970e9bad33f4c989a858853019e4edc` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:47.531646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14521564-fd27-4113-8068-7d4804b57227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0970e9bad33f4c989a858853019e4edc)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:47.533771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14521564-fd27-4113-8068-7d4804b57227 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:47.590056 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14521564-fd27-4113-8068-7d4804b57227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0970e9bad33f4c989a858853019e4edc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:47.598746 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14521564-fd27-4113-8068-7d4804b57227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0970e9bad33f4c989a858853019e4edc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:47.599630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14521564-fd27-4113-8068-7d4804b57227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0970e9bad33f4c989a858853019e4edc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:47.600343 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14521564-fd27-4113-8068-7d4804b57227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0970e9bad33f4c989a858853019e4edc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:47.614885 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14521564-fd27-4113-8068-7d4804b57227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0970e9bad33f4c989a858853019e4edc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:47.633710 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1120/2222] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:28:47 2022] DELETE /identity/v3/users/0970e9bad33f4c989a858853019e4edc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:48.014443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd672009-2c10-4e7d-bc2c-387f097c1c14 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:48.022537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cd672009-2c10-4e7d-bc2c-387f097c1c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:48.053476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd672009-2c10-4e7d-bc2c-387f097c1c14 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:48.127364 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c39f53-235f-4488-9395-82b9184ed5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:48.128333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c39f53-235f-4488-9395-82b9184ed5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:48.128621 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c39f53-235f-4488-9395-82b9184ed5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:48.132773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c39f53-235f-4488-9395-82b9184ed5f1 admin admin] PATH_INFO: `/v3/projects/6dcc28e35495421eb807c2d253dd76ec` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:48.134383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c39f53-235f-4488-9395-82b9184ed5f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dcc28e35495421eb807c2d253dd76ec)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:48.137832 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c39f53-235f-4488-9395-82b9184ed5f1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:48.211029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-41c39f53-235f-4488-9395-82b9184ed5f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dcc28e35495421eb807c2d253dd76ec', 'request_id': 'req-41c39f53-235f-4488-9395-82b9184ed5f1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:48.220168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-41c39f53-235f-4488-9395-82b9184ed5f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dcc28e35495421eb807c2d253dd76ec', 'request_id': 'req-41c39f53-235f-4488-9395-82b9184ed5f1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:48.228091 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-41c39f53-235f-4488-9395-82b9184ed5f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dcc28e35495421eb807c2d253dd76ec', 'request_id': 'req-41c39f53-235f-4488-9395-82b9184ed5f1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:48.244342 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-41c39f53-235f-4488-9395-82b9184ed5f1 admin admin] The token cache is being invalidate because project 6dcc28e35495421eb807c2d253dd76ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:28:48.244737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-41c39f53-235f-4488-9395-82b9184ed5f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:48.245853 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-41c39f53-235f-4488-9395-82b9184ed5f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:28:48.248811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1103/2223] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:28:48 2022] DELETE /identity/v3/projects/6dcc28e35495421eb807c2d253dd76ec => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:48.258098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcab462-e063-49bd-be4d-eaaddf28f96e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:48.258767 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcab462-e063-49bd-be4d-eaaddf28f96e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:48.259301 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcab462-e063-49bd-be4d-eaaddf28f96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:48.290863 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5fcab462-e063-49bd-be4d-eaaddf28f96e None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:48.292972 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5fcab462-e063-49bd-be4d-eaaddf28f96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:48.339936 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:48.406621 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1121/2224] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:48.410377 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837e579-e76b-439f-a1a7-f6aa6ac042fb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:48.410806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837e579-e76b-439f-a1a7-f6aa6ac042fb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:48.411283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837e579-e76b-439f-a1a7-f6aa6ac042fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:48.442698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4837e579-e76b-439f-a1a7-f6aa6ac042fb None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:48.443988 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4837e579-e76b-439f-a1a7-f6aa6ac042fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:48.452534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1104/2225] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:48.459212 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcab462-e063-49bd-be4d-eaaddf28f96e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:48.471450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcab462-e063-49bd-be4d-eaaddf28f96e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:48.480833 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6ac5f-065c-432b-bdf0-46bca2994588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:48.481952 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6ac5f-065c-432b-bdf0-46bca2994588 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:48.482490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6ac5f-065c-432b-bdf0-46bca2994588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:48.482953 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6ac5f-065c-432b-bdf0-46bca2994588 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:48.484274 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6ac5f-065c-432b-bdf0-46bca2994588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:28:48.484835 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6ac5f-065c-432b-bdf0-46bca2994588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:48.488406 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6ac5f-065c-432b-bdf0-46bca2994588 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:48.504709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1122/2226] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:28:48.511786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837e579-e76b-439f-a1a7-f6aa6ac042fb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:48.524637 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837e579-e76b-439f-a1a7-f6aa6ac042fb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:48.529617 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9475b-6709-4a69-b205-4151c01897f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:48.530369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9475b-6709-4a69-b205-4151c01897f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:48.530651 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9475b-6709-4a69-b205-4151c01897f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:48.530930 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9475b-6709-4a69-b205-4151c01897f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:48.531664 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9475b-6709-4a69-b205-4151c01897f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:48.533673 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9475b-6709-4a69-b205-4151c01897f5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:48.566794 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1105/2227] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:28:48 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:28:48.575597 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6ac5f-065c-432b-bdf0-46bca2994588 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:48.592742 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6ac5f-065c-432b-bdf0-46bca2994588 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:48.678495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f6138-d48f-4cd9-8fa9-51d0f3e649d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:48.679514 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f6138-d48f-4cd9-8fa9-51d0f3e649d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:48.679875 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f6138-d48f-4cd9-8fa9-51d0f3e649d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:48.680284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f6138-d48f-4cd9-8fa9-51d0f3e649d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:48.681328 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f6138-d48f-4cd9-8fa9-51d0f3e649d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:48.683479 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f6138-d48f-4cd9-8fa9-51d0f3e649d7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:48.710651 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1123/2228] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:28:48 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:28:48.714989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9475b-6709-4a69-b205-4151c01897f5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:48.727335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9475b-6709-4a69-b205-4151c01897f5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:48.735530 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd293487-88b2-4d88-b32c-81ed5f489737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:48.736650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd293487-88b2-4d88-b32c-81ed5f489737 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:48.737358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd293487-88b2-4d88-b32c-81ed5f489737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:48.739665 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd293487-88b2-4d88-b32c-81ed5f489737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:48.740614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd293487-88b2-4d88-b32c-81ed5f489737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:48.742549 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd293487-88b2-4d88-b32c-81ed5f489737 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:48.763125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1106/2229] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:28:48.768985 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f6138-d48f-4cd9-8fa9-51d0f3e649d7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:48.781370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f6138-d48f-4cd9-8fa9-51d0f3e649d7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:48.787582 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d40cc0-2ae7-49d3-b7fc-160ae737d69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:48.788397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d40cc0-2ae7-49d3-b7fc-160ae737d69c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:48.788806 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d40cc0-2ae7-49d3-b7fc-160ae737d69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:48.789156 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d40cc0-2ae7-49d3-b7fc-160ae737d69c admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:48.790149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d40cc0-2ae7-49d3-b7fc-160ae737d69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:48.792047 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d40cc0-2ae7-49d3-b7fc-160ae737d69c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:48.806142 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1124/2230] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:28:48.810932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd293487-88b2-4d88-b32c-81ed5f489737 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:48.826368 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd293487-88b2-4d88-b32c-81ed5f489737 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:48.834356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b7d2a-1a98-4b16-8114-fbeb5414e24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:48.836406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b7d2a-1a98-4b16-8114-fbeb5414e24f admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:48.836406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b7d2a-1a98-4b16-8114-fbeb5414e24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:48.836838 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b7d2a-1a98-4b16-8114-fbeb5414e24f admin admin] PATH_INFO: `/v3/projects/09853aa2883f40baa81473f43367673c/users/bedd1142c90d47f4a58586180c03bf7e/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:48.874214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b7d2a-1a98-4b16-8114-fbeb5414e24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=09853aa2883f40baa81473f43367673c, user_id=bedd1142c90d47f4a58586180c03bf7e, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:48.879899 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b7d2a-1a98-4b16-8114-fbeb5414e24f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:48.904648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1107/2231] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:28:48 2022] PUT /identity/v3/projects/09853aa2883f40baa81473f43367673c/users/bedd1142c90d47f4a58586180c03bf7e/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:28:48.913077 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f9048-e3f8-427f-9ec0-7d4047a8bac6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:48.913361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f9048-e3f8-427f-9ec0-7d4047a8bac6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:48.913846 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f9048-e3f8-427f-9ec0-7d4047a8bac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:48.937278 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c77f9048-e3f8-427f-9ec0-7d4047a8bac6 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:48.938940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c77f9048-e3f8-427f-9ec0-7d4047a8bac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:49.021891 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1125/2232] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:49.032701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b7d2a-1a98-4b16-8114-fbeb5414e24f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:49.034830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-964b7d2a-1a98-4b16-8114-fbeb5414e24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:49.058890 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:49.104075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b7d2a-1a98-4b16-8114-fbeb5414e24f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:49.108053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49480ee-b70a-4455-9c5a-66a14fb422f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:49.108745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49480ee-b70a-4455-9c5a-66a14fb422f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:49.109033 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49480ee-b70a-4455-9c5a-66a14fb422f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:49.109311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49480ee-b70a-4455-9c5a-66a14fb422f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:49.121143 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49480ee-b70a-4455-9c5a-66a14fb422f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:49.122703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49480ee-b70a-4455-9c5a-66a14fb422f0 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:49.135465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1108/2233] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:28:51.363403 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497a261-3060-4702-8811-b4d8373e9051 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:51.363978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497a261-3060-4702-8811-b4d8373e9051 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:51.363978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497a261-3060-4702-8811-b4d8373e9051 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:51.365685 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1126/2234] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 27 15:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:28:51.391340 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83446f-7516-4e42-8297-62819ace462f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:51.393663 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83446f-7516-4e42-8297-62819ace462f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:51.394667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83446f-7516-4e42-8297-62819ace462f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:51.472109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2d83446f-7516-4e42-8297-62819ace462f None None] MFA Rules not processed for user `37a36c30e9dc472d97d762d236dd865a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:51.475455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2d83446f-7516-4e42-8297-62819ace462f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:51.625749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1109/2235] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 27 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:51.643160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497a261-3060-4702-8811-b4d8373e9051 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:51.665045 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f497a261-3060-4702-8811-b4d8373e9051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:51.805197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:51.881944 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497a261-3060-4702-8811-b4d8373e9051 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:51.888878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2775588-416a-419a-9eda-caef9b8b7092 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f18acfb35dfe41a1aeb50c702bd1942b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:51.889581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2775588-416a-419a-9eda-caef9b8b7092 service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:51.889891 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2775588-416a-419a-9eda-caef9b8b7092 service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:51.890159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2775588-416a-419a-9eda-caef9b8b7092 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:51.908549 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2775588-416a-419a-9eda-caef9b8b7092 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:51.910506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2775588-416a-419a-9eda-caef9b8b7092 service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:51.924374 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1127/2236] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:28:52.014386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a480bc-6529-4418-9972-da5a456176ba None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:52.014813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a480bc-6529-4418-9972-da5a456176ba None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:52.015265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a480bc-6529-4418-9972-da5a456176ba None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:52.017932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1110/2237] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 27 15:28:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:28:52.024141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640191-c75f-460e-bf07-dbdb7c8710d4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:52.024442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640191-c75f-460e-bf07-dbdb7c8710d4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:52.024725 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640191-c75f-460e-bf07-dbdb7c8710d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:52.046901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-64640191-c75f-460e-bf07-dbdb7c8710d4 None None] MFA Rules not processed for user `67dbb53f47ca406c96377408e9f893f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:52.048185 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-64640191-c75f-460e-bf07-dbdb7c8710d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:52.056495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1128/2238] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 27 15:28:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:28:52.074492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a480bc-6529-4418-9972-da5a456176ba None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:52.076917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-66a480bc-6529-4418-9972-da5a456176ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:52.102068 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a480bc-6529-4418-9972-da5a456176ba None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:52.107172 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cb6ee-35bf-4a32-bf1e-25e698676f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:52.108070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cb6ee-35bf-4a32-bf1e-25e698676f7f service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:52.108496 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cb6ee-35bf-4a32-bf1e-25e698676f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:52.108966 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cb6ee-35bf-4a32-bf1e-25e698676f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:52.119659 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cb6ee-35bf-4a32-bf1e-25e698676f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:52.121180 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cb6ee-35bf-4a32-bf1e-25e698676f7f service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:52.135385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1111/2239] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:28:52.233440 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc63f9-fc7c-4ed5-94c4-f7310a392feb None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:52.233745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc63f9-fc7c-4ed5-94c4-f7310a392feb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:52.234019 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc63f9-fc7c-4ed5-94c4-f7310a392feb None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:52.235599 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1129/2240] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 27 15:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:28:52.243092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4ab63-44bd-4d25-9852-d8141daf7f22 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:52.243391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4ab63-44bd-4d25-9852-d8141daf7f22 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:52.243676 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4ab63-44bd-4d25-9852-d8141daf7f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:52.265998 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a9a4ab63-44bd-4d25-9852-d8141daf7f22 None None] MFA Rules not processed for user `37a36c30e9dc472d97d762d236dd865a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:52.267325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a9a4ab63-44bd-4d25-9852-d8141daf7f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:52.281424 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1112/2241] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 27 15:28:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:52.294361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc63f9-fc7c-4ed5-94c4-f7310a392feb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:52.309649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc63f9-fc7c-4ed5-94c4-f7310a392feb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:52.314458 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a33619-567a-496e-a763-fee78d32d82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:52.315169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a33619-567a-496e-a763-fee78d32d82d service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:52.315940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a33619-567a-496e-a763-fee78d32d82d service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:52.315940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a33619-567a-496e-a763-fee78d32d82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:52.328981 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a33619-567a-496e-a763-fee78d32d82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:52.330670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a33619-567a-496e-a763-fee78d32d82d service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:52.382381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1130/2242] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:28:56.104395 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255db90e-074c-4c5c-bb4b-893c57017d74 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:56.105042 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255db90e-074c-4c5c-bb4b-893c57017d74 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:56.105399 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255db90e-074c-4c5c-bb4b-893c57017d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:56.154071 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-255db90e-074c-4c5c-bb4b-893c57017d74 None None] MFA Rules not processed for user `bedd1142c90d47f4a58586180c03bf7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:28:56.155623 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-255db90e-074c-4c5c-bb4b-893c57017d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:56.253583 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1113/2243] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:28:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:28:56.258703 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a33619-567a-496e-a763-fee78d32d82d service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:56.272531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a33619-567a-496e-a763-fee78d32d82d service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:56.277725 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02502ac-5ad2-4b43-8863-39865e3d465a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:56.278647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02502ac-5ad2-4b43-8863-39865e3d465a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:56.278953 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02502ac-5ad2-4b43-8863-39865e3d465a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:56.279270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02502ac-5ad2-4b43-8863-39865e3d465a admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:56.279943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02502ac-5ad2-4b43-8863-39865e3d465a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:56.282717 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02502ac-5ad2-4b43-8863-39865e3d465a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:56.317762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1131/2244] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:28:56 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:28:56.322259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255db90e-074c-4c5c-bb4b-893c57017d74 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:56.334824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255db90e-074c-4c5c-bb4b-893c57017d74 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:56.340712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:56.418623 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d217b-a44c-4725-98c2-d0102a2c1524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:56.419488 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d217b-a44c-4725-98c2-d0102a2c1524 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:56.420179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d217b-a44c-4725-98c2-d0102a2c1524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:56.420627 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d217b-a44c-4725-98c2-d0102a2c1524 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:56.421683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d217b-a44c-4725-98c2-d0102a2c1524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:56.424459 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d217b-a44c-4725-98c2-d0102a2c1524 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:56.455711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1114/2245] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:28:56 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:28:56.461577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02502ac-5ad2-4b43-8863-39865e3d465a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:56.475755 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02502ac-5ad2-4b43-8863-39865e3d465a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:56.483283 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19782fe4-9b66-472a-b042-9f6f13164957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:56.484238 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19782fe4-9b66-472a-b042-9f6f13164957 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:56.484706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19782fe4-9b66-472a-b042-9f6f13164957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:56.485180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19782fe4-9b66-472a-b042-9f6f13164957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:56.486642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19782fe4-9b66-472a-b042-9f6f13164957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:56.489254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19782fe4-9b66-472a-b042-9f6f13164957 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:56.504489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1132/2246] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:28:56.509786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d217b-a44c-4725-98c2-d0102a2c1524 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:56.525890 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d217b-a44c-4725-98c2-d0102a2c1524 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:56.533064 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dc684-f42d-45ec-b569-5487ba8365f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:56.534123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dc684-f42d-45ec-b569-5487ba8365f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:56.534787 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dc684-f42d-45ec-b569-5487ba8365f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:56.535148 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dc684-f42d-45ec-b569-5487ba8365f0 admin admin] PATH_INFO: `/v3/projects/4550a149eb614444875fb516e4643538/users/164733fa6d6d48cfb0f107db19477a0f/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:56.553766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dc684-f42d-45ec-b569-5487ba8365f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4550a149eb614444875fb516e4643538, user_id=164733fa6d6d48cfb0f107db19477a0f, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:56.556582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dc684-f42d-45ec-b569-5487ba8365f0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:56.575383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1115/2247] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:28:56 2022] PUT /identity/v3/projects/4550a149eb614444875fb516e4643538/users/164733fa6d6d48cfb0f107db19477a0f/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:56.580292 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19782fe4-9b66-472a-b042-9f6f13164957 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:56.598048 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19782fe4-9b66-472a-b042-9f6f13164957 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:56.698363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8b18b-d13a-4449-9e08-d7841a53a471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:56.699467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8b18b-d13a-4449-9e08-d7841a53a471 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:56.700203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8b18b-d13a-4449-9e08-d7841a53a471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:56.700720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8b18b-d13a-4449-9e08-d7841a53a471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:56.702203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8b18b-d13a-4449-9e08-d7841a53a471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:56.704581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8b18b-d13a-4449-9e08-d7841a53a471 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:56.723762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1133/2248] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:28:56.728435 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dc684-f42d-45ec-b569-5487ba8365f0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:56.744084 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dc684-f42d-45ec-b569-5487ba8365f0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:56.749547 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418c297-f4d5-4ec4-b282-08ac5ec642af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:56.750501 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418c297-f4d5-4ec4-b282-08ac5ec642af admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:56.750829 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418c297-f4d5-4ec4-b282-08ac5ec642af admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:56.751104 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418c297-f4d5-4ec4-b282-08ac5ec642af admin admin] PATH_INFO: `/v3/projects/4550a149eb614444875fb516e4643538/users/164733fa6d6d48cfb0f107db19477a0f/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:56.754577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418c297-f4d5-4ec4-b282-08ac5ec642af admin admin] RBAC: Authorizing `identity:create_grant(project_id=4550a149eb614444875fb516e4643538, user_id=164733fa6d6d48cfb0f107db19477a0f, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:56.757514 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418c297-f4d5-4ec4-b282-08ac5ec642af admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:56.774618 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1116/2249] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:28:56 2022] PUT /identity/v3/projects/4550a149eb614444875fb516e4643538/users/164733fa6d6d48cfb0f107db19477a0f/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:28:58.070174 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8b18b-d13a-4449-9e08-d7841a53a471 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:58.072832 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-82f8b18b-d13a-4449-9e08-d7841a53a471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:58.257458 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:58.328457 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8b18b-d13a-4449-9e08-d7841a53a471 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:58.555068 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418c297-f4d5-4ec4-b282-08ac5ec642af admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:28:58.560491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d418c297-f4d5-4ec4-b282-08ac5ec642af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:58.602440 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc9f91-f5a7-4c03-8393-7cfe1d18abc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b471b5b4ede845c7a9dfbf2a90544591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:58.605512 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9f91-f5a7-4c03-8393-7cfe1d18abc8 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:58.605951 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9f91-f5a7-4c03-8393-7cfe1d18abc8 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:58.606937 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9f91-f5a7-4c03-8393-7cfe1d18abc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:58.614930 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-94bc9f91-f5a7-4c03-8393-7cfe1d18abc8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:28:58.665325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc9f91-f5a7-4c03-8393-7cfe1d18abc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:58.669145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc9f91-f5a7-4c03-8393-7cfe1d18abc8 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:58.704714 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1134/2250] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:28:58.821831 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418c297-f4d5-4ec4-b282-08ac5ec642af admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:28:58.844148 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cfeb9-c2d6-453d-8a10-6d13c38a4eeb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b471b5b4ede845c7a9dfbf2a90544591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:28:58.844884 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cfeb9-c2d6-453d-8a10-6d13c38a4eeb service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:28:58.845351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cfeb9-c2d6-453d-8a10-6d13c38a4eeb service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:28:58.845804 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cfeb9-c2d6-453d-8a10-6d13c38a4eeb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:28:58.870781 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cfeb9-c2d6-453d-8a10-6d13c38a4eeb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:28:58.882840 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cfeb9-c2d6-453d-8a10-6d13c38a4eeb service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:28:58.937510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1117/2251] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:28:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:29:02.238830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adf15d-1b51-484c-9856-5357aa7e6955 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:02.239412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adf15d-1b51-484c-9856-5357aa7e6955 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:02.239807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adf15d-1b51-484c-9856-5357aa7e6955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:02.387365 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c9adf15d-1b51-484c-9856-5357aa7e6955 None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:29:02.389869 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c9adf15d-1b51-484c-9856-5357aa7e6955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:29:02.583985 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1135/2252] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 27 15:29:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:29:02.605717 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cfeb9-c2d6-453d-8a10-6d13c38a4eeb service placement] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:29:02.608105 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-737cfeb9-c2d6-453d-8a10-6d13c38a4eeb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:29:02.733985 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:02.820410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cfeb9-c2d6-453d-8a10-6d13c38a4eeb service placement] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:29:02.829489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f9f2b-f76d-44f2-be79-278e94cad1dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:29:02.830582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f9f2b-f76d-44f2-be79-278e94cad1dd service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:02.831135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f9f2b-f76d-44f2-be79-278e94cad1dd service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:02.831576 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f9f2b-f76d-44f2-be79-278e94cad1dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:02.843821 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f9f2b-f76d-44f2-be79-278e94cad1dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:29:02.846089 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f9f2b-f76d-44f2-be79-278e94cad1dd service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:29:02.857991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1118/2253] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:29:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 15:29:06.351660 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaaf9d-2b42-4834-b5c4-862eab516eb7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:06.368374 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaaf9d-2b42-4834-b5c4-862eab516eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:06.369133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaaf9d-2b42-4834-b5c4-862eab516eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:06.439070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c3eaaf9d-2b42-4834-b5c4-862eab516eb7 None None] MFA Rules not processed for user `e93c670c90a643978a0ef04d83ee02d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:29:06.439803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c3eaaf9d-2b42-4834-b5c4-862eab516eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:29:06.619098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:06.641535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ae8cc-1051-4877-ab0e-42c1e746eb48 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:06.645103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ae8cc-1051-4877-ab0e-42c1e746eb48 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:06.646075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ae8cc-1051-4877-ab0e-42c1e746eb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:06.673188 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1136/2254] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:29:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:29:06.774155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b16ae8cc-1051-4877-ab0e-42c1e746eb48 None None] MFA Rules not processed for user `164733fa6d6d48cfb0f107db19477a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:29:06.780249 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b16ae8cc-1051-4877-ab0e-42c1e746eb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:29:07.067447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1119/2255] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:29:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:29:07.086902 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eaaf9d-2b42-4834-b5c4-862eab516eb7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:29:07.173132 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eaaf9d-2b42-4834-b5c4-862eab516eb7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:29:07.178617 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b18f4a-55c3-44d0-bd7a-2d92485be1c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f18acfb35dfe41a1aeb50c702bd1942b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:29:07.179356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b18f4a-55c3-44d0-bd7a-2d92485be1c0 service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:07.179622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b18f4a-55c3-44d0-bd7a-2d92485be1c0 service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:07.179910 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b18f4a-55c3-44d0-bd7a-2d92485be1c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:07.270099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b18f4a-55c3-44d0-bd7a-2d92485be1c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:29:07.272084 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b18f4a-55c3-44d0-bd7a-2d92485be1c0 service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:29:07.294962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1137/2256] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:29:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:29:07.599212 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc5047-4933-4701-bb9d-20e6e732c588 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:07.604134 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc5047-4933-4701-bb9d-20e6e732c588 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:07.604421 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc5047-4933-4701-bb9d-20e6e732c588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:07.645690 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-05dc5047-4933-4701-bb9d-20e6e732c588 None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:29:07.647284 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-05dc5047-4933-4701-bb9d-20e6e732c588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:29:07.662307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1120/2257] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 27 15:29:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:29:07.749364 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b18f4a-55c3-44d0-bd7a-2d92485be1c0 service glance] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:29:07.770265 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b18f4a-55c3-44d0-bd7a-2d92485be1c0 service glance] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:29:07.784093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dae76-d298-4b05-a8c3-e5fc2a100580 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:29:07.785516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dae76-d298-4b05-a8c3-e5fc2a100580 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:07.785915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dae76-d298-4b05-a8c3-e5fc2a100580 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:07.786415 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dae76-d298-4b05-a8c3-e5fc2a100580 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:07.800932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60dae76-d298-4b05-a8c3-e5fc2a100580 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:29:07.803568 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60dae76-d298-4b05-a8c3-e5fc2a100580 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:29:07.818743 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1138/2258] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:29:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:29:17.637202 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=55 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:17.812196 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=56 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:24.352314 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90dbd3-9ea9-4b82-bae9-465d4948e4d9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:24.353877 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90dbd3-9ea9-4b82-bae9-465d4948e4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:24.354382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90dbd3-9ea9-4b82-bae9-465d4948e4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:24.379032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6d90dbd3-9ea9-4b82-bae9-465d4948e4d9 None None] MFA Rules not processed for user `bedd1142c90d47f4a58586180c03bf7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:29:24.380690 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6d90dbd3-9ea9-4b82-bae9-465d4948e4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:29:24.389893 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1121/2259] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:29:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:29:25.548205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2ba8-0acb-48ae-bcd5-6b1573079e02 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:25.550041 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2ba8-0acb-48ae-bcd5-6b1573079e02 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:25.551026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2ba8-0acb-48ae-bcd5-6b1573079e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:25.584420 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-feaa2ba8-0acb-48ae-bcd5-6b1573079e02 None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:29:25.586395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-feaa2ba8-0acb-48ae-bcd5-6b1573079e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:29:25.606299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1139/2260] 10.222.0.33 () {58 vars in 967 bytes} [Mon Jun 27 15:29:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:29:25.619803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90dbd3-9ea9-4b82-bae9-465d4948e4d9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:29:25.655150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90dbd3-9ea9-4b82-bae9-465d4948e4d9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:29:25.660839 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f94b96-54ee-4cb4-b438-6bb9da614419 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:29:25.661634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f94b96-54ee-4cb4-b438-6bb9da614419 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:25.661984 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f94b96-54ee-4cb4-b438-6bb9da614419 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:25.662512 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f94b96-54ee-4cb4-b438-6bb9da614419 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:25.673176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f94b96-54ee-4cb4-b438-6bb9da614419 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:29:25.675519 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f94b96-54ee-4cb4-b438-6bb9da614419 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:29:25.689699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1122/2261] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:29:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:29:30.208312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5387c-b939-4b69-a983-d625b89face2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:30.210389 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5387c-b939-4b69-a983-d625b89face2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:30.211388 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5387c-b939-4b69-a983-d625b89face2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:30.261645 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cff5387c-b939-4b69-a983-d625b89face2 None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:29:30.266719 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cff5387c-b939-4b69-a983-d625b89face2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:29:30.282388 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1140/2262] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 27 15:29:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:29:30.312129 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f94b96-54ee-4cb4-b438-6bb9da614419 service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:29:30.325035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f94b96-54ee-4cb4-b438-6bb9da614419 service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:29:30.333462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b0b98-cc38-47f6-be17-7efdf17f86f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:29:30.334504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b0b98-cc38-47f6-be17-7efdf17f86f0 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:30.334956 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b0b98-cc38-47f6-be17-7efdf17f86f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:30.335644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b0b98-cc38-47f6-be17-7efdf17f86f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:30.352786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b0b98-cc38-47f6-be17-7efdf17f86f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:29:30.355015 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b0b98-cc38-47f6-be17-7efdf17f86f0 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:29:30.370013 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1123/2263] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:29:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:29:40.246866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:40.363496 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=15 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:43.974125 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc1992-37b8-4d1d-a569-80f058466029 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:43.975052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc1992-37b8-4d1d-a569-80f058466029 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:43.975052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc1992-37b8-4d1d-a569-80f058466029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:43.998412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b3dc1992-37b8-4d1d-a569-80f058466029 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:29:44.000060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b3dc1992-37b8-4d1d-a569-80f058466029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:29:44.085347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1141/2264] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Jun 27 15:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:29:44.112704 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b0b98-cc38-47f6-be17-7efdf17f86f0 service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:29:44.114560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-db8b0b98-cc38-47f6-be17-7efdf17f86f0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:29:44.234993 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b0b98-cc38-47f6-be17-7efdf17f86f0 service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:29:44.245833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cb844-7d1d-453e-bed4-5dc8b01026e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:29:44.247269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cb844-7d1d-453e-bed4-5dc8b01026e3 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:44.247758 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cb844-7d1d-453e-bed4-5dc8b01026e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:44.248244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cb844-7d1d-453e-bed4-5dc8b01026e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:44.270279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cb844-7d1d-453e-bed4-5dc8b01026e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:29:44.273479 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cb844-7d1d-453e-bed4-5dc8b01026e3 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:29:44.295038 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1124/2265] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:29:44.503600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab440a9-13d7-4ba5-9c0b-ac4212d88dce None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:44.503893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab440a9-13d7-4ba5-9c0b-ac4212d88dce None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:44.504316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab440a9-13d7-4ba5-9c0b-ac4212d88dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:44.529015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9ab440a9-13d7-4ba5-9c0b-ac4212d88dce None None] MFA Rules not processed for user `69c9809662bc441f8e95bfe2e4d069f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:29:44.531544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9ab440a9-13d7-4ba5-9c0b-ac4212d88dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:29:44.624814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1142/2266] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:29:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:29:47.375526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d49b1e-7413-4618-8b9c-9117ce1bd82b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:47.376190 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d49b1e-7413-4618-8b9c-9117ce1bd82b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:47.376329 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d49b1e-7413-4618-8b9c-9117ce1bd82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:47.406255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-53d49b1e-7413-4618-8b9c-9117ce1bd82b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:29:47.406590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-53d49b1e-7413-4618-8b9c-9117ce1bd82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:29:47.426476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1125/2267] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Jun 27 15:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:29:47.453279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab440a9-13d7-4ba5-9c0b-ac4212d88dce None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:29:47.468888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab440a9-13d7-4ba5-9c0b-ac4212d88dce None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:29:47.478603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe7ddd-9c0d-433a-9a34-1c7c08177977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:29:47.479728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe7ddd-9c0d-433a-9a34-1c7c08177977 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:47.480217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe7ddd-9c0d-433a-9a34-1c7c08177977 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:47.480728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe7ddd-9c0d-433a-9a34-1c7c08177977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:47.496902 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe7ddd-9c0d-433a-9a34-1c7c08177977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:29:47.498933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe7ddd-9c0d-433a-9a34-1c7c08177977 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:29:47.521356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1143/2268] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:29:51.574290 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c508e39-963d-4f43-8ba5-e3d8d835881c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:51.574768 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c508e39-963d-4f43-8ba5-e3d8d835881c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:51.574863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c508e39-963d-4f43-8ba5-e3d8d835881c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:51.606722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2c508e39-963d-4f43-8ba5-e3d8d835881c None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:29:51.608116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2c508e39-963d-4f43-8ba5-e3d8d835881c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:29:51.618468 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1126/2269] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Jun 27 15:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:29:51.658320 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe7ddd-9c0d-433a-9a34-1c7c08177977 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:29:51.683666 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe7ddd-9c0d-433a-9a34-1c7c08177977 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:29:51.692978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fa9f6-edcf-4096-833a-980cea4c0b8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:29:51.693869 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fa9f6-edcf-4096-833a-980cea4c0b8c service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:51.694410 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fa9f6-edcf-4096-833a-980cea4c0b8c service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:51.694903 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fa9f6-edcf-4096-833a-980cea4c0b8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:51.708726 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fa9f6-edcf-4096-833a-980cea4c0b8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:29:51.711208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fa9f6-edcf-4096-833a-980cea4c0b8c service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:29:51.722618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1144/2270] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:29:53.731089 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c508e39-963d-4f43-8ba5-e3d8d835881c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:29:53.832913 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c508e39-963d-4f43-8ba5-e3d8d835881c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:29:53.837959 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3599dc5-60cd-4162-8c3c-c500885ad60a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:29:53.838699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3599dc5-60cd-4162-8c3c-c500885ad60a service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:53.838988 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3599dc5-60cd-4162-8c3c-c500885ad60a service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:53.839299 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3599dc5-60cd-4162-8c3c-c500885ad60a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:53.854938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3599dc5-60cd-4162-8c3c-c500885ad60a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:29:53.856680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3599dc5-60cd-4162-8c3c-c500885ad60a service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:29:53.868462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1127/2271] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:29:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:29:55.845268 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d5315-299b-4184-b48b-91f6375a0295 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:55.846972 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d5315-299b-4184-b48b-91f6375a0295 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:55.847474 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d5315-299b-4184-b48b-91f6375a0295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:55.882652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d28d5315-299b-4184-b48b-91f6375a0295 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:29:55.884558 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d28d5315-299b-4184-b48b-91f6375a0295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:29:55.894115 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1145/2272] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Jun 27 15:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:29:55.932052 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3599dc5-60cd-4162-8c3c-c500885ad60a service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:29:55.934671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d3599dc5-60cd-4162-8c3c-c500885ad60a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:29:55.956557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3599dc5-60cd-4162-8c3c-c500885ad60a service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:29:55.966538 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a073b03-cee7-4221-864c-6b4e19bf8e0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:29:55.967907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a073b03-cee7-4221-864c-6b4e19bf8e0e service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:29:55.968532 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a073b03-cee7-4221-864c-6b4e19bf8e0e service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:29:55.978662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a073b03-cee7-4221-864c-6b4e19bf8e0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:29:55.991491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a073b03-cee7-4221-864c-6b4e19bf8e0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:29:55.993549 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a073b03-cee7-4221-864c-6b4e19bf8e0e service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:29:56.006552 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1128/2273] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:30:00.225322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325822c-b88b-4f20-ac83-01a91c663d01 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:00.226329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325822c-b88b-4f20-ac83-01a91c663d01 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:00.226795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325822c-b88b-4f20-ac83-01a91c663d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:00.261346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3325822c-b88b-4f20-ac83-01a91c663d01 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:30:00.263175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3325822c-b88b-4f20-ac83-01a91c663d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:00.272749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1146/2274] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Jun 27 15:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:30:00.402378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a073b03-cee7-4221-864c-6b4e19bf8e0e service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:00.422167 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a073b03-cee7-4221-864c-6b4e19bf8e0e service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:00.434651 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b13b27-7489-4433-ad9d-333e53cdb20f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:00.435841 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b13b27-7489-4433-ad9d-333e53cdb20f service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:00.436588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b13b27-7489-4433-ad9d-333e53cdb20f service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:00.437091 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b13b27-7489-4433-ad9d-333e53cdb20f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:00.459328 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b13b27-7489-4433-ad9d-333e53cdb20f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:00.462392 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b13b27-7489-4433-ad9d-333e53cdb20f service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:00.477429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1129/2275] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:30:07.436510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05a5d8-633c-47f5-88c1-848f7d8456e0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:07.437106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05a5d8-633c-47f5-88c1-848f7d8456e0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:07.437106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05a5d8-633c-47f5-88c1-848f7d8456e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:07.465526 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3a05a5d8-633c-47f5-88c1-848f7d8456e0 None None] MFA Rules not processed for user `c5ebe5c2142f49ab8f2455bf1ae952d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:30:07.467736 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3a05a5d8-633c-47f5-88c1-848f7d8456e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:07.541013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1147/2276] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:30:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:30:10.468982 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=78 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:17.533197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:23.077372 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7554f8-6bae-4c25-b11d-a14ee62840ab None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:23.078618 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7554f8-6bae-4c25-b11d-a14ee62840ab None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:23.079147 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7554f8-6bae-4c25-b11d-a14ee62840ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:23.099536 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-da7554f8-6bae-4c25-b11d-a14ee62840ab None None] MFA Rules not processed for user `202e415e386e4abe8c70a9889448eb02`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:30:23.100832 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-da7554f8-6bae-4c25-b11d-a14ee62840ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:23.171668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1130/2277] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:30:33.164294 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=25 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:37.957752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf2614-4489-453e-9e9b-9d08ddc17b77 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:37.958368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf2614-4489-453e-9e9b-9d08ddc17b77 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:37.958368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf2614-4489-453e-9e9b-9d08ddc17b77 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:37.959809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1148/2278] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 27 15:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:30:38.000170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464892e-0c8b-4c68-af5b-d0976aa2427c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:38.001038 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464892e-0c8b-4c68-af5b-d0976aa2427c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:38.001490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464892e-0c8b-4c68-af5b-d0976aa2427c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:38.053175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf2614-4489-453e-9e9b-9d08ddc17b77 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:38.055297 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-31bf2614-4489-453e-9e9b-9d08ddc17b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:38.092417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf2614-4489-453e-9e9b-9d08ddc17b77 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:38.099906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079ae28-e66a-49d1-b311-f63e6f4c85f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:38.101459 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079ae28-e66a-49d1-b311-f63e6f4c85f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:38.101741 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079ae28-e66a-49d1-b311-f63e6f4c85f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:38.102014 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079ae28-e66a-49d1-b311-f63e6f4c85f6 admin admin] PATH_INFO: `/v3/users/e93c670c90a643978a0ef04d83ee02d3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:38.103436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079ae28-e66a-49d1-b311-f63e6f4c85f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e93c670c90a643978a0ef04d83ee02d3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:38.109734 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8464892e-0c8b-4c68-af5b-d0976aa2427c None None] MFA Rules not processed for user `b471b5b4ede845c7a9dfbf2a90544591`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:30:38.110299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079ae28-e66a-49d1-b311-f63e6f4c85f6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:38.111688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8464892e-0c8b-4c68-af5b-d0976aa2427c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:38.133325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1131/2279] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 27 15:30:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:30:38.155805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464892e-0c8b-4c68-af5b-d0976aa2427c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:38.172698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464892e-0c8b-4c68-af5b-d0976aa2427c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:38.179784 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b62731-66db-4e09-8bdf-df188174334b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b471b5b4ede845c7a9dfbf2a90544591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:38.180617 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62731-66db-4e09-8bdf-df188174334b service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:38.181396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62731-66db-4e09-8bdf-df188174334b service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:38.181840 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62731-66db-4e09-8bdf-df188174334b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:38.195469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b62731-66db-4e09-8bdf-df188174334b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:38.197507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b62731-66db-4e09-8bdf-df188174334b service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:38.210703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1132/2280] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:30:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:30:38.215098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5079ae28-e66a-49d1-b311-f63e6f4c85f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e93c670c90a643978a0ef04d83ee02d3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:38.228340 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5079ae28-e66a-49d1-b311-f63e6f4c85f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e93c670c90a643978a0ef04d83ee02d3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:38.229208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5079ae28-e66a-49d1-b311-f63e6f4c85f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e93c670c90a643978a0ef04d83ee02d3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:38.230155 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5079ae28-e66a-49d1-b311-f63e6f4c85f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e93c670c90a643978a0ef04d83ee02d3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:38.254326 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5079ae28-e66a-49d1-b311-f63e6f4c85f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e93c670c90a643978a0ef04d83ee02d3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:38.273513 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1149/2281] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:30:38 2022] DELETE /identity/v3/users/e93c670c90a643978a0ef04d83ee02d3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:30:38.464633 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b62731-66db-4e09-8bdf-df188174334b service placement] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:38.475787 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b62731-66db-4e09-8bdf-df188174334b service placement] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:38.539317 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31900f1d-17f2-49fc-9a5d-98b332cafc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:38.540199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31900f1d-17f2-49fc-9a5d-98b332cafc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:38.540481 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31900f1d-17f2-49fc-9a5d-98b332cafc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:38.540756 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31900f1d-17f2-49fc-9a5d-98b332cafc45 admin admin] PATH_INFO: `/v3/projects/204b02b5afb24710b7cc8725993c98cd` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:38.541943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31900f1d-17f2-49fc-9a5d-98b332cafc45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=204b02b5afb24710b7cc8725993c98cd)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:38.544268 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31900f1d-17f2-49fc-9a5d-98b332cafc45 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:38.598119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-31900f1d-17f2-49fc-9a5d-98b332cafc45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '204b02b5afb24710b7cc8725993c98cd', 'request_id': 'req-31900f1d-17f2-49fc-9a5d-98b332cafc45'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:38.613087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-31900f1d-17f2-49fc-9a5d-98b332cafc45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '204b02b5afb24710b7cc8725993c98cd', 'request_id': 'req-31900f1d-17f2-49fc-9a5d-98b332cafc45'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:38.627952 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-31900f1d-17f2-49fc-9a5d-98b332cafc45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '204b02b5afb24710b7cc8725993c98cd', 'request_id': 'req-31900f1d-17f2-49fc-9a5d-98b332cafc45'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:38.645437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-31900f1d-17f2-49fc-9a5d-98b332cafc45 admin admin] The token cache is being invalidate because project 204b02b5afb24710b7cc8725993c98cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:30:38.645878 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-31900f1d-17f2-49fc-9a5d-98b332cafc45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:38.646743 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-31900f1d-17f2-49fc-9a5d-98b332cafc45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:38.648879 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1133/2282] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:30:38 2022] DELETE /identity/v3/projects/204b02b5afb24710b7cc8725993c98cd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:30:38.654474 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f0898-8178-4b4b-9457-db2b9f7a8639 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:38.654720 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f0898-8178-4b4b-9457-db2b9f7a8639 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:38.655031 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f0898-8178-4b4b-9457-db2b9f7a8639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:38.675788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9e2f0898-8178-4b4b-9457-db2b9f7a8639 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:30:38.677083 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9e2f0898-8178-4b4b-9457-db2b9f7a8639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:38.749722 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1150/2283] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:30:38.757749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfc16b-6c18-40a5-bc1c-bc7da552c841 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:38.758090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfc16b-6c18-40a5-bc1c-bc7da552c841 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:38.758339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfc16b-6c18-40a5-bc1c-bc7da552c841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:38.778987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5bbfc16b-6c18-40a5-bc1c-bc7da552c841 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:30:38.780238 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5bbfc16b-6c18-40a5-bc1c-bc7da552c841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:38.788944 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1134/2284] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:30:38.794151 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f0898-8178-4b4b-9457-db2b9f7a8639 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:38.803878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f0898-8178-4b4b-9457-db2b9f7a8639 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:38.809270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb1006-1a2e-48c5-916b-ddeb65a8f328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:38.809948 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb1006-1a2e-48c5-916b-ddeb65a8f328 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:38.810253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb1006-1a2e-48c5-916b-ddeb65a8f328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:38.810591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb1006-1a2e-48c5-916b-ddeb65a8f328 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:38.811344 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb1006-1a2e-48c5-916b-ddeb65a8f328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:30:38.811711 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb1006-1a2e-48c5-916b-ddeb65a8f328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:38.813356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb1006-1a2e-48c5-916b-ddeb65a8f328 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:38.827062 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1151/2285] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:30:38.831501 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfc16b-6c18-40a5-bc1c-bc7da552c841 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:38.841400 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfc16b-6c18-40a5-bc1c-bc7da552c841 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:38.847283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db915fa4-fb44-4718-aa2e-a9c96f966529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:38.848066 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db915fa4-fb44-4718-aa2e-a9c96f966529 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:38.848517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db915fa4-fb44-4718-aa2e-a9c96f966529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:38.848780 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db915fa4-fb44-4718-aa2e-a9c96f966529 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:38.849572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db915fa4-fb44-4718-aa2e-a9c96f966529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:38.851690 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db915fa4-fb44-4718-aa2e-a9c96f966529 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:38.889091 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1135/2286] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:30:38 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:30:38.893561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb1006-1a2e-48c5-916b-ddeb65a8f328 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:38.904135 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb1006-1a2e-48c5-916b-ddeb65a8f328 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:38.970653 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcd82d-0790-4313-a645-a33da3dca5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:38.971442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcd82d-0790-4313-a645-a33da3dca5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:38.971702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcd82d-0790-4313-a645-a33da3dca5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:38.971888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcd82d-0790-4313-a645-a33da3dca5b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:38.972726 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcd82d-0790-4313-a645-a33da3dca5b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:38.974959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcd82d-0790-4313-a645-a33da3dca5b1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:38.982072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:38.998286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1152/2287] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:30:38 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:30:39.002250 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db915fa4-fb44-4718-aa2e-a9c96f966529 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:39.013414 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db915fa4-fb44-4718-aa2e-a9c96f966529 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:39.019149 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d49f0e-9822-4510-8791-fc59e3913758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:39.019822 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d49f0e-9822-4510-8791-fc59e3913758 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:39.020110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d49f0e-9822-4510-8791-fc59e3913758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:39.020425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d49f0e-9822-4510-8791-fc59e3913758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:39.021146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d49f0e-9822-4510-8791-fc59e3913758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:39.022818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d49f0e-9822-4510-8791-fc59e3913758 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:39.033976 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1136/2288] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:30:39.038564 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcd82d-0790-4313-a645-a33da3dca5b1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:39.050042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcd82d-0790-4313-a645-a33da3dca5b1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:39.056368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa92568-d2ad-499c-92bb-1527cccef472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:39.057265 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa92568-d2ad-499c-92bb-1527cccef472 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:39.057598 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa92568-d2ad-499c-92bb-1527cccef472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:39.057992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa92568-d2ad-499c-92bb-1527cccef472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:39.059139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa92568-d2ad-499c-92bb-1527cccef472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:39.061538 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa92568-d2ad-499c-92bb-1527cccef472 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:39.074723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1153/2289] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:30:39.079279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d49f0e-9822-4510-8791-fc59e3913758 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:39.090785 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d49f0e-9822-4510-8791-fc59e3913758 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:39.097817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb8ace-c206-4b62-b120-4a760427c577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:39.099287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8ace-c206-4b62-b120-4a760427c577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:39.099585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8ace-c206-4b62-b120-4a760427c577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:39.099947 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8ace-c206-4b62-b120-4a760427c577 admin admin] PATH_INFO: `/v3/projects/7b0b7b7805a240c59b73c4a2200cf698/users/091832ba389d4bc19fa621f1856bf587/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:39.118803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb8ace-c206-4b62-b120-4a760427c577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0b7b7805a240c59b73c4a2200cf698, user_id=091832ba389d4bc19fa621f1856bf587, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:39.121938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb8ace-c206-4b62-b120-4a760427c577 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:39.124316 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:39.138980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1137/2290] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:30:39 2022] PUT /identity/v3/projects/7b0b7b7805a240c59b73c4a2200cf698/users/091832ba389d4bc19fa621f1856bf587/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:30:39.149645 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc19639-d98b-4ec4-a800-1f9ec3de40a0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:39.149947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc19639-d98b-4ec4-a800-1f9ec3de40a0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:39.150273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc19639-d98b-4ec4-a800-1f9ec3de40a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:39.179397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6dc19639-d98b-4ec4-a800-1f9ec3de40a0 None None] MFA Rules not processed for user `091832ba389d4bc19fa621f1856bf587`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:30:39.180567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6dc19639-d98b-4ec4-a800-1f9ec3de40a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:39.250259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1154/2291] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:30:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:30:39.261444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb8ace-c206-4b62-b120-4a760427c577 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:39.263306 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9ccb8ace-c206-4b62-b120-4a760427c577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:39.325844 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb8ace-c206-4b62-b120-4a760427c577 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:39.330170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a179ad-eb0a-4e21-9a95-e879d02329fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:39.330865 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a179ad-eb0a-4e21-9a95-e879d02329fa service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:39.331178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a179ad-eb0a-4e21-9a95-e879d02329fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:39.331456 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a179ad-eb0a-4e21-9a95-e879d02329fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:39.340895 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a179ad-eb0a-4e21-9a95-e879d02329fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:39.342417 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a179ad-eb0a-4e21-9a95-e879d02329fa service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:39.351858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1138/2292] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:30:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:30:41.936346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929e41a-47a2-48bb-85a8-cb9f60986849 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:41.937032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929e41a-47a2-48bb-85a8-cb9f60986849 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:41.937032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929e41a-47a2-48bb-85a8-cb9f60986849 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:41.938556 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1155/2293] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 27 15:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 15:30:41.944873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ab5c2-075b-471c-a80b-07586647a162 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:41.945554 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ab5c2-075b-471c-a80b-07586647a162 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:41.945992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ab5c2-075b-471c-a80b-07586647a162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:41.971746 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ed4ab5c2-075b-471c-a80b-07586647a162 None None] MFA Rules not processed for user `67dbb53f47ca406c96377408e9f893f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:30:41.973106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ed4ab5c2-075b-471c-a80b-07586647a162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:42.064511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1139/2294] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 27 15:30:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:30:42.087051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929e41a-47a2-48bb-85a8-cb9f60986849 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:42.090042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0929e41a-47a2-48bb-85a8-cb9f60986849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:42.106718 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929e41a-47a2-48bb-85a8-cb9f60986849 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:42.115984 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95332e4-f2a9-417c-9a2c-a951fd89e1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:42.117162 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95332e4-f2a9-417c-9a2c-a951fd89e1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:42.117521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95332e4-f2a9-417c-9a2c-a951fd89e1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:42.117864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95332e4-f2a9-417c-9a2c-a951fd89e1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:42.136352 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95332e4-f2a9-417c-9a2c-a951fd89e1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:42.138883 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95332e4-f2a9-417c-9a2c-a951fd89e1d0 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:42.153398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1156/2295] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:30:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:30:42.293410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920f187-9d4c-4e79-9a1f-d36ee1b9f97d None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:42.293927 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920f187-9d4c-4e79-9a1f-d36ee1b9f97d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:42.294436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920f187-9d4c-4e79-9a1f-d36ee1b9f97d None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:42.296203 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1140/2296] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 27 15:30:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:30:42.305026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4008a-be2a-4dc8-a5e9-4689dd77eb42 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:42.305453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4008a-be2a-4dc8-a5e9-4689dd77eb42 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:42.305740 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4008a-be2a-4dc8-a5e9-4689dd77eb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:42.326904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-72a4008a-be2a-4dc8-a5e9-4689dd77eb42 None None] MFA Rules not processed for user `37a36c30e9dc472d97d762d236dd865a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:30:42.328155 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-72a4008a-be2a-4dc8-a5e9-4689dd77eb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:42.411243 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1157/2297] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 27 15:30:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:30:42.426512 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920f187-9d4c-4e79-9a1f-d36ee1b9f97d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:42.442012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920f187-9d4c-4e79-9a1f-d36ee1b9f97d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:42.451003 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a2fad-c250-4879-8788-6f9e1f4d8e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:42.451893 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2fad-c250-4879-8788-6f9e1f4d8e2b service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:42.452332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2fad-c250-4879-8788-6f9e1f4d8e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:42.453312 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2fad-c250-4879-8788-6f9e1f4d8e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:42.466797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a2fad-c250-4879-8788-6f9e1f4d8e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:42.468473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a2fad-c250-4879-8788-6f9e1f4d8e2b service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:42.485336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1141/2298] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:30:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:30:49.871107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4008a-be2a-4dc8-a5e9-4689dd77eb42 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:49.922578 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:49.939271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4008a-be2a-4dc8-a5e9-4689dd77eb42 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:49.944169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f654f41-b54b-422a-9404-6b6adfb3ea40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:49.945078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f654f41-b54b-422a-9404-6b6adfb3ea40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:49.945357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f654f41-b54b-422a-9404-6b6adfb3ea40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:49.945652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f654f41-b54b-422a-9404-6b6adfb3ea40 admin admin] PATH_INFO: `/v3/users/091832ba389d4bc19fa621f1856bf587` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:49.946902 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f654f41-b54b-422a-9404-6b6adfb3ea40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=091832ba389d4bc19fa621f1856bf587)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:49.949440 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f654f41-b54b-422a-9404-6b6adfb3ea40 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:50.002743 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7f654f41-b54b-422a-9404-6b6adfb3ea40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091832ba389d4bc19fa621f1856bf587'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:50.011666 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7f654f41-b54b-422a-9404-6b6adfb3ea40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091832ba389d4bc19fa621f1856bf587'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:50.012394 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7f654f41-b54b-422a-9404-6b6adfb3ea40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091832ba389d4bc19fa621f1856bf587'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:50.013002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7f654f41-b54b-422a-9404-6b6adfb3ea40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091832ba389d4bc19fa621f1856bf587'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:50.026406 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7f654f41-b54b-422a-9404-6b6adfb3ea40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091832ba389d4bc19fa621f1856bf587'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:50.043254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1158/2299] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:30:49 2022] DELETE /identity/v3/users/091832ba389d4bc19fa621f1856bf587 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:30:50.048032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb767-5b94-4565-b017-02331bb5c221 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:50.048531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb767-5b94-4565-b017-02331bb5c221 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:50.048531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb767-5b94-4565-b017-02331bb5c221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:50.075034 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1aacb767-5b94-4565-b017-02331bb5c221 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:30:50.076285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1aacb767-5b94-4565-b017-02331bb5c221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:50.144115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1142/2300] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:30:50.154154 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f654f41-b54b-422a-9404-6b6adfb3ea40 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:50.155632 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7f654f41-b54b-422a-9404-6b6adfb3ea40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:50.229099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f654f41-b54b-422a-9404-6b6adfb3ea40 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:50.233907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ad0b7-9815-4fab-bf1c-9da2da44fcad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:50.234636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ad0b7-9815-4fab-bf1c-9da2da44fcad service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:50.234924 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ad0b7-9815-4fab-bf1c-9da2da44fcad service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:50.235203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ad0b7-9815-4fab-bf1c-9da2da44fcad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:50.245769 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ad0b7-9815-4fab-bf1c-9da2da44fcad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:50.247339 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ad0b7-9815-4fab-bf1c-9da2da44fcad service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:50.262988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1159/2301] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:30:50.635332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacb767-5b94-4565-b017-02331bb5c221 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:50.640577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1aacb767-5b94-4565-b017-02331bb5c221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:50.672582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacb767-5b94-4565-b017-02331bb5c221 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:50.701348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:50.702389 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:50.702562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:50.702843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04 admin admin] PATH_INFO: `/v3/projects/7b0b7b7805a240c59b73c4a2200cf698` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:50.704161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0b7b7805a240c59b73c4a2200cf698)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:50.706378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:50.750018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:50.780338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0b7b7805a240c59b73c4a2200cf698', 'request_id': 'req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:50.788994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0b7b7805a240c59b73c4a2200cf698', 'request_id': 'req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:50.795385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0b7b7805a240c59b73c4a2200cf698', 'request_id': 'req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:50.806780 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04 admin admin] The token cache is being invalidate because project 7b0b7b7805a240c59b73c4a2200cf698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:30:50.807096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:50.807758 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:30:50.809361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1143/2302] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:30:50 2022] DELETE /identity/v3/projects/7b0b7b7805a240c59b73c4a2200cf698 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:30:51.657688 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ad0b7-9815-4fab-bf1c-9da2da44fcad service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:51.659345 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a76ad0b7-9815-4fab-bf1c-9da2da44fcad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:51.676712 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ad0b7-9815-4fab-bf1c-9da2da44fcad service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:51.741807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98fa2f-9910-40e7-8349-7c2912035279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:51.743398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98fa2f-9910-40e7-8349-7c2912035279 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:51.745628 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98fa2f-9910-40e7-8349-7c2912035279 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:51.745628 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98fa2f-9910-40e7-8349-7c2912035279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:51.746455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1f98fa2f-9910-40e7-8349-7c2912035279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:51.769318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:51.829481 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98fa2f-9910-40e7-8349-7c2912035279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:51.831293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98fa2f-9910-40e7-8349-7c2912035279 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:51.846108 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1160/2303] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:30:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:30:53.106647 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:53.108507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:53.128522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5297aa-be4e-4a05-bf6f-b064b6c74f04 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:53.133444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb698b-d7f3-4f44-9ccd-263e82d03f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:53.134653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb698b-d7f3-4f44-9ccd-263e82d03f79 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:53.135126 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb698b-d7f3-4f44-9ccd-263e82d03f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:53.135440 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb698b-d7f3-4f44-9ccd-263e82d03f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:53.138360 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-becb698b-d7f3-4f44-9ccd-263e82d03f79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:53.154668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb698b-d7f3-4f44-9ccd-263e82d03f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:53.156138 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb698b-d7f3-4f44-9ccd-263e82d03f79 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:53.168671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1144/2304] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:30:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:30:56.657587 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67819729-14af-4dc2-9f95-6dac32616292 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:56.658152 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67819729-14af-4dc2-9f95-6dac32616292 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:56.658152 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67819729-14af-4dc2-9f95-6dac32616292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:56.678510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-67819729-14af-4dc2-9f95-6dac32616292 None None] MFA Rules not processed for user `38077d8c653b4752814a0c200eb2a713`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:30:56.679774 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-67819729-14af-4dc2-9f95-6dac32616292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:56.746660 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1161/2305] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:30:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:30:56.971016 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb698b-d7f3-4f44-9ccd-263e82d03f79 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:30:56.972461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-becb698b-d7f3-4f44-9ccd-263e82d03f79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:56.986549 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb698b-d7f3-4f44-9ccd-263e82d03f79 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:30:56.992242 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c031424-ca05-4c5c-83bb-eb0a400b7865 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:30:56.992900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c031424-ca05-4c5c-83bb-eb0a400b7865 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:30:56.993187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c031424-ca05-4c5c-83bb-eb0a400b7865 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:30:56.993468 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c031424-ca05-4c5c-83bb-eb0a400b7865 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:30:56.995330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3c031424-ca05-4c5c-83bb-eb0a400b7865 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:30:57.061940 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c031424-ca05-4c5c-83bb-eb0a400b7865 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:30:57.063897 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c031424-ca05-4c5c-83bb-eb0a400b7865 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:30:57.075133 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1145/2306] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:30:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:31:05.108771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19769723-ba89-4224-8087-c563b534cf92 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:05.109345 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19769723-ba89-4224-8087-c563b534cf92 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:05.109444 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19769723-ba89-4224-8087-c563b534cf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:05.128227 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-19769723-ba89-4224-8087-c563b534cf92 None None] MFA Rules not processed for user `69c9809662bc441f8e95bfe2e4d069f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:05.129466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-19769723-ba89-4224-8087-c563b534cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:05.137949 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1162/2307] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:31:07.070671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=48,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:10.639469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c031424-ca05-4c5c-83bb-eb0a400b7865 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:10.641120 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3c031424-ca05-4c5c-83bb-eb0a400b7865 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:10.657887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c031424-ca05-4c5c-83bb-eb0a400b7865 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:10.665688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de30b2c-7d14-4612-a4d4-25343828d56c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:10.666424 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de30b2c-7d14-4612-a4d4-25343828d56c service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:10.666718 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de30b2c-7d14-4612-a4d4-25343828d56c service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:10.667008 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de30b2c-7d14-4612-a4d4-25343828d56c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:10.670181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3de30b2c-7d14-4612-a4d4-25343828d56c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:10.737502 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de30b2c-7d14-4612-a4d4-25343828d56c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:10.739167 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de30b2c-7d14-4612-a4d4-25343828d56c service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:10.748956 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1146/2308] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:31:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:31:15.122155 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=51 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:20.744351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=28 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:21.775029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19769723-ba89-4224-8087-c563b534cf92 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:21.789569 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19769723-ba89-4224-8087-c563b534cf92 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:21.797232 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4597941-07a4-487a-83e1-c76bcf77e3e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:21.798203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4597941-07a4-487a-83e1-c76bcf77e3e9 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:21.798645 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4597941-07a4-487a-83e1-c76bcf77e3e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:21.798934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4597941-07a4-487a-83e1-c76bcf77e3e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:21.801636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e4597941-07a4-487a-83e1-c76bcf77e3e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:21.889047 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4597941-07a4-487a-83e1-c76bcf77e3e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:21.890704 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4597941-07a4-487a-83e1-c76bcf77e3e9 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:21.901897 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1163/2309] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:31:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:31:24.112899 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de30b2c-7d14-4612-a4d4-25343828d56c service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:24.127339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de30b2c-7d14-4612-a4d4-25343828d56c service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:24.131903 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671db0f6-0567-4a12-ad00-040c44b92de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:24.132550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671db0f6-0567-4a12-ad00-040c44b92de0 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:24.132848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671db0f6-0567-4a12-ad00-040c44b92de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:24.133124 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671db0f6-0567-4a12-ad00-040c44b92de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:24.135135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-671db0f6-0567-4a12-ad00-040c44b92de0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:24.145745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671db0f6-0567-4a12-ad00-040c44b92de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:24.147273 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671db0f6-0567-4a12-ad00-040c44b92de0 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:24.156165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1147/2310] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:31:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:31:25.756684 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4597941-07a4-487a-83e1-c76bcf77e3e9 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:25.767899 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4597941-07a4-487a-83e1-c76bcf77e3e9 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:25.771617 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ba9b4-880b-43c5-a8b7-a1447be008cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:25.772282 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ba9b4-880b-43c5-a8b7-a1447be008cd service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:25.772556 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ba9b4-880b-43c5-a8b7-a1447be008cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:25.772855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ba9b4-880b-43c5-a8b7-a1447be008cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:25.774908 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4b8ba9b4-880b-43c5-a8b7-a1447be008cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:25.848698 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ba9b4-880b-43c5-a8b7-a1447be008cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:25.850205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ba9b4-880b-43c5-a8b7-a1447be008cd service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:25.862985 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1164/2311] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:31:29.669128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671db0f6-0567-4a12-ad00-040c44b92de0 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:29.672124 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-671db0f6-0567-4a12-ad00-040c44b92de0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:29.698996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671db0f6-0567-4a12-ad00-040c44b92de0 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:29.707574 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7ce75-4769-4602-90a1-22f08c26898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:29.709030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7ce75-4769-4602-90a1-22f08c26898c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:29.709550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7ce75-4769-4602-90a1-22f08c26898c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:29.710533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7ce75-4769-4602-90a1-22f08c26898c admin admin] PATH_INFO: `/v3/users/c5ebe5c2142f49ab8f2455bf1ae952d5` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:29.712239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7ce75-4769-4602-90a1-22f08c26898c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5ebe5c2142f49ab8f2455bf1ae952d5)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:29.714303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7ce75-4769-4602-90a1-22f08c26898c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:29.777532 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f2e7ce75-4769-4602-90a1-22f08c26898c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5ebe5c2142f49ab8f2455bf1ae952d5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:29.785779 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f2e7ce75-4769-4602-90a1-22f08c26898c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5ebe5c2142f49ab8f2455bf1ae952d5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:29.795314 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f2e7ce75-4769-4602-90a1-22f08c26898c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5ebe5c2142f49ab8f2455bf1ae952d5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:29.796300 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f2e7ce75-4769-4602-90a1-22f08c26898c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5ebe5c2142f49ab8f2455bf1ae952d5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:29.809983 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f2e7ce75-4769-4602-90a1-22f08c26898c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5ebe5c2142f49ab8f2455bf1ae952d5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:29.816856 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1148/2312] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:31:29 2022] DELETE /identity/v3/users/c5ebe5c2142f49ab8f2455bf1ae952d5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:30.035465 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ba9b4-880b-43c5-a8b7-a1447be008cd service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:30.053944 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ba9b4-880b-43c5-a8b7-a1447be008cd service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:30.163127 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e15b4-7cba-4d59-8a3e-812b184c4784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:30.164128 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e15b4-7cba-4d59-8a3e-812b184c4784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:30.164970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e15b4-7cba-4d59-8a3e-812b184c4784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:30.164970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e15b4-7cba-4d59-8a3e-812b184c4784 admin admin] PATH_INFO: `/v3/projects/80bd590dbd764fbf95e6403700207933` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:30.166171 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e15b4-7cba-4d59-8a3e-812b184c4784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80bd590dbd764fbf95e6403700207933)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:30.169932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e15b4-7cba-4d59-8a3e-812b184c4784 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:30.237025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:30.249044 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e9e15b4-7cba-4d59-8a3e-812b184c4784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80bd590dbd764fbf95e6403700207933', 'request_id': 'req-5e9e15b4-7cba-4d59-8a3e-812b184c4784'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:30.257329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e9e15b4-7cba-4d59-8a3e-812b184c4784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80bd590dbd764fbf95e6403700207933', 'request_id': 'req-5e9e15b4-7cba-4d59-8a3e-812b184c4784'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:30.265625 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e9e15b4-7cba-4d59-8a3e-812b184c4784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80bd590dbd764fbf95e6403700207933', 'request_id': 'req-5e9e15b4-7cba-4d59-8a3e-812b184c4784'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:30.285701 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e9e15b4-7cba-4d59-8a3e-812b184c4784 admin admin] The token cache is being invalidate because project 80bd590dbd764fbf95e6403700207933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:31:30.286253 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e9e15b4-7cba-4d59-8a3e-812b184c4784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:30.287395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e9e15b4-7cba-4d59-8a3e-812b184c4784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:30.289591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1165/2313] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:31:30 2022] DELETE /identity/v3/projects/80bd590dbd764fbf95e6403700207933 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:30.301513 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445490de-5c41-4cd7-8e9f-b13528f7f286 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:30.302551 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445490de-5c41-4cd7-8e9f-b13528f7f286 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:30.302901 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445490de-5c41-4cd7-8e9f-b13528f7f286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:30.324345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-445490de-5c41-4cd7-8e9f-b13528f7f286 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:30.325817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-445490de-5c41-4cd7-8e9f-b13528f7f286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:30.397423 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1149/2314] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:31:30.409032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f96df1-90ef-4422-be0e-ab0e4e7d651d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:30.409306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f96df1-90ef-4422-be0e-ab0e4e7d651d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:30.409589 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f96df1-90ef-4422-be0e-ab0e4e7d651d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:30.430409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-43f96df1-90ef-4422-be0e-ab0e4e7d651d None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:30.431701 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-43f96df1-90ef-4422-be0e-ab0e4e7d651d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:30.450772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1166/2315] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:31:30.452837 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445490de-5c41-4cd7-8e9f-b13528f7f286 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:30.464153 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445490de-5c41-4cd7-8e9f-b13528f7f286 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:30.469585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51ead4-7270-40b5-a566-87c589a9d3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:30.470326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51ead4-7270-40b5-a566-87c589a9d3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:30.470618 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51ead4-7270-40b5-a566-87c589a9d3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:30.470900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51ead4-7270-40b5-a566-87c589a9d3f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:30.471673 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51ead4-7270-40b5-a566-87c589a9d3f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:31:30.471976 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51ead4-7270-40b5-a566-87c589a9d3f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:30.473644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51ead4-7270-40b5-a566-87c589a9d3f1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:30.489402 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1150/2316] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:31:30.494118 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f96df1-90ef-4422-be0e-ab0e4e7d651d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:30.506159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f96df1-90ef-4422-be0e-ab0e4e7d651d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:30.512411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94371b5c-11e4-48ad-8039-4883e640693c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:30.513130 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94371b5c-11e4-48ad-8039-4883e640693c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:30.513417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94371b5c-11e4-48ad-8039-4883e640693c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:30.513692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94371b5c-11e4-48ad-8039-4883e640693c admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:30.514477 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94371b5c-11e4-48ad-8039-4883e640693c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:30.516496 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94371b5c-11e4-48ad-8039-4883e640693c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:30.554414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1167/2317] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:31:30 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:31:30.560004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51ead4-7270-40b5-a566-87c589a9d3f1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:30.572711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51ead4-7270-40b5-a566-87c589a9d3f1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:30.627615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:30.644938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c3e71-aa8a-4bef-9c96-274038899ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:30.645644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c3e71-aa8a-4bef-9c96-274038899ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:30.645929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c3e71-aa8a-4bef-9c96-274038899ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:30.646211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c3e71-aa8a-4bef-9c96-274038899ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:30.646954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c3e71-aa8a-4bef-9c96-274038899ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:30.648949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c3e71-aa8a-4bef-9c96-274038899ef7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:30.672133 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1151/2318] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:31:30 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:31:30.678333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94371b5c-11e4-48ad-8039-4883e640693c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:30.694115 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94371b5c-11e4-48ad-8039-4883e640693c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:30.700915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27ee98-a27b-4fb9-99ba-ce8facf17f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:30.702148 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27ee98-a27b-4fb9-99ba-ce8facf17f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:30.702695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27ee98-a27b-4fb9-99ba-ce8facf17f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:30.703254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27ee98-a27b-4fb9-99ba-ce8facf17f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:30.704571 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27ee98-a27b-4fb9-99ba-ce8facf17f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:30.708058 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27ee98-a27b-4fb9-99ba-ce8facf17f91 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:30.722339 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1168/2319] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:31:30.726992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c3e71-aa8a-4bef-9c96-274038899ef7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:30.739336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c3e71-aa8a-4bef-9c96-274038899ef7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:30.745932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca3ee0-688b-4ae7-b4a5-22fdcbe531fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:30.746763 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca3ee0-688b-4ae7-b4a5-22fdcbe531fc admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:30.747208 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca3ee0-688b-4ae7-b4a5-22fdcbe531fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:30.747496 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca3ee0-688b-4ae7-b4a5-22fdcbe531fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:30.748254 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca3ee0-688b-4ae7-b4a5-22fdcbe531fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:30.749989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca3ee0-688b-4ae7-b4a5-22fdcbe531fc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:30.762656 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1152/2320] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:31:30.768627 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27ee98-a27b-4fb9-99ba-ce8facf17f91 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:30.779438 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27ee98-a27b-4fb9-99ba-ce8facf17f91 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:30.785433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69311d0-ae00-470e-aad8-c282b0ac00ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:30.786916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69311d0-ae00-470e-aad8-c282b0ac00ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:30.787215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69311d0-ae00-470e-aad8-c282b0ac00ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:30.787511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69311d0-ae00-470e-aad8-c282b0ac00ce admin admin] PATH_INFO: `/v3/projects/673e5012a0154099bade11165ef8b683/users/60a8933dde7240ff8ca77e61b2fbc651/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:30.806350 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69311d0-ae00-470e-aad8-c282b0ac00ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=673e5012a0154099bade11165ef8b683, user_id=60a8933dde7240ff8ca77e61b2fbc651, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:30.809045 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69311d0-ae00-470e-aad8-c282b0ac00ce admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:30.825858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1169/2321] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:31:30 2022] PUT /identity/v3/projects/673e5012a0154099bade11165ef8b683/users/60a8933dde7240ff8ca77e61b2fbc651/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:30.837067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def5321-1f25-4485-80b5-01808059e33a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:30.837369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def5321-1f25-4485-80b5-01808059e33a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:30.837645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def5321-1f25-4485-80b5-01808059e33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:30.879057 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1def5321-1f25-4485-80b5-01808059e33a None None] MFA Rules not processed for user `60a8933dde7240ff8ca77e61b2fbc651`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:30.880353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1def5321-1f25-4485-80b5-01808059e33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:30.958593 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1153/2322] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:31:30.972257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69311d0-ae00-470e-aad8-c282b0ac00ce admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:30.973992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a69311d0-ae00-470e-aad8-c282b0ac00ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:31.055577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69311d0-ae00-470e-aad8-c282b0ac00ce admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:31.063169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7a9f6-7d9d-459b-b650-c6edef56d060 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:31.063842 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7a9f6-7d9d-459b-b650-c6edef56d060 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:31.064118 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7a9f6-7d9d-459b-b650-c6edef56d060 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:31.064866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7a9f6-7d9d-459b-b650-c6edef56d060 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:31.073832 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7a9f6-7d9d-459b-b650-c6edef56d060 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:31.075686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7a9f6-7d9d-459b-b650-c6edef56d060 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:31.086536 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1170/2323] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:31:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:31:33.872951 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def5321-1f25-4485-80b5-01808059e33a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:33.940847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def5321-1f25-4485-80b5-01808059e33a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:33.945490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c07b87-2976-4969-9442-9804e69093e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:33.946412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c07b87-2976-4969-9442-9804e69093e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:33.946692 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c07b87-2976-4969-9442-9804e69093e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:33.946968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c07b87-2976-4969-9442-9804e69093e9 admin admin] PATH_INFO: `/v3/users/60a8933dde7240ff8ca77e61b2fbc651` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:33.948149 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c07b87-2976-4969-9442-9804e69093e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a8933dde7240ff8ca77e61b2fbc651)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:33.950112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c07b87-2976-4969-9442-9804e69093e9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:34.012321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-12c07b87-2976-4969-9442-9804e69093e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a8933dde7240ff8ca77e61b2fbc651'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:34.020662 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-12c07b87-2976-4969-9442-9804e69093e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a8933dde7240ff8ca77e61b2fbc651'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:34.022505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:34.030811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-12c07b87-2976-4969-9442-9804e69093e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a8933dde7240ff8ca77e61b2fbc651'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:34.032389 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-12c07b87-2976-4969-9442-9804e69093e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a8933dde7240ff8ca77e61b2fbc651'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:34.047714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-12c07b87-2976-4969-9442-9804e69093e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a8933dde7240ff8ca77e61b2fbc651'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:34.056833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1154/2324] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:31:33 2022] DELETE /identity/v3/users/60a8933dde7240ff8ca77e61b2fbc651 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:34.063531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bade4eb-bc50-4a0a-9f40-49541b3e8063 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:34.064040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bade4eb-bc50-4a0a-9f40-49541b3e8063 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:34.064040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bade4eb-bc50-4a0a-9f40-49541b3e8063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:34.085638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2bade4eb-bc50-4a0a-9f40-49541b3e8063 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:34.086886 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2bade4eb-bc50-4a0a-9f40-49541b3e8063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:34.136462 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:34.157938 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1171/2325] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:31:34.167871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c07b87-2976-4969-9442-9804e69093e9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:34.169436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-12c07b87-2976-4969-9442-9804e69093e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:34.235704 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c07b87-2976-4969-9442-9804e69093e9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:34.239437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1440e5-ecdb-438c-a4cb-35e0a707e5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:34.240141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1440e5-ecdb-438c-a4cb-35e0a707e5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:34.240422 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1440e5-ecdb-438c-a4cb-35e0a707e5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:34.240696 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1440e5-ecdb-438c-a4cb-35e0a707e5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:34.250653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1440e5-ecdb-438c-a4cb-35e0a707e5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:34.252108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1440e5-ecdb-438c-a4cb-35e0a707e5c6 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:34.261578 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1155/2326] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:31:34.551692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bade4eb-bc50-4a0a-9f40-49541b3e8063 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:34.553356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2bade4eb-bc50-4a0a-9f40-49541b3e8063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:34.568648 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bade4eb-bc50-4a0a-9f40-49541b3e8063 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:34.573552 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633a206-d87c-410f-a3c6-e55c81fd6a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:34.574473 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633a206-d87c-410f-a3c6-e55c81fd6a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:34.574749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633a206-d87c-410f-a3c6-e55c81fd6a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:34.575032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633a206-d87c-410f-a3c6-e55c81fd6a74 admin admin] PATH_INFO: `/v3/projects/673e5012a0154099bade11165ef8b683` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:34.576342 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633a206-d87c-410f-a3c6-e55c81fd6a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=673e5012a0154099bade11165ef8b683)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:34.578630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633a206-d87c-410f-a3c6-e55c81fd6a74 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:34.635064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0633a206-d87c-410f-a3c6-e55c81fd6a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '673e5012a0154099bade11165ef8b683', 'request_id': 'req-0633a206-d87c-410f-a3c6-e55c81fd6a74'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:34.641583 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0633a206-d87c-410f-a3c6-e55c81fd6a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '673e5012a0154099bade11165ef8b683', 'request_id': 'req-0633a206-d87c-410f-a3c6-e55c81fd6a74'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:34.650782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0633a206-d87c-410f-a3c6-e55c81fd6a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '673e5012a0154099bade11165ef8b683', 'request_id': 'req-0633a206-d87c-410f-a3c6-e55c81fd6a74'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:34.667554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0633a206-d87c-410f-a3c6-e55c81fd6a74 admin admin] The token cache is being invalidate because project 673e5012a0154099bade11165ef8b683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:31:34.667845 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0633a206-d87c-410f-a3c6-e55c81fd6a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:34.668580 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0633a206-d87c-410f-a3c6-e55c81fd6a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:34.670199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1172/2327] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:31:34 2022] DELETE /identity/v3/projects/673e5012a0154099bade11165ef8b683 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:34.676569 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b859b-1462-453c-824b-e7b7f32705fb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:34.676860 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b859b-1462-453c-824b-e7b7f32705fb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:34.677141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b859b-1462-453c-824b-e7b7f32705fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:34.696715 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-030b859b-1462-453c-824b-e7b7f32705fb None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:34.697947 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-030b859b-1462-453c-824b-e7b7f32705fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:34.769165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1156/2328] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:31:34.782037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d4b95-2c26-4ca6-8985-32b3cfd1815e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:34.782362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d4b95-2c26-4ca6-8985-32b3cfd1815e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:34.782638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d4b95-2c26-4ca6-8985-32b3cfd1815e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:34.801677 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b15d4b95-2c26-4ca6-8985-32b3cfd1815e None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:34.802832 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b15d4b95-2c26-4ca6-8985-32b3cfd1815e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:34.811221 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1173/2329] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:31:34.815822 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b859b-1462-453c-824b-e7b7f32705fb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:34.826580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b859b-1462-453c-824b-e7b7f32705fb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:34.832791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657f69a-4f05-4bd5-9176-a566d199cf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:34.833461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657f69a-4f05-4bd5-9176-a566d199cf1e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:34.833750 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657f69a-4f05-4bd5-9176-a566d199cf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:34.834028 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657f69a-4f05-4bd5-9176-a566d199cf1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:34.834805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657f69a-4f05-4bd5-9176-a566d199cf1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:31:34.835111 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657f69a-4f05-4bd5-9176-a566d199cf1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:34.836726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657f69a-4f05-4bd5-9176-a566d199cf1e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:34.850124 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1157/2330] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:31:34.859896 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d4b95-2c26-4ca6-8985-32b3cfd1815e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:34.879032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d4b95-2c26-4ca6-8985-32b3cfd1815e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:34.885344 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de712e-cbbd-433d-9299-c3e6d955755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:34.886035 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de712e-cbbd-433d-9299-c3e6d955755d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:34.886359 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de712e-cbbd-433d-9299-c3e6d955755d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:34.886635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de712e-cbbd-433d-9299-c3e6d955755d admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:34.887345 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de712e-cbbd-433d-9299-c3e6d955755d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:34.889298 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de712e-cbbd-433d-9299-c3e6d955755d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:34.921695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1174/2331] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:31:34 2022] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:31:34.926135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657f69a-4f05-4bd5-9176-a566d199cf1e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:34.938755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657f69a-4f05-4bd5-9176-a566d199cf1e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:35.023611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fd563-c75c-4e56-8aa9-82bc8db0c51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:35.024307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fd563-c75c-4e56-8aa9-82bc8db0c51c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:35.024595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fd563-c75c-4e56-8aa9-82bc8db0c51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:35.024883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fd563-c75c-4e56-8aa9-82bc8db0c51c admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:35.025598 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fd563-c75c-4e56-8aa9-82bc8db0c51c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:35.027762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fd563-c75c-4e56-8aa9-82bc8db0c51c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:35.042379 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:35.054629 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1158/2332] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:31:34 2022] POST /identity/v3/users => generated 303 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:31:35.060430 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de712e-cbbd-433d-9299-c3e6d955755d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:35.076877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de712e-cbbd-433d-9299-c3e6d955755d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:35.082859 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7384dcc-e62e-46df-9934-3f971901c959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:35.083580 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7384dcc-e62e-46df-9934-3f971901c959 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:35.083889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7384dcc-e62e-46df-9934-3f971901c959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:35.084148 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7384dcc-e62e-46df-9934-3f971901c959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:35.084908 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7384dcc-e62e-46df-9934-3f971901c959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:35.087003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7384dcc-e62e-46df-9934-3f971901c959 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:35.102406 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1175/2333] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:31:35.125517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fd563-c75c-4e56-8aa9-82bc8db0c51c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:35.133253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fd563-c75c-4e56-8aa9-82bc8db0c51c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:35.141004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b7094-2efc-46bd-872d-71ee3d7a734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:35.142127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b7094-2efc-46bd-872d-71ee3d7a734a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:35.142671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b7094-2efc-46bd-872d-71ee3d7a734a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:35.143161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b7094-2efc-46bd-872d-71ee3d7a734a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:35.144409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b7094-2efc-46bd-872d-71ee3d7a734a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:35.147522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b7094-2efc-46bd-872d-71ee3d7a734a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:35.162442 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1159/2334] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:31:35.167515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7384dcc-e62e-46df-9934-3f971901c959 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:35.178063 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7384dcc-e62e-46df-9934-3f971901c959 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:35.183516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c02b26-371d-4bb2-8aaa-0d7de63e3351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:35.184039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c02b26-371d-4bb2-8aaa-0d7de63e3351 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:35.184318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c02b26-371d-4bb2-8aaa-0d7de63e3351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:35.184623 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c02b26-371d-4bb2-8aaa-0d7de63e3351 admin admin] PATH_INFO: `/v3/projects/3378fa7a90a844afb15b3f45b5c15fe9/users/21acb3d7a7474174940deee22bc1c27d/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:35.202048 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c02b26-371d-4bb2-8aaa-0d7de63e3351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3378fa7a90a844afb15b3f45b5c15fe9, user_id=21acb3d7a7474174940deee22bc1c27d, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:35.204923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c02b26-371d-4bb2-8aaa-0d7de63e3351 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:35.217823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1176/2335] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:31:35 2022] PUT /identity/v3/projects/3378fa7a90a844afb15b3f45b5c15fe9/users/21acb3d7a7474174940deee22bc1c27d/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:35.228460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92951e65-24f7-42f3-843d-d918c1e4d967 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:35.228755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92951e65-24f7-42f3-843d-d918c1e4d967 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:35.229034 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92951e65-24f7-42f3-843d-d918c1e4d967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:35.255780 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-92951e65-24f7-42f3-843d-d918c1e4d967 None None] MFA Rules not processed for user `21acb3d7a7474174940deee22bc1c27d`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:35.257117 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-92951e65-24f7-42f3-843d-d918c1e4d967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:35.328888 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1160/2336] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:31:35.333388 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c02b26-371d-4bb2-8aaa-0d7de63e3351 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:35.406274 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c02b26-371d-4bb2-8aaa-0d7de63e3351 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:35.420706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23488a70-7854-4c75-aa4e-d87f6d146e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:35.421411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23488a70-7854-4c75-aa4e-d87f6d146e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:35.421683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23488a70-7854-4c75-aa4e-d87f6d146e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:35.421973 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23488a70-7854-4c75-aa4e-d87f6d146e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:35.422725 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23488a70-7854-4c75-aa4e-d87f6d146e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:35.424722 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23488a70-7854-4c75-aa4e-d87f6d146e7c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:35.435867 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:35.469224 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1177/2337] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:31:35 2022] POST /identity/v3/projects => generated 403 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:31:35.470690 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92951e65-24f7-42f3-843d-d918c1e4d967 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:35.482347 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92951e65-24f7-42f3-843d-d918c1e4d967 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:35.548989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c025c-23be-4a06-848d-27b0f637ba40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:35.549687 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c025c-23be-4a06-848d-27b0f637ba40 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:35.549971 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c025c-23be-4a06-848d-27b0f637ba40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:35.550253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c025c-23be-4a06-848d-27b0f637ba40 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:35.551012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c025c-23be-4a06-848d-27b0f637ba40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:35.552962 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c025c-23be-4a06-848d-27b0f637ba40 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:35.580525 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1161/2338] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:31:35 2022] POST /identity/v3/users => generated 308 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:31:35.581932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23488a70-7854-4c75-aa4e-d87f6d146e7c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:35.594114 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23488a70-7854-4c75-aa4e-d87f6d146e7c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:35.600272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd276b00-e807-4c7c-b3e8-11ff2233e718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:35.600999 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd276b00-e807-4c7c-b3e8-11ff2233e718 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:35.601315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd276b00-e807-4c7c-b3e8-11ff2233e718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:35.601594 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd276b00-e807-4c7c-b3e8-11ff2233e718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:35.602380 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd276b00-e807-4c7c-b3e8-11ff2233e718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:35.604066 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd276b00-e807-4c7c-b3e8-11ff2233e718 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:35.616037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1178/2339] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:31:35.620999 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c025c-23be-4a06-848d-27b0f637ba40 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:35.632331 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c025c-23be-4a06-848d-27b0f637ba40 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:35.638179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd7310-67e6-4133-9a05-c7bbb0e843c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:35.639130 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7310-67e6-4133-9a05-c7bbb0e843c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:35.639431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7310-67e6-4133-9a05-c7bbb0e843c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:35.639965 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7310-67e6-4133-9a05-c7bbb0e843c6 admin admin] PATH_INFO: `/v3/projects/0144c375aa214f6395a7b31803efedba/users/1158628b8d564aa2bffbf5590d096ddc/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:35.658263 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd7310-67e6-4133-9a05-c7bbb0e843c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0144c375aa214f6395a7b31803efedba, user_id=1158628b8d564aa2bffbf5590d096ddc, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:35.661202 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd7310-67e6-4133-9a05-c7bbb0e843c6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:35.678967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1162/2340] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:31:35 2022] PUT /identity/v3/projects/0144c375aa214f6395a7b31803efedba/users/1158628b8d564aa2bffbf5590d096ddc/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:31:35.683027 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd276b00-e807-4c7c-b3e8-11ff2233e718 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:35.694449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd276b00-e807-4c7c-b3e8-11ff2233e718 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:35.757711 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990ec94-167b-4ab6-babc-1c0365fbc25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:35.758431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990ec94-167b-4ab6-babc-1c0365fbc25e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:35.758721 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990ec94-167b-4ab6-babc-1c0365fbc25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:35.759000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990ec94-167b-4ab6-babc-1c0365fbc25e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:35.759760 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990ec94-167b-4ab6-babc-1c0365fbc25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:35.761369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990ec94-167b-4ab6-babc-1c0365fbc25e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:35.774292 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1179/2341] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:31:35.779293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd7310-67e6-4133-9a05-c7bbb0e843c6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:35.790545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd7310-67e6-4133-9a05-c7bbb0e843c6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:35.796854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf353b01-7a6f-4694-a40e-f13724941c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:35.797797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf353b01-7a6f-4694-a40e-f13724941c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:35.798080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf353b01-7a6f-4694-a40e-f13724941c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:35.798682 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf353b01-7a6f-4694-a40e-f13724941c7c admin admin] PATH_INFO: `/v3/projects/0144c375aa214f6395a7b31803efedba/users/1158628b8d564aa2bffbf5590d096ddc/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:35.801023 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf353b01-7a6f-4694-a40e-f13724941c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0144c375aa214f6395a7b31803efedba, user_id=1158628b8d564aa2bffbf5590d096ddc, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:35.803768 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf353b01-7a6f-4694-a40e-f13724941c7c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:35.817335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1163/2342] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:31:35 2022] PUT /identity/v3/projects/0144c375aa214f6395a7b31803efedba/users/1158628b8d564aa2bffbf5590d096ddc/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:35.828638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ae410-4a74-46f0-9eb1-b700f16ef455 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:35.828983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ae410-4a74-46f0-9eb1-b700f16ef455 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:35.829302 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ae410-4a74-46f0-9eb1-b700f16ef455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:35.859037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-202ae410-4a74-46f0-9eb1-b700f16ef455 None None] MFA Rules not processed for user `1158628b8d564aa2bffbf5590d096ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:35.860305 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-202ae410-4a74-46f0-9eb1-b700f16ef455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:35.963957 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1180/2343] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:31:35.974761 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf353b01-7a6f-4694-a40e-f13724941c7c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:35.976679 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bf353b01-7a6f-4694-a40e-f13724941c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:36.023817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:36.076933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf353b01-7a6f-4694-a40e-f13724941c7c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:36.081565 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3a09e-d312-4994-8b5c-0060741f7b5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:36.082347 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3a09e-d312-4994-8b5c-0060741f7b5f service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:36.082901 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3a09e-d312-4994-8b5c-0060741f7b5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:36.083256 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3a09e-d312-4994-8b5c-0060741f7b5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:36.094732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3a09e-d312-4994-8b5c-0060741f7b5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:36.096687 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3a09e-d312-4994-8b5c-0060741f7b5f service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:36.131530 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1164/2344] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:31:35 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:31:36.306139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ae410-4a74-46f0-9eb1-b700f16ef455 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:36.417605 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ae410-4a74-46f0-9eb1-b700f16ef455 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:36.428186 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5ab0d-bcda-435f-b910-bbdfbd845ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:36.429489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ab0d-bcda-435f-b910-bbdfbd845ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:36.430467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ab0d-bcda-435f-b910-bbdfbd845ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:36.430996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ab0d-bcda-435f-b910-bbdfbd845ad1 admin admin] PATH_INFO: `/v3/users/21acb3d7a7474174940deee22bc1c27d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:36.432889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5ab0d-bcda-435f-b910-bbdfbd845ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21acb3d7a7474174940deee22bc1c27d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:36.434995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5ab0d-bcda-435f-b910-bbdfbd845ad1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:36.436924 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:36.505220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c9c5ab0d-bcda-435f-b910-bbdfbd845ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21acb3d7a7474174940deee22bc1c27d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:36.513107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c9c5ab0d-bcda-435f-b910-bbdfbd845ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21acb3d7a7474174940deee22bc1c27d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:36.514149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c9c5ab0d-bcda-435f-b910-bbdfbd845ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21acb3d7a7474174940deee22bc1c27d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:36.514824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c9c5ab0d-bcda-435f-b910-bbdfbd845ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21acb3d7a7474174940deee22bc1c27d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:36.529962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c9c5ab0d-bcda-435f-b910-bbdfbd845ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21acb3d7a7474174940deee22bc1c27d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:36.548023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1181/2345] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:31:36 2022] DELETE /identity/v3/users/21acb3d7a7474174940deee22bc1c27d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:36.554499 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea55e21-77aa-46d5-99f9-51ad6cd2ec36 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:36.554706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea55e21-77aa-46d5-99f9-51ad6cd2ec36 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:36.554960 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea55e21-77aa-46d5-99f9-51ad6cd2ec36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:36.575928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0ea55e21-77aa-46d5-99f9-51ad6cd2ec36 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:36.577199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0ea55e21-77aa-46d5-99f9-51ad6cd2ec36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:36.655501 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1165/2346] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:31:36.678191 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5ab0d-bcda-435f-b910-bbdfbd845ad1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:36.679870 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c9c5ab0d-bcda-435f-b910-bbdfbd845ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:36.752215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5ab0d-bcda-435f-b910-bbdfbd845ad1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:36.757245 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec7e41-b192-42e2-a66b-daf1baf005e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:36.757935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec7e41-b192-42e2-a66b-daf1baf005e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:36.758247 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec7e41-b192-42e2-a66b-daf1baf005e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:36.758545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec7e41-b192-42e2-a66b-daf1baf005e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:36.769749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec7e41-b192-42e2-a66b-daf1baf005e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:36.771263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec7e41-b192-42e2-a66b-daf1baf005e5 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:36.781627 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1182/2347] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:31:37.204251 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea55e21-77aa-46d5-99f9-51ad6cd2ec36 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:37.205926 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0ea55e21-77aa-46d5-99f9-51ad6cd2ec36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:37.219309 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea55e21-77aa-46d5-99f9-51ad6cd2ec36 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:37.226485 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400d665-525e-4bc4-9f83-811abeb7c3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:37.227456 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400d665-525e-4bc4-9f83-811abeb7c3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:37.228142 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400d665-525e-4bc4-9f83-811abeb7c3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:37.228427 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400d665-525e-4bc4-9f83-811abeb7c3c0 admin admin] PATH_INFO: `/v3/projects/3378fa7a90a844afb15b3f45b5c15fe9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:37.229686 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400d665-525e-4bc4-9f83-811abeb7c3c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3378fa7a90a844afb15b3f45b5c15fe9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:37.232337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400d665-525e-4bc4-9f83-811abeb7c3c0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:37.283226 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4400d665-525e-4bc4-9f83-811abeb7c3c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3378fa7a90a844afb15b3f45b5c15fe9', 'request_id': 'req-4400d665-525e-4bc4-9f83-811abeb7c3c0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:37.292624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4400d665-525e-4bc4-9f83-811abeb7c3c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3378fa7a90a844afb15b3f45b5c15fe9', 'request_id': 'req-4400d665-525e-4bc4-9f83-811abeb7c3c0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:37.298596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4400d665-525e-4bc4-9f83-811abeb7c3c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3378fa7a90a844afb15b3f45b5c15fe9', 'request_id': 'req-4400d665-525e-4bc4-9f83-811abeb7c3c0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:37.310263 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4400d665-525e-4bc4-9f83-811abeb7c3c0 admin admin] The token cache is being invalidate because project 3378fa7a90a844afb15b3f45b5c15fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:31:37.310557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4400d665-525e-4bc4-9f83-811abeb7c3c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:37.311210 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4400d665-525e-4bc4-9f83-811abeb7c3c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:37.315961 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1166/2348] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:31:37 2022] DELETE /identity/v3/projects/3378fa7a90a844afb15b3f45b5c15fe9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:37.317462 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec7e41-b192-42e2-a66b-daf1baf005e5 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:37.328127 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec7e41-b192-42e2-a66b-daf1baf005e5 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:37.384950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40e34c-69cb-48a4-b64c-40cad3754920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:37.385852 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40e34c-69cb-48a4-b64c-40cad3754920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:37.386518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40e34c-69cb-48a4-b64c-40cad3754920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:37.386518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40e34c-69cb-48a4-b64c-40cad3754920 admin admin] PATH_INFO: `/v3/users/1158628b8d564aa2bffbf5590d096ddc` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:37.387650 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40e34c-69cb-48a4-b64c-40cad3754920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1158628b8d564aa2bffbf5590d096ddc)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:37.389935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40e34c-69cb-48a4-b64c-40cad3754920 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:37.415588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:37.448459 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1e40e34c-69cb-48a4-b64c-40cad3754920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1158628b8d564aa2bffbf5590d096ddc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:37.456862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1e40e34c-69cb-48a4-b64c-40cad3754920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1158628b8d564aa2bffbf5590d096ddc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:37.457820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1e40e34c-69cb-48a4-b64c-40cad3754920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1158628b8d564aa2bffbf5590d096ddc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:37.458563 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1e40e34c-69cb-48a4-b64c-40cad3754920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1158628b8d564aa2bffbf5590d096ddc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:37.473423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1e40e34c-69cb-48a4-b64c-40cad3754920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1158628b8d564aa2bffbf5590d096ddc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:37.492815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1183/2349] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:31:37 2022] DELETE /identity/v3/users/1158628b8d564aa2bffbf5590d096ddc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:37.870953 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400d665-525e-4bc4-9f83-811abeb7c3c0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:37.872658 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4400d665-525e-4bc4-9f83-811abeb7c3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:37.895447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400d665-525e-4bc4-9f83-811abeb7c3c0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:37.952893 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:37.966451 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72c7d6-22d7-406a-9480-a5a9448a3665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:37.967358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72c7d6-22d7-406a-9480-a5a9448a3665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:37.967642 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72c7d6-22d7-406a-9480-a5a9448a3665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:37.967919 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72c7d6-22d7-406a-9480-a5a9448a3665 admin admin] PATH_INFO: `/v3/projects/0144c375aa214f6395a7b31803efedba` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:37.969193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72c7d6-22d7-406a-9480-a5a9448a3665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0144c375aa214f6395a7b31803efedba)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:37.971187 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72c7d6-22d7-406a-9480-a5a9448a3665 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:38.035411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-db72c7d6-22d7-406a-9480-a5a9448a3665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0144c375aa214f6395a7b31803efedba', 'request_id': 'req-db72c7d6-22d7-406a-9480-a5a9448a3665'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:38.052962 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-db72c7d6-22d7-406a-9480-a5a9448a3665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0144c375aa214f6395a7b31803efedba', 'request_id': 'req-db72c7d6-22d7-406a-9480-a5a9448a3665'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:38.066511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-db72c7d6-22d7-406a-9480-a5a9448a3665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0144c375aa214f6395a7b31803efedba', 'request_id': 'req-db72c7d6-22d7-406a-9480-a5a9448a3665'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:38.090604 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-db72c7d6-22d7-406a-9480-a5a9448a3665 admin admin] The token cache is being invalidate because project 0144c375aa214f6395a7b31803efedba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:31:38.091123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-db72c7d6-22d7-406a-9480-a5a9448a3665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:38.092194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-db72c7d6-22d7-406a-9480-a5a9448a3665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:38.095014 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1167/2350] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:31:37 2022] DELETE /identity/v3/projects/0144c375aa214f6395a7b31803efedba => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:38.103397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e0910-c41f-4d43-a12c-1721d0ea528c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:38.103866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e0910-c41f-4d43-a12c-1721d0ea528c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:38.104362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e0910-c41f-4d43-a12c-1721d0ea528c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:38.155679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4d0e0910-c41f-4d43-a12c-1721d0ea528c None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:38.158320 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4d0e0910-c41f-4d43-a12c-1721d0ea528c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:38.277636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1184/2351] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:31:38.293019 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab4a1c-4226-4240-8f65-5bb14e0422b8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:38.293655 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab4a1c-4226-4240-8f65-5bb14e0422b8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:38.293995 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab4a1c-4226-4240-8f65-5bb14e0422b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:38.351903 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a6ab4a1c-4226-4240-8f65-5bb14e0422b8 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:38.353726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a6ab4a1c-4226-4240-8f65-5bb14e0422b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:38.365170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1168/2352] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:31:38.370398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e0910-c41f-4d43-a12c-1721d0ea528c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:38.392277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e0910-c41f-4d43-a12c-1721d0ea528c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:38.403036 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ad5c8-b276-4b95-a19a-450529c042f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:38.403825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ad5c8-b276-4b95-a19a-450529c042f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:38.404193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ad5c8-b276-4b95-a19a-450529c042f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:38.404360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ad5c8-b276-4b95-a19a-450529c042f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:38.405133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ad5c8-b276-4b95-a19a-450529c042f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:31:38.405447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ad5c8-b276-4b95-a19a-450529c042f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:38.407133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ad5c8-b276-4b95-a19a-450529c042f6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:38.438380 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab4a1c-4226-4240-8f65-5bb14e0422b8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:38.446039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1185/2353] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:31:38.453495 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab4a1c-4226-4240-8f65-5bb14e0422b8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:38.462014 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706013cf-0eb9-4dee-bd64-7aa3da92cd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:38.463492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706013cf-0eb9-4dee-bd64-7aa3da92cd05 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:38.464267 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706013cf-0eb9-4dee-bd64-7aa3da92cd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:38.464859 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706013cf-0eb9-4dee-bd64-7aa3da92cd05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:38.466244 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706013cf-0eb9-4dee-bd64-7aa3da92cd05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:38.469942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706013cf-0eb9-4dee-bd64-7aa3da92cd05 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:38.532819 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1169/2354] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:31:38 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:31:38.538545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ad5c8-b276-4b95-a19a-450529c042f6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:38.554985 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ad5c8-b276-4b95-a19a-450529c042f6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:38.631800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320364d6-3782-4195-b2c0-64c5b17e6f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:38.632791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320364d6-3782-4195-b2c0-64c5b17e6f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:38.633177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320364d6-3782-4195-b2c0-64c5b17e6f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:38.633630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320364d6-3782-4195-b2c0-64c5b17e6f03 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:38.634601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320364d6-3782-4195-b2c0-64c5b17e6f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:38.637090 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320364d6-3782-4195-b2c0-64c5b17e6f03 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:38.670422 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1186/2355] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:31:38 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:31:38.672688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706013cf-0eb9-4dee-bd64-7aa3da92cd05 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:38.686797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706013cf-0eb9-4dee-bd64-7aa3da92cd05 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:38.693030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a2619-2e3e-4488-b63e-0f7cbacc76b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:38.694129 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a2619-2e3e-4488-b63e-0f7cbacc76b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:38.694549 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a2619-2e3e-4488-b63e-0f7cbacc76b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:38.694928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a2619-2e3e-4488-b63e-0f7cbacc76b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:38.695785 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a2619-2e3e-4488-b63e-0f7cbacc76b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:38.698453 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a2619-2e3e-4488-b63e-0f7cbacc76b3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:38.725551 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1170/2356] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:31:38.728018 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320364d6-3782-4195-b2c0-64c5b17e6f03 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:38.743228 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320364d6-3782-4195-b2c0-64c5b17e6f03 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:38.751564 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433705e-07bc-4bfb-9319-87505269eba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:38.753347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433705e-07bc-4bfb-9319-87505269eba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:38.753813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433705e-07bc-4bfb-9319-87505269eba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:38.754105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433705e-07bc-4bfb-9319-87505269eba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:38.754982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433705e-07bc-4bfb-9319-87505269eba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:38.756785 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433705e-07bc-4bfb-9319-87505269eba8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:38.772937 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1187/2357] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:31:38.776958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a2619-2e3e-4488-b63e-0f7cbacc76b3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:38.790640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a2619-2e3e-4488-b63e-0f7cbacc76b3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:38.800074 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7ee55-154e-47ed-a467-cb81b8e40935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:38.801461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7ee55-154e-47ed-a467-cb81b8e40935 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:38.802096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7ee55-154e-47ed-a467-cb81b8e40935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:38.802571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7ee55-154e-47ed-a467-cb81b8e40935 admin admin] PATH_INFO: `/v3/projects/86e7e8fc34244caca83dd5f947f6e024/users/22a7778ccc5a4749932c9ef835309585/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:38.843871 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7ee55-154e-47ed-a467-cb81b8e40935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e7e8fc34244caca83dd5f947f6e024, user_id=22a7778ccc5a4749932c9ef835309585, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:38.851709 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7ee55-154e-47ed-a467-cb81b8e40935 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:38.874740 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1171/2358] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:31:38 2022] PUT /identity/v3/projects/86e7e8fc34244caca83dd5f947f6e024/users/22a7778ccc5a4749932c9ef835309585/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:38.885785 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ba4ac-f233-46f9-8e5e-317fae8460b1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:38.886076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ba4ac-f233-46f9-8e5e-317fae8460b1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:38.886445 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ba4ac-f233-46f9-8e5e-317fae8460b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:38.911466 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:38.950156 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fe0ba4ac-f233-46f9-8e5e-317fae8460b1 None None] MFA Rules not processed for user `22a7778ccc5a4749932c9ef835309585`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:38.952032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fe0ba4ac-f233-46f9-8e5e-317fae8460b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:39.043956 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1188/2359] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:31:39.048355 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7ee55-154e-47ed-a467-cb81b8e40935 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:39.125327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7ee55-154e-47ed-a467-cb81b8e40935 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:39.128558 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5e635-677e-4564-8b4d-9cb062637c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:39.129246 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5e635-677e-4564-8b4d-9cb062637c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:39.129530 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5e635-677e-4564-8b4d-9cb062637c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:39.129810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5e635-677e-4564-8b4d-9cb062637c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:39.130628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5e635-677e-4564-8b4d-9cb062637c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:39.140306 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5e635-677e-4564-8b4d-9cb062637c7b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:39.161990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1172/2360] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:31:39 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:31:39.166201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ba4ac-f233-46f9-8e5e-317fae8460b1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:39.178654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ba4ac-f233-46f9-8e5e-317fae8460b1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:39.245825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64db52-b09b-4994-bf98-14d9b0d6af1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:39.246792 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64db52-b09b-4994-bf98-14d9b0d6af1c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:39.247103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64db52-b09b-4994-bf98-14d9b0d6af1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:39.247419 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64db52-b09b-4994-bf98-14d9b0d6af1c admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:39.248323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64db52-b09b-4994-bf98-14d9b0d6af1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:39.250508 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64db52-b09b-4994-bf98-14d9b0d6af1c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:39.277053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1189/2361] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:31:39 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:31:39.281928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5e635-677e-4564-8b4d-9cb062637c7b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:39.288300 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:39.295082 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5e635-677e-4564-8b4d-9cb062637c7b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:39.305106 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c68a93-5fc6-4dda-885e-61cd89fd7977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:39.306206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c68a93-5fc6-4dda-885e-61cd89fd7977 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:39.307548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c68a93-5fc6-4dda-885e-61cd89fd7977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:39.308638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c68a93-5fc6-4dda-885e-61cd89fd7977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:39.312221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c68a93-5fc6-4dda-885e-61cd89fd7977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:39.317508 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c68a93-5fc6-4dda-885e-61cd89fd7977 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:39.331966 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1173/2362] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:31:39.338209 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64db52-b09b-4994-bf98-14d9b0d6af1c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:39.349928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64db52-b09b-4994-bf98-14d9b0d6af1c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:39.355695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f0690-3be0-4884-993e-9f2da757f07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:39.356875 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f0690-3be0-4884-993e-9f2da757f07a admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:39.357218 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f0690-3be0-4884-993e-9f2da757f07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:39.357536 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f0690-3be0-4884-993e-9f2da757f07a admin admin] PATH_INFO: `/v3/projects/8a6aa536cdb64b00a857a4bd0af2eb1b/users/82230e9bbe98483b93d84b5fb8e6d5df/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:39.381573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f0690-3be0-4884-993e-9f2da757f07a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6aa536cdb64b00a857a4bd0af2eb1b, user_id=82230e9bbe98483b93d84b5fb8e6d5df, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:39.384293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f0690-3be0-4884-993e-9f2da757f07a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:39.400183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1190/2363] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:31:39 2022] PUT /identity/v3/projects/8a6aa536cdb64b00a857a4bd0af2eb1b/users/82230e9bbe98483b93d84b5fb8e6d5df/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:31:39.404505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c68a93-5fc6-4dda-885e-61cd89fd7977 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:39.417707 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c68a93-5fc6-4dda-885e-61cd89fd7977 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:39.483206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412ec96-87c8-4b43-a52b-638ecb62468e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:39.483892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412ec96-87c8-4b43-a52b-638ecb62468e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:39.484176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412ec96-87c8-4b43-a52b-638ecb62468e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:39.484450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412ec96-87c8-4b43-a52b-638ecb62468e admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:39.485177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412ec96-87c8-4b43-a52b-638ecb62468e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:39.487443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412ec96-87c8-4b43-a52b-638ecb62468e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:39.499024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1174/2364] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:31:39.503894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f0690-3be0-4884-993e-9f2da757f07a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:39.517330 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f0690-3be0-4884-993e-9f2da757f07a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:39.523536 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f54af-11e3-44ca-8092-90a3ef2cbb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:39.524462 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f54af-11e3-44ca-8092-90a3ef2cbb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:39.524749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f54af-11e3-44ca-8092-90a3ef2cbb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:39.525030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f54af-11e3-44ca-8092-90a3ef2cbb9e admin admin] PATH_INFO: `/v3/projects/8a6aa536cdb64b00a857a4bd0af2eb1b/users/82230e9bbe98483b93d84b5fb8e6d5df/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:39.527358 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f54af-11e3-44ca-8092-90a3ef2cbb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6aa536cdb64b00a857a4bd0af2eb1b, user_id=82230e9bbe98483b93d84b5fb8e6d5df, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:39.530073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f54af-11e3-44ca-8092-90a3ef2cbb9e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:39.543661 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1191/2365] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:31:39 2022] PUT /identity/v3/projects/8a6aa536cdb64b00a857a4bd0af2eb1b/users/82230e9bbe98483b93d84b5fb8e6d5df/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:39.557135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ec1fe-bb4d-435f-82e1-5ea6943f7974 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:39.557424 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ec1fe-bb4d-435f-82e1-5ea6943f7974 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:39.557789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ec1fe-bb4d-435f-82e1-5ea6943f7974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:39.589499 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7c2ec1fe-bb4d-435f-82e1-5ea6943f7974 None None] MFA Rules not processed for user `82230e9bbe98483b93d84b5fb8e6d5df`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:39.590788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7c2ec1fe-bb4d-435f-82e1-5ea6943f7974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:39.668963 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1175/2366] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:31:39.680469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f54af-11e3-44ca-8092-90a3ef2cbb9e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:39.682533 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ba9f54af-11e3-44ca-8092-90a3ef2cbb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:39.745852 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:39.751236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f54af-11e3-44ca-8092-90a3ef2cbb9e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:39.757678 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d79351-9a64-46e4-afea-303e34da79a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:39.758406 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d79351-9a64-46e4-afea-303e34da79a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:39.758692 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d79351-9a64-46e4-afea-303e34da79a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:39.759023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d79351-9a64-46e4-afea-303e34da79a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:39.832607 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d79351-9a64-46e4-afea-303e34da79a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:39.834098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d79351-9a64-46e4-afea-303e34da79a6 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:39.844738 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1192/2367] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:31:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:31:42.501086 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ec1fe-bb4d-435f-82e1-5ea6943f7974 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:42.502976 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7c2ec1fe-bb4d-435f-82e1-5ea6943f7974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:42.515476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ec1fe-bb4d-435f-82e1-5ea6943f7974 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:42.519557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b124540-37eb-468b-91d4-c25d06966633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:42.521188 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b124540-37eb-468b-91d4-c25d06966633 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:42.521473 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b124540-37eb-468b-91d4-c25d06966633 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:42.521746 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b124540-37eb-468b-91d4-c25d06966633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:42.532423 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b124540-37eb-468b-91d4-c25d06966633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:42.534036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b124540-37eb-468b-91d4-c25d06966633 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:42.545888 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1176/2368] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:31:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:31:42.974799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d79351-9a64-46e4-afea-303e34da79a6 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:42.982620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-64d79351-9a64-46e4-afea-303e34da79a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:43.143791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d79351-9a64-46e4-afea-303e34da79a6 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:43.153709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0f4ae-8d03-4b09-9031-4480b992b3bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:43.154650 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0f4ae-8d03-4b09-9031-4480b992b3bd service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:43.155055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0f4ae-8d03-4b09-9031-4480b992b3bd service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:43.155641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0f4ae-8d03-4b09-9031-4480b992b3bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:43.158260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-92a0f4ae-8d03-4b09-9031-4480b992b3bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:43.175858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0f4ae-8d03-4b09-9031-4480b992b3bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:43.177505 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0f4ae-8d03-4b09-9031-4480b992b3bd service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:43.190046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1193/2369] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:31:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:31:44.268055 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5950cd-f8a2-4f3b-a4bd-58354acb2da3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:44.268920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5950cd-f8a2-4f3b-a4bd-58354acb2da3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:44.268920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5950cd-f8a2-4f3b-a4bd-58354acb2da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:44.289764 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8d5950cd-f8a2-4f3b-a4bd-58354acb2da3 None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:44.291148 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8d5950cd-f8a2-4f3b-a4bd-58354acb2da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:44.371166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1177/2370] 10.222.0.33 () {58 vars in 967 bytes} [Mon Jun 27 15:31:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:31:44.421633 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0f4ae-8d03-4b09-9031-4480b992b3bd service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:44.423198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-92a0f4ae-8d03-4b09-9031-4480b992b3bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:44.507788 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0f4ae-8d03-4b09-9031-4480b992b3bd service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:44.516190 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7e013-ec22-4f91-87c9-db19412430a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:44.517394 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7e013-ec22-4f91-87c9-db19412430a7 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:44.517723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7e013-ec22-4f91-87c9-db19412430a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:44.518204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7e013-ec22-4f91-87c9-db19412430a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:44.533256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7e013-ec22-4f91-87c9-db19412430a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:44.534964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7e013-ec22-4f91-87c9-db19412430a7 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:44.544836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1194/2371] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:31:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 15:31:48.663769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791738e4-4df5-46f6-9b08-4d9c7b49e7a8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:48.664910 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791738e4-4df5-46f6-9b08-4d9c7b49e7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:48.665385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791738e4-4df5-46f6-9b08-4d9c7b49e7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:48.683275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:48.713510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-791738e4-4df5-46f6-9b08-4d9c7b49e7a8 None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:48.714842 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-791738e4-4df5-46f6-9b08-4d9c7b49e7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:48.744008 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1178/2372] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 27 15:31:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:31:48.753109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7e013-ec22-4f91-87c9-db19412430a7 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:48.765568 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7e013-ec22-4f91-87c9-db19412430a7 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:48.775916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a9c5a-f2c1-4232-b88e-c979fe39bb78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:48.777624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a9c5a-f2c1-4232-b88e-c979fe39bb78 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:48.778064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a9c5a-f2c1-4232-b88e-c979fe39bb78 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:48.778594 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a9c5a-f2c1-4232-b88e-c979fe39bb78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:48.792895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a9c5a-f2c1-4232-b88e-c979fe39bb78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:48.795455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a9c5a-f2c1-4232-b88e-c979fe39bb78 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:48.808802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1195/2373] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:31:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:31:50.957628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791738e4-4df5-46f6-9b08-4d9c7b49e7a8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:50.960234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-791738e4-4df5-46f6-9b08-4d9c7b49e7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:50.995288 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791738e4-4df5-46f6-9b08-4d9c7b49e7a8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:51.009239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa24cb-aa98-47f7-9486-e8bac5793e4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:51.010321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa24cb-aa98-47f7-9486-e8bac5793e4d service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:51.011026 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa24cb-aa98-47f7-9486-e8bac5793e4d service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:51.012300 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa24cb-aa98-47f7-9486-e8bac5793e4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:51.016239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-08aa24cb-aa98-47f7-9486-e8bac5793e4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:51.043409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa24cb-aa98-47f7-9486-e8bac5793e4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:51.047584 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa24cb-aa98-47f7-9486-e8bac5793e4d service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:51.079622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1179/2374] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:31:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:31:54.865198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a9c5a-f2c1-4232-b88e-c979fe39bb78 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:54.866730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-207a9c5a-f2c1-4232-b88e-c979fe39bb78 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:54.875424 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:54.973030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a9c5a-f2c1-4232-b88e-c979fe39bb78 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:54.982873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034e378-d335-42f3-bdbe-eb1ff877e820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:54.984714 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034e378-d335-42f3-bdbe-eb1ff877e820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:54.985159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034e378-d335-42f3-bdbe-eb1ff877e820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:54.985663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034e378-d335-42f3-bdbe-eb1ff877e820 admin admin] PATH_INFO: `/v3/users/bedd1142c90d47f4a58586180c03bf7e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:54.988247 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034e378-d335-42f3-bdbe-eb1ff877e820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bedd1142c90d47f4a58586180c03bf7e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:54.992325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034e378-d335-42f3-bdbe-eb1ff877e820 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:55.074160 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9034e378-d335-42f3-bdbe-eb1ff877e820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bedd1142c90d47f4a58586180c03bf7e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:55.083001 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9034e378-d335-42f3-bdbe-eb1ff877e820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bedd1142c90d47f4a58586180c03bf7e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:55.083786 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9034e378-d335-42f3-bdbe-eb1ff877e820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bedd1142c90d47f4a58586180c03bf7e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:55.084409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9034e378-d335-42f3-bdbe-eb1ff877e820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bedd1142c90d47f4a58586180c03bf7e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:55.106559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9034e378-d335-42f3-bdbe-eb1ff877e820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bedd1142c90d47f4a58586180c03bf7e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:55.145134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1196/2375] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:31:54 2022] DELETE /identity/v3/users/bedd1142c90d47f4a58586180c03bf7e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:31:55.408328 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa24cb-aa98-47f7-9486-e8bac5793e4d service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:55.432261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa24cb-aa98-47f7-9486-e8bac5793e4d service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:55.603633 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893988d-d121-4816-9950-5a0544222858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:55.604841 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893988d-d121-4816-9950-5a0544222858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:55.605304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893988d-d121-4816-9950-5a0544222858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:55.605737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893988d-d121-4816-9950-5a0544222858 admin admin] PATH_INFO: `/v3/projects/09853aa2883f40baa81473f43367673c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:55.607352 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893988d-d121-4816-9950-5a0544222858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09853aa2883f40baa81473f43367673c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:55.609639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893988d-d121-4816-9950-5a0544222858 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:55.706570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e893988d-d121-4816-9950-5a0544222858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09853aa2883f40baa81473f43367673c', 'request_id': 'req-e893988d-d121-4816-9950-5a0544222858'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:55.717608 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e893988d-d121-4816-9950-5a0544222858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09853aa2883f40baa81473f43367673c', 'request_id': 'req-e893988d-d121-4816-9950-5a0544222858'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:55.731667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e893988d-d121-4816-9950-5a0544222858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09853aa2883f40baa81473f43367673c', 'request_id': 'req-e893988d-d121-4816-9950-5a0544222858'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:55.745131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e893988d-d121-4816-9950-5a0544222858 admin admin] The token cache is being invalidate because project 09853aa2883f40baa81473f43367673c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:31:55.745533 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e893988d-d121-4816-9950-5a0544222858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:55.746164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e893988d-d121-4816-9950-5a0544222858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:55.748309 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1180/2376] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:31:55 2022] DELETE /identity/v3/projects/09853aa2883f40baa81473f43367673c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:55.752428 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034e378-d335-42f3-bdbe-eb1ff877e820 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:55.753935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9034e378-d335-42f3-bdbe-eb1ff877e820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:55.774842 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034e378-d335-42f3-bdbe-eb1ff877e820 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:55.907513 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa16390-7036-4cc6-91ad-c06070ac6755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:55.909008 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa16390-7036-4cc6-91ad-c06070ac6755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:55.909577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa16390-7036-4cc6-91ad-c06070ac6755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:55.910070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa16390-7036-4cc6-91ad-c06070ac6755 admin admin] PATH_INFO: `/v3/users/164733fa6d6d48cfb0f107db19477a0f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:55.912655 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa16390-7036-4cc6-91ad-c06070ac6755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=164733fa6d6d48cfb0f107db19477a0f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:55.916959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa16390-7036-4cc6-91ad-c06070ac6755 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:56.000421 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:56.034007 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3fa16390-7036-4cc6-91ad-c06070ac6755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '164733fa6d6d48cfb0f107db19477a0f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:56.044078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3fa16390-7036-4cc6-91ad-c06070ac6755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '164733fa6d6d48cfb0f107db19477a0f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:56.045713 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3fa16390-7036-4cc6-91ad-c06070ac6755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '164733fa6d6d48cfb0f107db19477a0f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:56.050438 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3fa16390-7036-4cc6-91ad-c06070ac6755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '164733fa6d6d48cfb0f107db19477a0f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:56.078005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3fa16390-7036-4cc6-91ad-c06070ac6755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '164733fa6d6d48cfb0f107db19477a0f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:56.126912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1197/2377] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:31:55 2022] DELETE /identity/v3/users/164733fa6d6d48cfb0f107db19477a0f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:56.424358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893988d-d121-4816-9950-5a0544222858 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:56.433888 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e893988d-d121-4816-9950-5a0544222858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:56.470652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893988d-d121-4816-9950-5a0544222858 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:56.558670 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72df4a-f762-4995-b57a-54b3fe937f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:56.559746 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72df4a-f762-4995-b57a-54b3fe937f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:56.560042 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72df4a-f762-4995-b57a-54b3fe937f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:56.560316 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72df4a-f762-4995-b57a-54b3fe937f9b admin admin] PATH_INFO: `/v3/projects/4550a149eb614444875fb516e4643538` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:56.561609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72df4a-f762-4995-b57a-54b3fe937f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4550a149eb614444875fb516e4643538)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:56.563802 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72df4a-f762-4995-b57a-54b3fe937f9b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:56.584161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:56.639802 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9a72df4a-f762-4995-b57a-54b3fe937f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4550a149eb614444875fb516e4643538', 'request_id': 'req-9a72df4a-f762-4995-b57a-54b3fe937f9b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:56.651848 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9a72df4a-f762-4995-b57a-54b3fe937f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4550a149eb614444875fb516e4643538', 'request_id': 'req-9a72df4a-f762-4995-b57a-54b3fe937f9b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:56.660734 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9a72df4a-f762-4995-b57a-54b3fe937f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4550a149eb614444875fb516e4643538', 'request_id': 'req-9a72df4a-f762-4995-b57a-54b3fe937f9b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:56.677744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9a72df4a-f762-4995-b57a-54b3fe937f9b admin admin] The token cache is being invalidate because project 4550a149eb614444875fb516e4643538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:31:56.678171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9a72df4a-f762-4995-b57a-54b3fe937f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:56.682620 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9a72df4a-f762-4995-b57a-54b3fe937f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:56.682620 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1181/2378] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:31:56 2022] DELETE /identity/v3/projects/4550a149eb614444875fb516e4643538 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:57.073341 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa16390-7036-4cc6-91ad-c06070ac6755 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:57.075906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3fa16390-7036-4cc6-91ad-c06070ac6755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:57.093641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa16390-7036-4cc6-91ad-c06070ac6755 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:57.189446 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341b2ff-8f9a-413b-bc00-77cb914e8d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:57.190669 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341b2ff-8f9a-413b-bc00-77cb914e8d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:57.191029 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341b2ff-8f9a-413b-bc00-77cb914e8d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:57.191385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341b2ff-8f9a-413b-bc00-77cb914e8d88 admin admin] PATH_INFO: `/v3/users/22a7778ccc5a4749932c9ef835309585` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:57.192742 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341b2ff-8f9a-413b-bc00-77cb914e8d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a7778ccc5a4749932c9ef835309585)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:57.194661 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341b2ff-8f9a-413b-bc00-77cb914e8d88 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:57.283790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2341b2ff-8f9a-413b-bc00-77cb914e8d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a7778ccc5a4749932c9ef835309585'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:57.295704 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2341b2ff-8f9a-413b-bc00-77cb914e8d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a7778ccc5a4749932c9ef835309585'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:57.296682 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2341b2ff-8f9a-413b-bc00-77cb914e8d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a7778ccc5a4749932c9ef835309585'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:57.303471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2341b2ff-8f9a-413b-bc00-77cb914e8d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a7778ccc5a4749932c9ef835309585'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:57.343506 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2341b2ff-8f9a-413b-bc00-77cb914e8d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a7778ccc5a4749932c9ef835309585'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:57.382340 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1198/2379] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:31:57 2022] DELETE /identity/v3/users/22a7778ccc5a4749932c9ef835309585 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:31:57.387256 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432a73a-5b5d-495a-b73e-f23c00cbe8e2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:57.387683 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432a73a-5b5d-495a-b73e-f23c00cbe8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:57.388022 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432a73a-5b5d-495a-b73e-f23c00cbe8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:57.409691 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5432a73a-5b5d-495a-b73e-f23c00cbe8e2 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:57.411313 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5432a73a-5b5d-495a-b73e-f23c00cbe8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:57.511744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1182/2380] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:31:57.525173 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341b2ff-8f9a-413b-bc00-77cb914e8d88 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:57.527332 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2341b2ff-8f9a-413b-bc00-77cb914e8d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:57.561578 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:57.617636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341b2ff-8f9a-413b-bc00-77cb914e8d88 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:57.621676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff2963-955e-4126-8438-4d35837642f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:57.622417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff2963-955e-4126-8438-4d35837642f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:57.622693 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff2963-955e-4126-8438-4d35837642f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:57.622977 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff2963-955e-4126-8438-4d35837642f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:57.638207 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff2963-955e-4126-8438-4d35837642f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:57.640341 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff2963-955e-4126-8438-4d35837642f2 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:57.659667 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1199/2381] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:31:57.869084 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432a73a-5b5d-495a-b73e-f23c00cbe8e2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:57.870955 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5432a73a-5b5d-495a-b73e-f23c00cbe8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:58.043525 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432a73a-5b5d-495a-b73e-f23c00cbe8e2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:58.057962 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44228e41-405f-4c1f-a6d2-d4a7bcc5dc11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:58.059282 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44228e41-405f-4c1f-a6d2-d4a7bcc5dc11 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:58.059783 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44228e41-405f-4c1f-a6d2-d4a7bcc5dc11 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:58.060503 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44228e41-405f-4c1f-a6d2-d4a7bcc5dc11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:58.064378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-44228e41-405f-4c1f-a6d2-d4a7bcc5dc11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:58.191767 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff2963-955e-4126-8438-4d35837642f2 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:58.194130 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5cff2963-955e-4126-8438-4d35837642f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:58.196083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:58.250423 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44228e41-405f-4c1f-a6d2-d4a7bcc5dc11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:58.253492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44228e41-405f-4c1f-a6d2-d4a7bcc5dc11 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:58.270476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff2963-955e-4126-8438-4d35837642f2 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:58.280646 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1183/2382] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:31:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:31:58.289996 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa266462-3a1d-4db2-9b96-e95d1a200893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:58.292914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa266462-3a1d-4db2-9b96-e95d1a200893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:58.293749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa266462-3a1d-4db2-9b96-e95d1a200893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:58.294163 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa266462-3a1d-4db2-9b96-e95d1a200893 admin admin] PATH_INFO: `/v3/projects/86e7e8fc34244caca83dd5f947f6e024` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:58.298422 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa266462-3a1d-4db2-9b96-e95d1a200893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e7e8fc34244caca83dd5f947f6e024)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:58.303114 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa266462-3a1d-4db2-9b96-e95d1a200893 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:58.458754 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fa266462-3a1d-4db2-9b96-e95d1a200893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e7e8fc34244caca83dd5f947f6e024', 'request_id': 'req-fa266462-3a1d-4db2-9b96-e95d1a200893'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:58.469977 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fa266462-3a1d-4db2-9b96-e95d1a200893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e7e8fc34244caca83dd5f947f6e024', 'request_id': 'req-fa266462-3a1d-4db2-9b96-e95d1a200893'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:58.477793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fa266462-3a1d-4db2-9b96-e95d1a200893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e7e8fc34244caca83dd5f947f6e024', 'request_id': 'req-fa266462-3a1d-4db2-9b96-e95d1a200893'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:58.514516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fa266462-3a1d-4db2-9b96-e95d1a200893 admin admin] The token cache is being invalidate because project 86e7e8fc34244caca83dd5f947f6e024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:31:58.515077 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fa266462-3a1d-4db2-9b96-e95d1a200893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:58.518844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fa266462-3a1d-4db2-9b96-e95d1a200893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:58.521784 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1200/2383] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:31:58 2022] DELETE /identity/v3/projects/86e7e8fc34244caca83dd5f947f6e024 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:58.526584 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44228e41-405f-4c1f-a6d2-d4a7bcc5dc11 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:58.546415 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44228e41-405f-4c1f-a6d2-d4a7bcc5dc11 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:58.669114 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3703270-deda-409f-bb44-5c90f6d95a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:58.670405 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3703270-deda-409f-bb44-5c90f6d95a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:58.670796 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3703270-deda-409f-bb44-5c90f6d95a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:58.671211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3703270-deda-409f-bb44-5c90f6d95a5c admin admin] PATH_INFO: `/v3/users/82230e9bbe98483b93d84b5fb8e6d5df` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:58.672863 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3703270-deda-409f-bb44-5c90f6d95a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=82230e9bbe98483b93d84b5fb8e6d5df)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:58.676884 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3703270-deda-409f-bb44-5c90f6d95a5c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:58.776332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b3703270-deda-409f-bb44-5c90f6d95a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82230e9bbe98483b93d84b5fb8e6d5df'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:58.786433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b3703270-deda-409f-bb44-5c90f6d95a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82230e9bbe98483b93d84b5fb8e6d5df'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:58.801776 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b3703270-deda-409f-bb44-5c90f6d95a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82230e9bbe98483b93d84b5fb8e6d5df'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:58.802463 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b3703270-deda-409f-bb44-5c90f6d95a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82230e9bbe98483b93d84b5fb8e6d5df'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:58.843481 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b3703270-deda-409f-bb44-5c90f6d95a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82230e9bbe98483b93d84b5fb8e6d5df'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:58.874143 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1184/2384] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:31:58 2022] DELETE /identity/v3/users/82230e9bbe98483b93d84b5fb8e6d5df => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:59.379920 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa266462-3a1d-4db2-9b96-e95d1a200893 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:59.382311 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fa266462-3a1d-4db2-9b96-e95d1a200893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:59.428749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa266462-3a1d-4db2-9b96-e95d1a200893 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:59.532206 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620a880-f67a-4816-a9b0-bfa2d10ec1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:59.533560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620a880-f67a-4816-a9b0-bfa2d10ec1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:59.534086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620a880-f67a-4816-a9b0-bfa2d10ec1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:59.534592 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620a880-f67a-4816-a9b0-bfa2d10ec1f5 admin admin] PATH_INFO: `/v3/projects/8a6aa536cdb64b00a857a4bd0af2eb1b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:59.536467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620a880-f67a-4816-a9b0-bfa2d10ec1f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a6aa536cdb64b00a857a4bd0af2eb1b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:59.545445 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620a880-f67a-4816-a9b0-bfa2d10ec1f5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:59.624530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e620a880-f67a-4816-a9b0-bfa2d10ec1f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a6aa536cdb64b00a857a4bd0af2eb1b', 'request_id': 'req-e620a880-f67a-4816-a9b0-bfa2d10ec1f5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:59.627931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:59.637128 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e620a880-f67a-4816-a9b0-bfa2d10ec1f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a6aa536cdb64b00a857a4bd0af2eb1b', 'request_id': 'req-e620a880-f67a-4816-a9b0-bfa2d10ec1f5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:59.652509 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e620a880-f67a-4816-a9b0-bfa2d10ec1f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a6aa536cdb64b00a857a4bd0af2eb1b', 'request_id': 'req-e620a880-f67a-4816-a9b0-bfa2d10ec1f5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:59.674555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e620a880-f67a-4816-a9b0-bfa2d10ec1f5 admin admin] The token cache is being invalidate because project 8a6aa536cdb64b00a857a4bd0af2eb1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:31:59.674855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e620a880-f67a-4816-a9b0-bfa2d10ec1f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:59.675892 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e620a880-f67a-4816-a9b0-bfa2d10ec1f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:31:59.682865 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a74d5-01ca-4ba3-8ad4-6c348dd7a583 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:59.683725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a74d5-01ca-4ba3-8ad4-6c348dd7a583 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:59.684204 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a74d5-01ca-4ba3-8ad4-6c348dd7a583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:59.686865 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1201/2385] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:31:59 2022] DELETE /identity/v3/projects/8a6aa536cdb64b00a857a4bd0af2eb1b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:31:59.712703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bd2a74d5-01ca-4ba3-8ad4-6c348dd7a583 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:59.713997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bd2a74d5-01ca-4ba3-8ad4-6c348dd7a583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:59.799463 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1185/2386] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:31:59.807901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c78fd0-707f-42b8-be8e-3e1d7216a096 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:59.808217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c78fd0-707f-42b8-be8e-3e1d7216a096 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:59.808504 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c78fd0-707f-42b8-be8e-3e1d7216a096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:59.829571 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-85c78fd0-707f-42b8-be8e-3e1d7216a096 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:31:59.831009 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-85c78fd0-707f-42b8-be8e-3e1d7216a096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:31:59.840818 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1202/2387] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:31:59.845638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a74d5-01ca-4ba3-8ad4-6c348dd7a583 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:59.850928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:59.860704 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a74d5-01ca-4ba3-8ad4-6c348dd7a583 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:59.869938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b5e7a-abc8-4063-81de-57d9239e7943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:59.871257 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b5e7a-abc8-4063-81de-57d9239e7943 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:59.871766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b5e7a-abc8-4063-81de-57d9239e7943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:59.872263 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b5e7a-abc8-4063-81de-57d9239e7943 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:59.873654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b5e7a-abc8-4063-81de-57d9239e7943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:31:59.874258 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b5e7a-abc8-4063-81de-57d9239e7943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:59.877588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b5e7a-abc8-4063-81de-57d9239e7943 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:59.905037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1186/2388] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:31:59.906340 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c78fd0-707f-42b8-be8e-3e1d7216a096 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:31:59.917921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c78fd0-707f-42b8-be8e-3e1d7216a096 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:31:59.923994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befdfca-e5da-4fa2-b15b-03769b30de55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:31:59.925362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befdfca-e5da-4fa2-b15b-03769b30de55 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:31:59.925362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befdfca-e5da-4fa2-b15b-03769b30de55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:31:59.925362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befdfca-e5da-4fa2-b15b-03769b30de55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:31:59.925943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befdfca-e5da-4fa2-b15b-03769b30de55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:31:59.927951 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befdfca-e5da-4fa2-b15b-03769b30de55 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:31:59.978263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1203/2389] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:31:59 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:31:59.984593 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b5e7a-abc8-4063-81de-57d9239e7943 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:00.001603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b5e7a-abc8-4063-81de-57d9239e7943 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:00.120441 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff22a1d-269a-4a48-bdcd-ec78032c9267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:00.120977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff22a1d-269a-4a48-bdcd-ec78032c9267 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:00.121322 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff22a1d-269a-4a48-bdcd-ec78032c9267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:00.121658 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff22a1d-269a-4a48-bdcd-ec78032c9267 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:00.122898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff22a1d-269a-4a48-bdcd-ec78032c9267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:00.125355 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff22a1d-269a-4a48-bdcd-ec78032c9267 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:00.161045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1187/2390] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:31:59 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:00.165942 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befdfca-e5da-4fa2-b15b-03769b30de55 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:00.181881 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befdfca-e5da-4fa2-b15b-03769b30de55 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:00.188187 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ee014-1df5-47df-8308-705833444cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:00.188955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee014-1df5-47df-8308-705833444cda admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:00.189234 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee014-1df5-47df-8308-705833444cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:00.189517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee014-1df5-47df-8308-705833444cda admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:00.190329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ee014-1df5-47df-8308-705833444cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:00.192147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ee014-1df5-47df-8308-705833444cda admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:00.206281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1204/2391] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:00.210047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff22a1d-269a-4a48-bdcd-ec78032c9267 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:00.226480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff22a1d-269a-4a48-bdcd-ec78032c9267 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:00.231850 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79da21-ba0e-4395-98ea-d9849027d393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:00.232915 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79da21-ba0e-4395-98ea-d9849027d393 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:00.233494 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79da21-ba0e-4395-98ea-d9849027d393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:00.235090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79da21-ba0e-4395-98ea-d9849027d393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:00.236276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79da21-ba0e-4395-98ea-d9849027d393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:00.237936 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79da21-ba0e-4395-98ea-d9849027d393 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:00.255583 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1188/2392] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:00.256393 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ee014-1df5-47df-8308-705833444cda admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:00.270884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ee014-1df5-47df-8308-705833444cda admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:00.276312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469b89b-4f4d-40be-9f1a-e8162c61e8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:00.277232 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469b89b-4f4d-40be-9f1a-e8162c61e8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:00.277536 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469b89b-4f4d-40be-9f1a-e8162c61e8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:00.277820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469b89b-4f4d-40be-9f1a-e8162c61e8dd admin admin] PATH_INFO: `/v3/projects/ca82740ba26b429a866683cd943b79b4/users/8e35f8e0ae6941688b8377d597e7331a/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:00.298190 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469b89b-4f4d-40be-9f1a-e8162c61e8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca82740ba26b429a866683cd943b79b4, user_id=8e35f8e0ae6941688b8377d597e7331a, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:00.301073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469b89b-4f4d-40be-9f1a-e8162c61e8dd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:00.319642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1205/2393] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:00 2022] PUT /identity/v3/projects/ca82740ba26b429a866683cd943b79b4/users/8e35f8e0ae6941688b8377d597e7331a/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:32:00.330760 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17fe3d-a5b0-4dc4-8e49-893e3344f5ff None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:00.331444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17fe3d-a5b0-4dc4-8e49-893e3344f5ff None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:00.331915 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17fe3d-a5b0-4dc4-8e49-893e3344f5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:00.374559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2e17fe3d-a5b0-4dc4-8e49-893e3344f5ff None None] MFA Rules not processed for user `8e35f8e0ae6941688b8377d597e7331a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:00.377180 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2e17fe3d-a5b0-4dc4-8e49-893e3344f5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:00.510816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1189/2394] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:00.515690 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469b89b-4f4d-40be-9f1a-e8162c61e8dd admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:00.613175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469b89b-4f4d-40be-9f1a-e8162c61e8dd admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:00.618812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5da7f7-67a9-48b1-a78c-88bbcd1e66f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:00.619693 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5da7f7-67a9-48b1-a78c-88bbcd1e66f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:00.620000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5da7f7-67a9-48b1-a78c-88bbcd1e66f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:00.620432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5da7f7-67a9-48b1-a78c-88bbcd1e66f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:00.621195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5da7f7-67a9-48b1-a78c-88bbcd1e66f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:00.623268 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5da7f7-67a9-48b1-a78c-88bbcd1e66f2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:00.670528 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1206/2395] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:00 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:32:00.676648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17fe3d-a5b0-4dc4-8e49-893e3344f5ff None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:00.699494 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17fe3d-a5b0-4dc4-8e49-893e3344f5ff None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:00.779406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:00.790977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c3726-3b7d-411a-b706-b40ece0bc83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:00.792092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c3726-3b7d-411a-b706-b40ece0bc83c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:00.792372 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c3726-3b7d-411a-b706-b40ece0bc83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:00.792645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c3726-3b7d-411a-b706-b40ece0bc83c admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:00.793393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c3726-3b7d-411a-b706-b40ece0bc83c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:00.795563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c3726-3b7d-411a-b706-b40ece0bc83c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:00.832121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1190/2396] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:32:00 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:00.837097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5da7f7-67a9-48b1-a78c-88bbcd1e66f2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:00.857262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5da7f7-67a9-48b1-a78c-88bbcd1e66f2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:00.865723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58461e2-9ecf-43dc-9ba9-6bc30e1bdb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:00.866527 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58461e2-9ecf-43dc-9ba9-6bc30e1bdb11 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:00.866813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58461e2-9ecf-43dc-9ba9-6bc30e1bdb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:00.867091 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58461e2-9ecf-43dc-9ba9-6bc30e1bdb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:00.867842 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58461e2-9ecf-43dc-9ba9-6bc30e1bdb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:00.869463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58461e2-9ecf-43dc-9ba9-6bc30e1bdb11 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:00.884361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1207/2397] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:00.888749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c3726-3b7d-411a-b706-b40ece0bc83c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:00.901981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c3726-3b7d-411a-b706-b40ece0bc83c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:00.914652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a788f-3ee8-4c6c-ae6b-fb55a7fc4e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:00.917217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a788f-3ee8-4c6c-ae6b-fb55a7fc4e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:00.917593 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a788f-3ee8-4c6c-ae6b-fb55a7fc4e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:00.917922 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a788f-3ee8-4c6c-ae6b-fb55a7fc4e21 admin admin] PATH_INFO: `/v3/projects/23f638e0f0aa483bbef232e38449e94a/users/1e00cef51b114e65af5c1f0e24e2b488/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:00.941930 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a788f-3ee8-4c6c-ae6b-fb55a7fc4e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f638e0f0aa483bbef232e38449e94a, user_id=1e00cef51b114e65af5c1f0e24e2b488, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:00.945279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a788f-3ee8-4c6c-ae6b-fb55a7fc4e21 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:00.963816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1191/2398] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:00 2022] PUT /identity/v3/projects/23f638e0f0aa483bbef232e38449e94a/users/1e00cef51b114e65af5c1f0e24e2b488/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:32:00.967827 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58461e2-9ecf-43dc-9ba9-6bc30e1bdb11 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:00.988544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58461e2-9ecf-43dc-9ba9-6bc30e1bdb11 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:01.033417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:01.054767 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065dd912-0193-4fa6-9775-72e3b0eb7e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:01.055451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dd912-0193-4fa6-9775-72e3b0eb7e14 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:01.055730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dd912-0193-4fa6-9775-72e3b0eb7e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:01.056005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dd912-0193-4fa6-9775-72e3b0eb7e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:01.056734 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065dd912-0193-4fa6-9775-72e3b0eb7e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:01.058356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065dd912-0193-4fa6-9775-72e3b0eb7e14 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:01.072388 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1208/2399] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:01.073675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a788f-3ee8-4c6c-ae6b-fb55a7fc4e21 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:01.084714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a788f-3ee8-4c6c-ae6b-fb55a7fc4e21 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:01.093567 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719fb58-e07a-4e8e-bec3-fbe2f758af59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:01.095256 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719fb58-e07a-4e8e-bec3-fbe2f758af59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:01.095565 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719fb58-e07a-4e8e-bec3-fbe2f758af59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:01.096363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719fb58-e07a-4e8e-bec3-fbe2f758af59 admin admin] PATH_INFO: `/v3/projects/23f638e0f0aa483bbef232e38449e94a/users/1e00cef51b114e65af5c1f0e24e2b488/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:01.097896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719fb58-e07a-4e8e-bec3-fbe2f758af59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f638e0f0aa483bbef232e38449e94a, user_id=1e00cef51b114e65af5c1f0e24e2b488, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:01.100594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719fb58-e07a-4e8e-bec3-fbe2f758af59 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:01.113204 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1192/2400] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:01 2022] PUT /identity/v3/projects/23f638e0f0aa483bbef232e38449e94a/users/1e00cef51b114e65af5c1f0e24e2b488/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:01.126135 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3523aa7-4c55-4cde-90dc-ec65b93c94c3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:01.126135 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3523aa7-4c55-4cde-90dc-ec65b93c94c3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:01.126135 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3523aa7-4c55-4cde-90dc-ec65b93c94c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:01.155749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e3523aa7-4c55-4cde-90dc-ec65b93c94c3 None None] MFA Rules not processed for user `1e00cef51b114e65af5c1f0e24e2b488`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:01.156992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e3523aa7-4c55-4cde-90dc-ec65b93c94c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:01.230988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1209/2401] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:01.243256 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719fb58-e07a-4e8e-bec3-fbe2f758af59 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:01.245328 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f719fb58-e07a-4e8e-bec3-fbe2f758af59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:01.308661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719fb58-e07a-4e8e-bec3-fbe2f758af59 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:01.313119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f7d9f-b568-4a53-95ab-daa63a44bf06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:01.313953 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f7d9f-b568-4a53-95ab-daa63a44bf06 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:01.314249 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f7d9f-b568-4a53-95ab-daa63a44bf06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:01.314668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f7d9f-b568-4a53-95ab-daa63a44bf06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:01.324870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f7d9f-b568-4a53-95ab-daa63a44bf06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:01.326376 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f7d9f-b568-4a53-95ab-daa63a44bf06 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:01.338016 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1193/2402] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:32:01.405534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3523aa7-4c55-4cde-90dc-ec65b93c94c3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:01.495824 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3523aa7-4c55-4cde-90dc-ec65b93c94c3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:01.501102 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4ddba-daec-4b90-86f9-4f984cf8f9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:01.503115 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ddba-daec-4b90-86f9-4f984cf8f9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:01.503397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ddba-daec-4b90-86f9-4f984cf8f9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:01.503670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ddba-daec-4b90-86f9-4f984cf8f9ea admin admin] PATH_INFO: `/v3/users/8e35f8e0ae6941688b8377d597e7331a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:01.504937 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4ddba-daec-4b90-86f9-4f984cf8f9ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e35f8e0ae6941688b8377d597e7331a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:01.507205 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4ddba-daec-4b90-86f9-4f984cf8f9ea admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:01.561827 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8fe4ddba-daec-4b90-86f9-4f984cf8f9ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e35f8e0ae6941688b8377d597e7331a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:01.570013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8fe4ddba-daec-4b90-86f9-4f984cf8f9ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e35f8e0ae6941688b8377d597e7331a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:01.570802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8fe4ddba-daec-4b90-86f9-4f984cf8f9ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e35f8e0ae6941688b8377d597e7331a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:01.571427 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8fe4ddba-daec-4b90-86f9-4f984cf8f9ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e35f8e0ae6941688b8377d597e7331a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:01.577031 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:01.590049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8fe4ddba-daec-4b90-86f9-4f984cf8f9ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e35f8e0ae6941688b8377d597e7331a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:01.607464 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1210/2403] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:32:01 2022] DELETE /identity/v3/users/8e35f8e0ae6941688b8377d597e7331a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:01.612485 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621192f-e945-4bde-946c-96cd0a5af2a1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:01.612789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621192f-e945-4bde-946c-96cd0a5af2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:01.613071 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621192f-e945-4bde-946c-96cd0a5af2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:01.634520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b621192f-e945-4bde-946c-96cd0a5af2a1 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:01.635778 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b621192f-e945-4bde-946c-96cd0a5af2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:01.696946 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1194/2404] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:01.708236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4ddba-daec-4b90-86f9-4f984cf8f9ea admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:01.709753 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8fe4ddba-daec-4b90-86f9-4f984cf8f9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:01.770696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4ddba-daec-4b90-86f9-4f984cf8f9ea admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:01.774941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350432c4-5811-4926-8cc8-cb438812e8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:01.775599 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350432c4-5811-4926-8cc8-cb438812e8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:01.775889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350432c4-5811-4926-8cc8-cb438812e8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:01.776168 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350432c4-5811-4926-8cc8-cb438812e8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:01.787223 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350432c4-5811-4926-8cc8-cb438812e8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:01.788882 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350432c4-5811-4926-8cc8-cb438812e8d5 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:01.800321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1211/2405] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:32:02.194637 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621192f-e945-4bde-946c-96cd0a5af2a1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:02.197653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b621192f-e945-4bde-946c-96cd0a5af2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:02.221431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621192f-e945-4bde-946c-96cd0a5af2a1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:02.226824 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630048c-51ce-4c25-8a8e-588700b5d23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:02.227835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630048c-51ce-4c25-8a8e-588700b5d23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:02.228306 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630048c-51ce-4c25-8a8e-588700b5d23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:02.228759 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630048c-51ce-4c25-8a8e-588700b5d23c admin admin] PATH_INFO: `/v3/projects/ca82740ba26b429a866683cd943b79b4` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:02.230164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630048c-51ce-4c25-8a8e-588700b5d23c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca82740ba26b429a866683cd943b79b4)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:02.233109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630048c-51ce-4c25-8a8e-588700b5d23c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:02.289572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:02.291772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2630048c-51ce-4c25-8a8e-588700b5d23c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca82740ba26b429a866683cd943b79b4', 'request_id': 'req-2630048c-51ce-4c25-8a8e-588700b5d23c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:02.301175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2630048c-51ce-4c25-8a8e-588700b5d23c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca82740ba26b429a866683cd943b79b4', 'request_id': 'req-2630048c-51ce-4c25-8a8e-588700b5d23c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:02.312591 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2630048c-51ce-4c25-8a8e-588700b5d23c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca82740ba26b429a866683cd943b79b4', 'request_id': 'req-2630048c-51ce-4c25-8a8e-588700b5d23c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:02.328006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2630048c-51ce-4c25-8a8e-588700b5d23c admin admin] The token cache is being invalidate because project ca82740ba26b429a866683cd943b79b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:02.328281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2630048c-51ce-4c25-8a8e-588700b5d23c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:02.328837 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2630048c-51ce-4c25-8a8e-588700b5d23c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:02.331319 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1195/2406] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:02 2022] DELETE /identity/v3/projects/ca82740ba26b429a866683cd943b79b4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:02.335145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350432c4-5811-4926-8cc8-cb438812e8d5 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:02.346770 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350432c4-5811-4926-8cc8-cb438812e8d5 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:02.456969 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a240aa-7667-4305-a13d-deed2bb9fd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:02.458053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a240aa-7667-4305-a13d-deed2bb9fd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:02.458360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a240aa-7667-4305-a13d-deed2bb9fd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:02.458642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a240aa-7667-4305-a13d-deed2bb9fd7d admin admin] PATH_INFO: `/v3/users/1e00cef51b114e65af5c1f0e24e2b488` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:02.460165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a240aa-7667-4305-a13d-deed2bb9fd7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e00cef51b114e65af5c1f0e24e2b488)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:02.462180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a240aa-7667-4305-a13d-deed2bb9fd7d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:02.521584 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73a240aa-7667-4305-a13d-deed2bb9fd7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e00cef51b114e65af5c1f0e24e2b488'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:02.538967 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73a240aa-7667-4305-a13d-deed2bb9fd7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e00cef51b114e65af5c1f0e24e2b488'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:02.539851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73a240aa-7667-4305-a13d-deed2bb9fd7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e00cef51b114e65af5c1f0e24e2b488'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:02.540639 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73a240aa-7667-4305-a13d-deed2bb9fd7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e00cef51b114e65af5c1f0e24e2b488'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:02.558705 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73a240aa-7667-4305-a13d-deed2bb9fd7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e00cef51b114e65af5c1f0e24e2b488'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:02.584971 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1212/2407] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:32:02 2022] DELETE /identity/v3/users/1e00cef51b114e65af5c1f0e24e2b488 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:02.953265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630048c-51ce-4c25-8a8e-588700b5d23c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:02.955287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2630048c-51ce-4c25-8a8e-588700b5d23c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:02.982588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630048c-51ce-4c25-8a8e-588700b5d23c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:03.056672 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e995d-c63f-41fc-a116-0192650ed1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:03.056672 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e995d-c63f-41fc-a116-0192650ed1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:03.056672 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e995d-c63f-41fc-a116-0192650ed1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:03.056992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e995d-c63f-41fc-a116-0192650ed1c9 admin admin] PATH_INFO: `/v3/projects/23f638e0f0aa483bbef232e38449e94a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:03.058179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e995d-c63f-41fc-a116-0192650ed1c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f638e0f0aa483bbef232e38449e94a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:03.060230 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e995d-c63f-41fc-a116-0192650ed1c9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:03.131959 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ee6e995d-c63f-41fc-a116-0192650ed1c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f638e0f0aa483bbef232e38449e94a', 'request_id': 'req-ee6e995d-c63f-41fc-a116-0192650ed1c9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:03.141224 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ee6e995d-c63f-41fc-a116-0192650ed1c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f638e0f0aa483bbef232e38449e94a', 'request_id': 'req-ee6e995d-c63f-41fc-a116-0192650ed1c9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:03.150388 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ee6e995d-c63f-41fc-a116-0192650ed1c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f638e0f0aa483bbef232e38449e94a', 'request_id': 'req-ee6e995d-c63f-41fc-a116-0192650ed1c9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:03.163152 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ee6e995d-c63f-41fc-a116-0192650ed1c9 admin admin] The token cache is being invalidate because project 23f638e0f0aa483bbef232e38449e94a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:03.163447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ee6e995d-c63f-41fc-a116-0192650ed1c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:03.164334 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ee6e995d-c63f-41fc-a116-0192650ed1c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:03.167529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1196/2408] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:02 2022] DELETE /identity/v3/projects/23f638e0f0aa483bbef232e38449e94a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:03.173834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c41d1-0d30-4cc5-ba7f-6c5efb58c0d0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:03.174026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c41d1-0d30-4cc5-ba7f-6c5efb58c0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:03.174335 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c41d1-0d30-4cc5-ba7f-6c5efb58c0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:03.180982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:03.197531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b89c41d1-0d30-4cc5-ba7f-6c5efb58c0d0 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:03.198851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b89c41d1-0d30-4cc5-ba7f-6c5efb58c0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:03.280286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1213/2409] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:03.289522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481b53d-d160-4298-855c-ae9960516d6d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:03.290073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481b53d-d160-4298-855c-ae9960516d6d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:03.290073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481b53d-d160-4298-855c-ae9960516d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:03.312686 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3481b53d-d160-4298-855c-ae9960516d6d None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:03.314816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3481b53d-d160-4298-855c-ae9960516d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:03.324437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1197/2410] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:03.328842 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c41d1-0d30-4cc5-ba7f-6c5efb58c0d0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:03.342376 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c41d1-0d30-4cc5-ba7f-6c5efb58c0d0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:03.351271 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3802b89-ac02-41f5-b893-3710f3f6ced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:03.352444 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3802b89-ac02-41f5-b893-3710f3f6ced6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:03.352908 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3802b89-ac02-41f5-b893-3710f3f6ced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:03.353404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3802b89-ac02-41f5-b893-3710f3f6ced6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:03.354978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3802b89-ac02-41f5-b893-3710f3f6ced6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:32:03.355505 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3802b89-ac02-41f5-b893-3710f3f6ced6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:03.358927 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3802b89-ac02-41f5-b893-3710f3f6ced6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:03.378493 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1214/2411] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:32:03.379527 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481b53d-d160-4298-855c-ae9960516d6d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:03.389906 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481b53d-d160-4298-855c-ae9960516d6d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:03.395251 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ac705-c67b-4faf-b13d-3bbfd971beb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:03.395942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ac705-c67b-4faf-b13d-3bbfd971beb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:03.396223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ac705-c67b-4faf-b13d-3bbfd971beb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:03.396495 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ac705-c67b-4faf-b13d-3bbfd971beb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:03.397193 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ac705-c67b-4faf-b13d-3bbfd971beb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:03.399172 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ac705-c67b-4faf-b13d-3bbfd971beb6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:03.431664 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1198/2412] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:03 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:03.433484 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3802b89-ac02-41f5-b893-3710f3f6ced6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:03.445366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3802b89-ac02-41f5-b893-3710f3f6ced6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:03.519056 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf5326-ded4-4aae-abbb-5890389173c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:03.519771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf5326-ded4-4aae-abbb-5890389173c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:03.520079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf5326-ded4-4aae-abbb-5890389173c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:03.520377 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf5326-ded4-4aae-abbb-5890389173c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:03.521040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf5326-ded4-4aae-abbb-5890389173c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:03.523081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf5326-ded4-4aae-abbb-5890389173c3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:03.548961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1215/2413] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:32:03 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:03.553371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ac705-c67b-4faf-b13d-3bbfd971beb6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:03.566839 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ac705-c67b-4faf-b13d-3bbfd971beb6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:03.577917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ee458-7ed8-49d7-8a19-834a4c7570dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:03.579079 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ee458-7ed8-49d7-8a19-834a4c7570dc admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:03.579562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ee458-7ed8-49d7-8a19-834a4c7570dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:03.579933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ee458-7ed8-49d7-8a19-834a4c7570dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:03.580952 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ee458-7ed8-49d7-8a19-834a4c7570dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:03.582916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ee458-7ed8-49d7-8a19-834a4c7570dc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:03.596229 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1199/2414] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:03.600674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf5326-ded4-4aae-abbb-5890389173c3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:03.612056 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf5326-ded4-4aae-abbb-5890389173c3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:03.618284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa93e75-4ea7-4e3a-b293-aa14e1b65db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:03.618995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa93e75-4ea7-4e3a-b293-aa14e1b65db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:03.619286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa93e75-4ea7-4e3a-b293-aa14e1b65db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:03.619570 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa93e75-4ea7-4e3a-b293-aa14e1b65db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:03.620315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa93e75-4ea7-4e3a-b293-aa14e1b65db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:03.621947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa93e75-4ea7-4e3a-b293-aa14e1b65db0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:03.637289 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1216/2415] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:03.642105 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ee458-7ed8-49d7-8a19-834a4c7570dc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:03.653147 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ee458-7ed8-49d7-8a19-834a4c7570dc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:03.658262 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d213360-cd49-43c0-a0f4-be03ac0f33d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:03.659226 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d213360-cd49-43c0-a0f4-be03ac0f33d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:03.659480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d213360-cd49-43c0-a0f4-be03ac0f33d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:03.659756 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d213360-cd49-43c0-a0f4-be03ac0f33d8 admin admin] PATH_INFO: `/v3/projects/5caefcae86b74ad3938101ead1b3adba/users/e9a3469027814feaa7bbd0d2d4d53db0/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:03.679585 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d213360-cd49-43c0-a0f4-be03ac0f33d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5caefcae86b74ad3938101ead1b3adba, user_id=e9a3469027814feaa7bbd0d2d4d53db0, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:03.682694 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d213360-cd49-43c0-a0f4-be03ac0f33d8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:03.697910 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1200/2416] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:03 2022] PUT /identity/v3/projects/5caefcae86b74ad3938101ead1b3adba/users/e9a3469027814feaa7bbd0d2d4d53db0/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:32:03.703468 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71837c5-4a0a-4431-9b39-d1ddf3b847f7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:03.703794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71837c5-4a0a-4431-9b39-d1ddf3b847f7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:03.704181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71837c5-4a0a-4431-9b39-d1ddf3b847f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:03.725525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c71837c5-4a0a-4431-9b39-d1ddf3b847f7 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:03.726841 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c71837c5-4a0a-4431-9b39-d1ddf3b847f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:03.796388 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1217/2417] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:03.808152 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d213360-cd49-43c0-a0f4-be03ac0f33d8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:03.810298 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2d213360-cd49-43c0-a0f4-be03ac0f33d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:03.816986 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:03.882145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d213360-cd49-43c0-a0f4-be03ac0f33d8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:03.886489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66c3f9-674f-4654-9d4c-39341b95aa39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:03.887151 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66c3f9-674f-4654-9d4c-39341b95aa39 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:03.887439 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66c3f9-674f-4654-9d4c-39341b95aa39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:03.887727 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66c3f9-674f-4654-9d4c-39341b95aa39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:03.899198 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66c3f9-674f-4654-9d4c-39341b95aa39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:03.901933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66c3f9-674f-4654-9d4c-39341b95aa39 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:03.917436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1201/2418] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:32:04.770490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fe464-520b-4cb9-afb0-a73f4c0f4824 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:04.771442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fe464-520b-4cb9-afb0-a73f4c0f4824 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:04.771974 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fe464-520b-4cb9-afb0-a73f4c0f4824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:04.793884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:04.805990 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b20fe464-520b-4cb9-afb0-a73f4c0f4824 None None] MFA Rules not processed for user `e9a3469027814feaa7bbd0d2d4d53db0`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:04.808666 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b20fe464-520b-4cb9-afb0-a73f4c0f4824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:04.902686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1218/2419] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:04.906868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66c3f9-674f-4654-9d4c-39341b95aa39 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:04.917723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66c3f9-674f-4654-9d4c-39341b95aa39 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:04.924913 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03262ffc-4599-461e-a994-2cadcd4c739a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:04.925613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262ffc-4599-461e-a994-2cadcd4c739a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:04.925900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262ffc-4599-461e-a994-2cadcd4c739a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:04.926183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262ffc-4599-461e-a994-2cadcd4c739a admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:04.927180 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03262ffc-4599-461e-a994-2cadcd4c739a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:04.930580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03262ffc-4599-461e-a994-2cadcd4c739a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:04.983847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1202/2420] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:04 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:04.987984 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fe464-520b-4cb9-afb0-a73f4c0f4824 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:05.004334 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fe464-520b-4cb9-afb0-a73f4c0f4824 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:05.092870 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cbf4b-b18e-4319-ae36-5ab5c2b80f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:05.093695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cbf4b-b18e-4319-ae36-5ab5c2b80f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:05.094038 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cbf4b-b18e-4319-ae36-5ab5c2b80f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:05.094434 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cbf4b-b18e-4319-ae36-5ab5c2b80f67 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:05.095820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cbf4b-b18e-4319-ae36-5ab5c2b80f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:05.098093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cbf4b-b18e-4319-ae36-5ab5c2b80f67 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:05.124717 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1219/2421] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:32:04 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:05.129938 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03262ffc-4599-461e-a994-2cadcd4c739a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:05.145954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03262ffc-4599-461e-a994-2cadcd4c739a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:05.151490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9ed4a-f755-404d-96bd-171895656f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:05.152113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9ed4a-f755-404d-96bd-171895656f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:05.152322 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9ed4a-f755-404d-96bd-171895656f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:05.152755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9ed4a-f755-404d-96bd-171895656f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:05.153730 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9ed4a-f755-404d-96bd-171895656f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:05.155870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9ed4a-f755-404d-96bd-171895656f97 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:05.171326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1203/2422] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:05.176171 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cbf4b-b18e-4319-ae36-5ab5c2b80f67 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:05.188214 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cbf4b-b18e-4319-ae36-5ab5c2b80f67 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:05.195165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f42d2-1e96-49f9-b27d-bced5520e1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:05.196273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f42d2-1e96-49f9-b27d-bced5520e1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:05.196631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f42d2-1e96-49f9-b27d-bced5520e1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:05.196984 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f42d2-1e96-49f9-b27d-bced5520e1eb admin admin] PATH_INFO: `/v3/projects/3e0bb06931f243a7b425a3b37ac271b5/users/74af58b2c44f4e5cb56eeb9aa2bf1ae0/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:05.216913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f42d2-1e96-49f9-b27d-bced5520e1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0bb06931f243a7b425a3b37ac271b5, user_id=74af58b2c44f4e5cb56eeb9aa2bf1ae0, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:05.219966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f42d2-1e96-49f9-b27d-bced5520e1eb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:05.234014 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1220/2423] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:05 2022] PUT /identity/v3/projects/3e0bb06931f243a7b425a3b37ac271b5/users/74af58b2c44f4e5cb56eeb9aa2bf1ae0/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:05.239072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9ed4a-f755-404d-96bd-171895656f97 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:05.252212 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9ed4a-f755-404d-96bd-171895656f97 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:05.319253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382daa8-d3c2-4a5f-9bd0-c8c24c5c78cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:05.320110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382daa8-d3c2-4a5f-9bd0-c8c24c5c78cc admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:05.320393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382daa8-d3c2-4a5f-9bd0-c8c24c5c78cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:05.320847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382daa8-d3c2-4a5f-9bd0-c8c24c5c78cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:05.321630 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382daa8-d3c2-4a5f-9bd0-c8c24c5c78cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:05.323575 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382daa8-d3c2-4a5f-9bd0-c8c24c5c78cc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:05.336956 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1204/2424] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:32:05.343442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f42d2-1e96-49f9-b27d-bced5520e1eb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:05.359085 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f42d2-1e96-49f9-b27d-bced5520e1eb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:05.368073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbc58b-241e-4eda-938c-4f83306ab5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:05.369865 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbc58b-241e-4eda-938c-4f83306ab5a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:05.370122 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbc58b-241e-4eda-938c-4f83306ab5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:05.370780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbc58b-241e-4eda-938c-4f83306ab5a8 admin admin] PATH_INFO: `/v3/projects/3e0bb06931f243a7b425a3b37ac271b5/users/74af58b2c44f4e5cb56eeb9aa2bf1ae0/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:05.373158 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbc58b-241e-4eda-938c-4f83306ab5a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0bb06931f243a7b425a3b37ac271b5, user_id=74af58b2c44f4e5cb56eeb9aa2bf1ae0, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:05.377483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbc58b-241e-4eda-938c-4f83306ab5a8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:05.388615 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1221/2425] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:05 2022] PUT /identity/v3/projects/3e0bb06931f243a7b425a3b37ac271b5/users/74af58b2c44f4e5cb56eeb9aa2bf1ae0/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:06.209030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283a7f5-9dec-4fcd-8a27-a33df5188f4e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:06.209937 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283a7f5-9dec-4fcd-8a27-a33df5188f4e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:06.210403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283a7f5-9dec-4fcd-8a27-a33df5188f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:06.243344 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbc58b-241e-4eda-938c-4f83306ab5a8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:06.246590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2adbc58b-241e-4eda-938c-4f83306ab5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:06.254969 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d283a7f5-9dec-4fcd-8a27-a33df5188f4e None None] MFA Rules not processed for user `74af58b2c44f4e5cb56eeb9aa2bf1ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:06.256391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d283a7f5-9dec-4fcd-8a27-a33df5188f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:06.313058 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:06.328981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:06.337940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbc58b-241e-4eda-938c-4f83306ab5a8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:06.345993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74153f9d-fd23-4492-b57a-31385605d5a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b471b5b4ede845c7a9dfbf2a90544591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:06.356118 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1205/2426] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:06.356280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74153f9d-fd23-4492-b57a-31385605d5a5 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:06.356280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74153f9d-fd23-4492-b57a-31385605d5a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:06.356280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74153f9d-fd23-4492-b57a-31385605d5a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:06.356280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-74153f9d-fd23-4492-b57a-31385605d5a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:06.357182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61c09-c601-4465-9fd0-84ab6ae5350d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:06.357875 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61c09-c601-4465-9fd0-84ab6ae5350d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:06.358441 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61c09-c601-4465-9fd0-84ab6ae5350d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:06.361163 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74153f9d-fd23-4492-b57a-31385605d5a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:06.362820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74153f9d-fd23-4492-b57a-31385605d5a5 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:06.377232 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1222/2427] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:32:06.381877 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-49b61c09-c601-4465-9fd0-84ab6ae5350d None None] MFA Rules not processed for user `e9a3469027814feaa7bbd0d2d4d53db0`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:06.383297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-49b61c09-c601-4465-9fd0-84ab6ae5350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:06.461128 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1206/2428] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:06.473474 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74153f9d-fd23-4492-b57a-31385605d5a5 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:06.474893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-74153f9d-fd23-4492-b57a-31385605d5a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:06.569193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74153f9d-fd23-4492-b57a-31385605d5a5 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:06.575786 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa315c-914c-4193-9edf-2bcf7f8590f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:06.576513 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa315c-914c-4193-9edf-2bcf7f8590f3 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:06.576803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa315c-914c-4193-9edf-2bcf7f8590f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:06.577237 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa315c-914c-4193-9edf-2bcf7f8590f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:06.587776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa315c-914c-4193-9edf-2bcf7f8590f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:06.589545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa315c-914c-4193-9edf-2bcf7f8590f3 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:06.604454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1223/2429] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:32:07.071951 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b61c09-c601-4465-9fd0-84ab6ae5350d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:07.272564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b61c09-c601-4465-9fd0-84ab6ae5350d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:07.279628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bf4ba-3ee9-49fe-a27e-40113e5c4e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:07.280698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bf4ba-3ee9-49fe-a27e-40113e5c4e4c service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:07.281265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bf4ba-3ee9-49fe-a27e-40113e5c4e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:07.281696 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bf4ba-3ee9-49fe-a27e-40113e5c4e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:07.285703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b73bf4ba-3ee9-49fe-a27e-40113e5c4e4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:07.301510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bf4ba-3ee9-49fe-a27e-40113e5c4e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:07.303190 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bf4ba-3ee9-49fe-a27e-40113e5c4e4c service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:07.315791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1207/2430] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:32:09.430415 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4e69c-f805-4fc5-8b2d-899ce7b10453 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:09.431848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4e69c-f805-4fc5-8b2d-899ce7b10453 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:09.432668 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4e69c-f805-4fc5-8b2d-899ce7b10453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:09.466947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-17b4e69c-f805-4fc5-8b2d-899ce7b10453 None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:09.470307 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-17b4e69c-f805-4fc5-8b2d-899ce7b10453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:09.574489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1224/2431] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 27 15:32:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:09.591854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bf4ba-3ee9-49fe-a27e-40113e5c4e4c service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:09.593591 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b73bf4ba-3ee9-49fe-a27e-40113e5c4e4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:09.714362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bf4ba-3ee9-49fe-a27e-40113e5c4e4c service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:09.719941 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04792c44-fe54-4fda-98ec-81164c06b424 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:09.720711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04792c44-fe54-4fda-98ec-81164c06b424 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:09.721001 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04792c44-fe54-4fda-98ec-81164c06b424 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:09.721281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04792c44-fe54-4fda-98ec-81164c06b424 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:09.731066 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04792c44-fe54-4fda-98ec-81164c06b424 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:09.732712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04792c44-fe54-4fda-98ec-81164c06b424 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:09.742984 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1208/2432] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:32:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:32:19.564256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=68 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:19.738565 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=86 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:20.292728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4e69c-f805-4fc5-8b2d-899ce7b10453 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:20.305088 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4e69c-f805-4fc5-8b2d-899ce7b10453 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:20.311042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda5f0f-9d03-4227-9304-cada0587dbdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:20.312297 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda5f0f-9d03-4227-9304-cada0587dbdc service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:20.312581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda5f0f-9d03-4227-9304-cada0587dbdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:20.312923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda5f0f-9d03-4227-9304-cada0587dbdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:20.316007 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4bda5f0f-9d03-4227-9304-cada0587dbdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:20.418577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda5f0f-9d03-4227-9304-cada0587dbdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:20.420112 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda5f0f-9d03-4227-9304-cada0587dbdc service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:20.432671 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1225/2433] 10.222.0.33 () {60 vars in 1396 bytes} [Mon Jun 27 15:32:20 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3238 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:32:23.582970 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04792c44-fe54-4fda-98ec-81164c06b424 service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:23.584906 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-04792c44-fe54-4fda-98ec-81164c06b424 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:23.603273 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04792c44-fe54-4fda-98ec-81164c06b424 service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:23.609563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ce090-7542-40a7-a354-d8a22f48468f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a36c30e9dc472d97d762d236dd865a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:23.610421 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ce090-7542-40a7-a354-d8a22f48468f service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:23.610782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ce090-7542-40a7-a354-d8a22f48468f service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:23.611130 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ce090-7542-40a7-a354-d8a22f48468f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:23.613069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7e0ce090-7542-40a7-a354-d8a22f48468f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:23.628728 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ce090-7542-40a7-a354-d8a22f48468f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:23.630482 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ce090-7542-40a7-a354-d8a22f48468f service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:23.644542 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1209/2434] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:32:26.323695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda5f0f-9d03-4227-9304-cada0587dbdc service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:26.326969 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4bda5f0f-9d03-4227-9304-cada0587dbdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:26.348242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda5f0f-9d03-4227-9304-cada0587dbdc service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:26.356395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce4e59-cec4-439e-98d6-2f121f4bfe23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:26.357526 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce4e59-cec4-439e-98d6-2f121f4bfe23 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:26.358454 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce4e59-cec4-439e-98d6-2f121f4bfe23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:26.358574 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce4e59-cec4-439e-98d6-2f121f4bfe23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:26.361964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-11ce4e59-cec4-439e-98d6-2f121f4bfe23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:26.471820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce4e59-cec4-439e-98d6-2f121f4bfe23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:26.473325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce4e59-cec4-439e-98d6-2f121f4bfe23 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:26.485966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1226/2435] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:32:26.807594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88c832-9614-4769-88cc-30a9216409fa None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:26.808507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88c832-9614-4769-88cc-30a9216409fa None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:26.808995 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88c832-9614-4769-88cc-30a9216409fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:26.837213 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6c88c832-9614-4769-88cc-30a9216409fa None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:26.840140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6c88c832-9614-4769-88cc-30a9216409fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:26.856199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1210/2436] 10.222.0.33 () {58 vars in 967 bytes} [Mon Jun 27 15:32:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:26.894129 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce4e59-cec4-439e-98d6-2f121f4bfe23 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:26.916954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce4e59-cec4-439e-98d6-2f121f4bfe23 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:26.924022 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd906c2-5ca7-450c-9c52-69d64c0ee625 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:26.925536 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd906c2-5ca7-450c-9c52-69d64c0ee625 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:26.926056 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd906c2-5ca7-450c-9c52-69d64c0ee625 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:26.926596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd906c2-5ca7-450c-9c52-69d64c0ee625 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:26.937055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd906c2-5ca7-450c-9c52-69d64c0ee625 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:26.938941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd906c2-5ca7-450c-9c52-69d64c0ee625 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:26.950022 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1227/2437] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:32:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 15:32:31.747558 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88c832-9614-4769-88cc-30a9216409fa None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:31.749181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6c88c832-9614-4769-88cc-30a9216409fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:31.768456 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88c832-9614-4769-88cc-30a9216409fa None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:31.777199 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76611a5a-dec4-4ad4-b2d3-a219999a62f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b471b5b4ede845c7a9dfbf2a90544591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:31.778474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76611a5a-dec4-4ad4-b2d3-a219999a62f7 service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:31.791494 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76611a5a-dec4-4ad4-b2d3-a219999a62f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:31.792107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76611a5a-dec4-4ad4-b2d3-a219999a62f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:31.795648 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-76611a5a-dec4-4ad4-b2d3-a219999a62f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:31.816582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76611a5a-dec4-4ad4-b2d3-a219999a62f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:31.819167 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76611a5a-dec4-4ad4-b2d3-a219999a62f7 service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:31.855896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1211/2438] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:32:32.845464 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd906c2-5ca7-450c-9c52-69d64c0ee625 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:32.866495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd906c2-5ca7-450c-9c52-69d64c0ee625 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:32.866495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f33d-42a4-4bf4-a65b-5e73a69a9f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:32.866495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f33d-42a4-4bf4-a65b-5e73a69a9f04 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:32.866495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f33d-42a4-4bf4-a65b-5e73a69a9f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:32.866842 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f33d-42a4-4bf4-a65b-5e73a69a9f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:32.866842 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d7d2f33d-42a4-4bf4-a65b-5e73a69a9f04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:32.881857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2f33d-42a4-4bf4-a65b-5e73a69a9f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:32.881857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2f33d-42a4-4bf4-a65b-5e73a69a9f04 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:32.882205 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76611a5a-dec4-4ad4-b2d3-a219999a62f7 service placement] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:32.882205 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-76611a5a-dec4-4ad4-b2d3-a219999a62f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:32.890804 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1228/2439] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:32:32.978751 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76611a5a-dec4-4ad4-b2d3-a219999a62f7 service placement] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:32.985552 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f31f9-67a9-4e02-b83b-237ed9ddd7ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:32.987143 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f31f9-67a9-4e02-b83b-237ed9ddd7ec service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:32.987801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f31f9-67a9-4e02-b83b-237ed9ddd7ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:32.988478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f31f9-67a9-4e02-b83b-237ed9ddd7ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:33.007501 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f31f9-67a9-4e02-b83b-237ed9ddd7ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:33.010688 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f31f9-67a9-4e02-b83b-237ed9ddd7ec service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:33.027112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1212/2440] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:32:33.182814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f33d-42a4-4bf4-a65b-5e73a69a9f04 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:33.201455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f33d-42a4-4bf4-a65b-5e73a69a9f04 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:33.206882 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180b19a-2d67-4a72-8796-27ee4db434dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:33.208559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180b19a-2d67-4a72-8796-27ee4db434dd service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:33.209355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180b19a-2d67-4a72-8796-27ee4db434dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:33.210354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180b19a-2d67-4a72-8796-27ee4db434dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:33.214881 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6180b19a-2d67-4a72-8796-27ee4db434dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:33.254780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180b19a-2d67-4a72-8796-27ee4db434dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:33.261136 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180b19a-2d67-4a72-8796-27ee4db434dd service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:33.280222 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1229/2441] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:32:38.137693 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f31f9-67a9-4e02-b83b-237ed9ddd7ec service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:38.141069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bc1f31f9-67a9-4e02-b83b-237ed9ddd7ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:38.164251 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f31f9-67a9-4e02-b83b-237ed9ddd7ec service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:38.171378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa111856-82b6-41b2-87ef-0da54bdfc4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:38.172961 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa111856-82b6-41b2-87ef-0da54bdfc4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:38.172961 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa111856-82b6-41b2-87ef-0da54bdfc4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:38.173297 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa111856-82b6-41b2-87ef-0da54bdfc4af admin admin] PATH_INFO: `/v3/users/77ff2c22fc684248b9cff546e5eefd6b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:38.174928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa111856-82b6-41b2-87ef-0da54bdfc4af admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ff2c22fc684248b9cff546e5eefd6b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:38.179505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa111856-82b6-41b2-87ef-0da54bdfc4af admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:38.343534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fa111856-82b6-41b2-87ef-0da54bdfc4af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ff2c22fc684248b9cff546e5eefd6b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:38.360523 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fa111856-82b6-41b2-87ef-0da54bdfc4af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ff2c22fc684248b9cff546e5eefd6b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:38.382635 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fa111856-82b6-41b2-87ef-0da54bdfc4af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ff2c22fc684248b9cff546e5eefd6b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:38.383616 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fa111856-82b6-41b2-87ef-0da54bdfc4af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ff2c22fc684248b9cff546e5eefd6b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:38.417876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fa111856-82b6-41b2-87ef-0da54bdfc4af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ff2c22fc684248b9cff546e5eefd6b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:38.437061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1213/2442] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:32:38 2022] DELETE /identity/v3/users/77ff2c22fc684248b9cff546e5eefd6b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:39.124181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180b19a-2d67-4a72-8796-27ee4db434dd service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:39.130700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6180b19a-2d67-4a72-8796-27ee4db434dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:39.152810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180b19a-2d67-4a72-8796-27ee4db434dd service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:39.175107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa111856-82b6-41b2-87ef-0da54bdfc4af admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:39.176628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fa111856-82b6-41b2-87ef-0da54bdfc4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:39.246922 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:39.260101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:39.286016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb46f21-8649-44c5-9297-414d4441994c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:39.289037 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb46f21-8649-44c5-9297-414d4441994c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:39.289957 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb46f21-8649-44c5-9297-414d4441994c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:39.290831 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb46f21-8649-44c5-9297-414d4441994c admin admin] PATH_INFO: `/v3/users/69c9809662bc441f8e95bfe2e4d069f5` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:39.296201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb46f21-8649-44c5-9297-414d4441994c admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c9809662bc441f8e95bfe2e4d069f5)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:39.299546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa111856-82b6-41b2-87ef-0da54bdfc4af admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:39.301864 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb46f21-8649-44c5-9297-414d4441994c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:39.307159 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bc988-5887-4fc3-afac-03d78a812428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:39.309402 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bc988-5887-4fc3-afac-03d78a812428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:39.310012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bc988-5887-4fc3-afac-03d78a812428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:39.310569 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bc988-5887-4fc3-afac-03d78a812428 admin admin] PATH_INFO: `/v3/projects/a45a2dd190ad4a2abe2a314993eb32e7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:39.312339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bc988-5887-4fc3-afac-03d78a812428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45a2dd190ad4a2abe2a314993eb32e7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:39.315509 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bc988-5887-4fc3-afac-03d78a812428 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:39.386461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e37bc988-5887-4fc3-afac-03d78a812428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45a2dd190ad4a2abe2a314993eb32e7', 'request_id': 'req-e37bc988-5887-4fc3-afac-03d78a812428'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.403096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e37bc988-5887-4fc3-afac-03d78a812428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45a2dd190ad4a2abe2a314993eb32e7', 'request_id': 'req-e37bc988-5887-4fc3-afac-03d78a812428'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.409919 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ddb46f21-8649-44c5-9297-414d4441994c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c9809662bc441f8e95bfe2e4d069f5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.420064 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e37bc988-5887-4fc3-afac-03d78a812428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45a2dd190ad4a2abe2a314993eb32e7', 'request_id': 'req-e37bc988-5887-4fc3-afac-03d78a812428'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.425370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ddb46f21-8649-44c5-9297-414d4441994c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c9809662bc441f8e95bfe2e4d069f5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.426347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ddb46f21-8649-44c5-9297-414d4441994c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c9809662bc441f8e95bfe2e4d069f5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.427375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ddb46f21-8649-44c5-9297-414d4441994c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c9809662bc441f8e95bfe2e4d069f5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.457870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e37bc988-5887-4fc3-afac-03d78a812428 admin admin] The token cache is being invalidate because project a45a2dd190ad4a2abe2a314993eb32e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:39.458165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e37bc988-5887-4fc3-afac-03d78a812428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.459851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ddb46f21-8649-44c5-9297-414d4441994c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c9809662bc441f8e95bfe2e4d069f5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.461691 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e37bc988-5887-4fc3-afac-03d78a812428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.465327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1214/2443] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:39 2022] DELETE /identity/v3/projects/a45a2dd190ad4a2abe2a314993eb32e7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:39.471073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bc988-5887-4fc3-afac-03d78a812428 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:39.477560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e37bc988-5887-4fc3-afac-03d78a812428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:39.489528 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1230/2444] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:32:39 2022] DELETE /identity/v3/users/69c9809662bc441f8e95bfe2e4d069f5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:39.597671 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb46f21-8649-44c5-9297-414d4441994c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:39.601482 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ddb46f21-8649-44c5-9297-414d4441994c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:39.627665 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bc988-5887-4fc3-afac-03d78a812428 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:39.701241 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb46f21-8649-44c5-9297-414d4441994c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:39.717502 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f18b73-0e30-4cad-ad6f-694e277cb431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:39.718561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f18b73-0e30-4cad-ad6f-694e277cb431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:39.719106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f18b73-0e30-4cad-ad6f-694e277cb431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:39.719939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f18b73-0e30-4cad-ad6f-694e277cb431 admin admin] PATH_INFO: `/v3/users/38077d8c653b4752814a0c200eb2a713` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:39.723684 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4773a-1c16-4aba-9854-345f187b8c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:39.723985 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f18b73-0e30-4cad-ad6f-694e277cb431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38077d8c653b4752814a0c200eb2a713)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:39.725094 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4773a-1c16-4aba-9854-345f187b8c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:39.725767 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4773a-1c16-4aba-9854-345f187b8c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:39.725945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f18b73-0e30-4cad-ad6f-694e277cb431 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:39.726275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4773a-1c16-4aba-9854-345f187b8c12 admin admin] PATH_INFO: `/v3/users/6a62c582f2eb4317adf756f70b29f4e2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:39.728485 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4773a-1c16-4aba-9854-345f187b8c12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a62c582f2eb4317adf756f70b29f4e2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:39.731931 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4773a-1c16-4aba-9854-345f187b8c12 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:39.782687 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:39.815413 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f6f18b73-0e30-4cad-ad6f-694e277cb431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38077d8c653b4752814a0c200eb2a713'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.824433 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7a4773a-1c16-4aba-9854-345f187b8c12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a62c582f2eb4317adf756f70b29f4e2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.828839 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f6f18b73-0e30-4cad-ad6f-694e277cb431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38077d8c653b4752814a0c200eb2a713'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.830254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f6f18b73-0e30-4cad-ad6f-694e277cb431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38077d8c653b4752814a0c200eb2a713'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.831210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f6f18b73-0e30-4cad-ad6f-694e277cb431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38077d8c653b4752814a0c200eb2a713'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.839286 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7a4773a-1c16-4aba-9854-345f187b8c12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a62c582f2eb4317adf756f70b29f4e2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.849425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7a4773a-1c16-4aba-9854-345f187b8c12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a62c582f2eb4317adf756f70b29f4e2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.850253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7a4773a-1c16-4aba-9854-345f187b8c12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a62c582f2eb4317adf756f70b29f4e2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.856626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f6f18b73-0e30-4cad-ad6f-694e277cb431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38077d8c653b4752814a0c200eb2a713'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.858765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:39.875239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7a4773a-1c16-4aba-9854-345f187b8c12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a62c582f2eb4317adf756f70b29f4e2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:39.880087 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1231/2445] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:32:39 2022] DELETE /identity/v3/users/38077d8c653b4752814a0c200eb2a713 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:39.883103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f18b73-0e30-4cad-ad6f-694e277cb431 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:39.884914 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1215/2446] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:32:39 2022] DELETE /identity/v3/users/6a62c582f2eb4317adf756f70b29f4e2 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:39.888516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f6f18b73-0e30-4cad-ad6f-694e277cb431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:39.987399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f18b73-0e30-4cad-ad6f-694e277cb431 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:40.109010 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e1dd8-cbb4-49e4-bc94-264de71238d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:40.111221 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e1dd8-cbb4-49e4-bc94-264de71238d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:40.111614 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e1dd8-cbb4-49e4-bc94-264de71238d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:40.111983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e1dd8-cbb4-49e4-bc94-264de71238d8 admin admin] PATH_INFO: `/v3/projects/e79c93921a6444e68048cf12a02baa24` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:40.113859 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e1dd8-cbb4-49e4-bc94-264de71238d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e79c93921a6444e68048cf12a02baa24)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:40.116687 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e1dd8-cbb4-49e4-bc94-264de71238d8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:40.167497 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4773a-1c16-4aba-9854-345f187b8c12 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:40.169132 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f7a4773a-1c16-4aba-9854-345f187b8c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:40.202281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4773a-1c16-4aba-9854-345f187b8c12 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:40.221344 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f1623-4cba-4d03-94d4-285558dd2213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:40.222303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f1623-4cba-4d03-94d4-285558dd2213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:40.222628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f1623-4cba-4d03-94d4-285558dd2213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:40.222899 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f1623-4cba-4d03-94d4-285558dd2213 admin admin] PATH_INFO: `/v3/projects/247c9ecd4c644b588fc9755fa6b8561c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:40.224497 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f1623-4cba-4d03-94d4-285558dd2213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=247c9ecd4c644b588fc9755fa6b8561c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:40.226792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f1623-4cba-4d03-94d4-285558dd2213 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:40.232109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-788e1dd8-cbb4-49e4-bc94-264de71238d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e79c93921a6444e68048cf12a02baa24', 'request_id': 'req-788e1dd8-cbb4-49e4-bc94-264de71238d8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:40.242763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-788e1dd8-cbb4-49e4-bc94-264de71238d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e79c93921a6444e68048cf12a02baa24', 'request_id': 'req-788e1dd8-cbb4-49e4-bc94-264de71238d8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:40.253658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-788e1dd8-cbb4-49e4-bc94-264de71238d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e79c93921a6444e68048cf12a02baa24', 'request_id': 'req-788e1dd8-cbb4-49e4-bc94-264de71238d8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:40.274086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-788e1dd8-cbb4-49e4-bc94-264de71238d8 admin admin] The token cache is being invalidate because project e79c93921a6444e68048cf12a02baa24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:40.275055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-788e1dd8-cbb4-49e4-bc94-264de71238d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:40.275981 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-788e1dd8-cbb4-49e4-bc94-264de71238d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:40.278145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1232/2447] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:39 2022] DELETE /identity/v3/projects/e79c93921a6444e68048cf12a02baa24 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:40.282715 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e1dd8-cbb4-49e4-bc94-264de71238d8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:40.284439 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-788e1dd8-cbb4-49e4-bc94-264de71238d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:40.304036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e8f1623-4cba-4d03-94d4-285558dd2213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247c9ecd4c644b588fc9755fa6b8561c', 'request_id': 'req-6e8f1623-4cba-4d03-94d4-285558dd2213'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:40.313505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e8f1623-4cba-4d03-94d4-285558dd2213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247c9ecd4c644b588fc9755fa6b8561c', 'request_id': 'req-6e8f1623-4cba-4d03-94d4-285558dd2213'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:40.320789 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e8f1623-4cba-4d03-94d4-285558dd2213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247c9ecd4c644b588fc9755fa6b8561c', 'request_id': 'req-6e8f1623-4cba-4d03-94d4-285558dd2213'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:40.328372 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:40.336150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e8f1623-4cba-4d03-94d4-285558dd2213 admin admin] The token cache is being invalidate because project 247c9ecd4c644b588fc9755fa6b8561c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:40.336425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e8f1623-4cba-4d03-94d4-285558dd2213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:40.337112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e8f1623-4cba-4d03-94d4-285558dd2213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:40.338750 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1216/2448] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:40 2022] DELETE /identity/v3/projects/247c9ecd4c644b588fc9755fa6b8561c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:40.354534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803009f-1d3b-4c62-827f-353002250025 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:40.354534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803009f-1d3b-4c62-827f-353002250025 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:40.354534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803009f-1d3b-4c62-827f-353002250025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:40.361692 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2803009f-1d3b-4c62-827f-353002250025 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:40.363149 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2803009f-1d3b-4c62-827f-353002250025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:40.374772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e1dd8-cbb4-49e4-bc94-264de71238d8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:40.449257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43942621-f22c-436c-ada5-5adb28ba4d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:40.450676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43942621-f22c-436c-ada5-5adb28ba4d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:40.451032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43942621-f22c-436c-ada5-5adb28ba4d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:40.451379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43942621-f22c-436c-ada5-5adb28ba4d77 admin admin] PATH_INFO: `/v3/projects/54ff223e3ce3434d85ee5215f102cc9e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:40.452983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43942621-f22c-436c-ada5-5adb28ba4d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ff223e3ce3434d85ee5215f102cc9e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:40.455627 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43942621-f22c-436c-ada5-5adb28ba4d77 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:40.470976 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1217/2449] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:40.479986 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9a944-c493-4e52-922f-ca3cb8ab344a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:40.480322 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9a944-c493-4e52-922f-ca3cb8ab344a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:40.480548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9a944-c493-4e52-922f-ca3cb8ab344a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:40.506712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-22e9a944-c493-4e52-922f-ca3cb8ab344a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:40.508165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-22e9a944-c493-4e52-922f-ca3cb8ab344a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:40.532837 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:40.539302 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-43942621-f22c-436c-ada5-5adb28ba4d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ff223e3ce3434d85ee5215f102cc9e', 'request_id': 'req-43942621-f22c-436c-ada5-5adb28ba4d77'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:40.548739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-43942621-f22c-436c-ada5-5adb28ba4d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ff223e3ce3434d85ee5215f102cc9e', 'request_id': 'req-43942621-f22c-436c-ada5-5adb28ba4d77'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:40.557525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-43942621-f22c-436c-ada5-5adb28ba4d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ff223e3ce3434d85ee5215f102cc9e', 'request_id': 'req-43942621-f22c-436c-ada5-5adb28ba4d77'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:40.577213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-43942621-f22c-436c-ada5-5adb28ba4d77 admin admin] The token cache is being invalidate because project 54ff223e3ce3434d85ee5215f102cc9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:40.578156 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-43942621-f22c-436c-ada5-5adb28ba4d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:40.579362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-43942621-f22c-436c-ada5-5adb28ba4d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:40.584532 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1233/2450] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:40 2022] DELETE /identity/v3/projects/54ff223e3ce3434d85ee5215f102cc9e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:40.591624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967bdbf-7a89-4e48-92b4-062baa0c671a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:40.591916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967bdbf-7a89-4e48-92b4-062baa0c671a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:40.592176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967bdbf-7a89-4e48-92b4-062baa0c671a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:40.614015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0967bdbf-7a89-4e48-92b4-062baa0c671a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:40.615631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0967bdbf-7a89-4e48-92b4-062baa0c671a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:40.632009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1218/2451] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:40.636534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9a944-c493-4e52-922f-ca3cb8ab344a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:40.647480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9a944-c493-4e52-922f-ca3cb8ab344a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:40.652605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09606bb9-f76c-4da3-8fd4-f84e95e42b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:40.653303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09606bb9-f76c-4da3-8fd4-f84e95e42b6d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:40.653608 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09606bb9-f76c-4da3-8fd4-f84e95e42b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:40.653857 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09606bb9-f76c-4da3-8fd4-f84e95e42b6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:40.654642 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09606bb9-f76c-4da3-8fd4-f84e95e42b6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:32:40.654950 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09606bb9-f76c-4da3-8fd4-f84e95e42b6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:40.656729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09606bb9-f76c-4da3-8fd4-f84e95e42b6d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:40.675699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1219/2452] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:32:40.676728 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09606bb9-f76c-4da3-8fd4-f84e95e42b6d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:40.688075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09606bb9-f76c-4da3-8fd4-f84e95e42b6d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:40.694246 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93bf17-1786-4d90-bbf2-23cbe4ad8369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:40.696212 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93bf17-1786-4d90-bbf2-23cbe4ad8369 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:40.696537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93bf17-1786-4d90-bbf2-23cbe4ad8369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:40.696823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93bf17-1786-4d90-bbf2-23cbe4ad8369 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:40.697584 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93bf17-1786-4d90-bbf2-23cbe4ad8369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:40.698541 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1234/2453] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:40.699805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93bf17-1786-4d90-bbf2-23cbe4ad8369 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:40.705338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99991d-0869-438b-ac1d-34488e852297 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:40.705627 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99991d-0869-438b-ac1d-34488e852297 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:40.705912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99991d-0869-438b-ac1d-34488e852297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:40.718607 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:40.725752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6b99991d-0869-438b-ac1d-34488e852297 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:40.728518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6b99991d-0869-438b-ac1d-34488e852297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:40.734152 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1220/2454] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:40 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:40.738728 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93bf17-1786-4d90-bbf2-23cbe4ad8369 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:40.739376 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1235/2455] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:40.743694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99991d-0869-438b-ac1d-34488e852297 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:40.754121 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99991d-0869-438b-ac1d-34488e852297 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:40.817163 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde2272-37cb-4634-a718-2773beb8ba42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:40.817471 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93bf17-1786-4d90-bbf2-23cbe4ad8369 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:40.817662 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde2272-37cb-4634-a718-2773beb8ba42 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:40.817860 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde2272-37cb-4634-a718-2773beb8ba42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:40.818173 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde2272-37cb-4634-a718-2773beb8ba42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:40.818943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde2272-37cb-4634-a718-2773beb8ba42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:32:40.819251 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde2272-37cb-4634-a718-2773beb8ba42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:40.820983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde2272-37cb-4634-a718-2773beb8ba42 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:40.823658 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110beb53-fa73-4503-8686-da8c9dadac66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:40.824929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110beb53-fa73-4503-8686-da8c9dadac66 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:40.830158 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110beb53-fa73-4503-8686-da8c9dadac66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:40.830158 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110beb53-fa73-4503-8686-da8c9dadac66 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:40.830158 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110beb53-fa73-4503-8686-da8c9dadac66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:40.830158 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110beb53-fa73-4503-8686-da8c9dadac66 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:40.835739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1236/2456] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:32:40.840261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde2272-37cb-4634-a718-2773beb8ba42 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:40.851588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde2272-37cb-4634-a718-2773beb8ba42 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:40.855166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1221/2457] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:32:40 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:32:40.857754 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a338e63-43f9-49ae-a993-133a390f1e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:40.858746 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a338e63-43f9-49ae-a993-133a390f1e26 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:40.859028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a338e63-43f9-49ae-a993-133a390f1e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:40.859310 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a338e63-43f9-49ae-a993-133a390f1e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:40.859697 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110beb53-fa73-4503-8686-da8c9dadac66 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:40.860429 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a338e63-43f9-49ae-a993-133a390f1e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:40.862047 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a338e63-43f9-49ae-a993-133a390f1e26 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:40.871357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110beb53-fa73-4503-8686-da8c9dadac66 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:40.876490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a92b1-e86f-4feb-a050-07c9b3028054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:40.877201 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a92b1-e86f-4feb-a050-07c9b3028054 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:40.877523 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a92b1-e86f-4feb-a050-07c9b3028054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:40.877810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a92b1-e86f-4feb-a050-07c9b3028054 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:40.878601 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a92b1-e86f-4feb-a050-07c9b3028054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:40.880492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a92b1-e86f-4feb-a050-07c9b3028054 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:40.893164 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1237/2458] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:40 2022] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:40.896140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1222/2459] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:32:40.897136 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a338e63-43f9-49ae-a993-133a390f1e26 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:40.898418 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a92b1-e86f-4feb-a050-07c9b3028054 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:40.908560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a92b1-e86f-4feb-a050-07c9b3028054 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:40.967378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a338e63-43f9-49ae-a993-133a390f1e26 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:40.973241 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe609aa-8cc6-46c0-9448-412713272ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:40.973943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe609aa-8cc6-46c0-9448-412713272ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:40.974425 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe609aa-8cc6-46c0-9448-412713272ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:40.974891 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe609aa-8cc6-46c0-9448-412713272ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:40.975734 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe609aa-8cc6-46c0-9448-412713272ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:40.977379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe609aa-8cc6-46c0-9448-412713272ef3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:40.984159 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6997c9-75a8-4dc1-86ca-b00cc9e3187e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:40.984983 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6997c9-75a8-4dc1-86ca-b00cc9e3187e admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:40.985267 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6997c9-75a8-4dc1-86ca-b00cc9e3187e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:40.985543 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6997c9-75a8-4dc1-86ca-b00cc9e3187e admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:40.986275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6997c9-75a8-4dc1-86ca-b00cc9e3187e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:40.988229 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6997c9-75a8-4dc1-86ca-b00cc9e3187e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:40.988789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1238/2460] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:32:40.993501 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe609aa-8cc6-46c0-9448-412713272ef3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:40.999247 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:41.006409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe609aa-8cc6-46c0-9448-412713272ef3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:41.011812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf001316-922f-4722-8352-48dcaed1788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:41.012434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1223/2461] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:32:40 2022] POST /identity/v3/users => generated 302 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:41.014593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf001316-922f-4722-8352-48dcaed1788b admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:41.014912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf001316-922f-4722-8352-48dcaed1788b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:41.015201 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf001316-922f-4722-8352-48dcaed1788b admin admin] PATH_INFO: `/v3/projects/f41880cd8144477190f7fa37535eefa3/users/64df3f023787416dbf17847aadd0b95b/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:41.016735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6997c9-75a8-4dc1-86ca-b00cc9e3187e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:41.027165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6997c9-75a8-4dc1-86ca-b00cc9e3187e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:41.032304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4150b-ab5d-453f-8212-d6ed9fac9254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:41.032981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4150b-ab5d-453f-8212-d6ed9fac9254 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:41.033266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4150b-ab5d-453f-8212-d6ed9fac9254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:41.033546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4150b-ab5d-453f-8212-d6ed9fac9254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:41.034320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4150b-ab5d-453f-8212-d6ed9fac9254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:41.034758 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf001316-922f-4722-8352-48dcaed1788b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41880cd8144477190f7fa37535eefa3, user_id=64df3f023787416dbf17847aadd0b95b, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:41.035933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4150b-ab5d-453f-8212-d6ed9fac9254 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:41.037524 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf001316-922f-4722-8352-48dcaed1788b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:41.047332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1224/2462] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:41.051781 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4150b-ab5d-453f-8212-d6ed9fac9254 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:41.057001 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1239/2463] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:40 2022] PUT /identity/v3/projects/f41880cd8144477190f7fa37535eefa3/users/64df3f023787416dbf17847aadd0b95b/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:32:41.062894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4150b-ab5d-453f-8212-d6ed9fac9254 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:41.067909 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd55108-b7e8-4b96-9e45-4ae099b52f57 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:41.068208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd55108-b7e8-4b96-9e45-4ae099b52f57 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:41.068490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd55108-b7e8-4b96-9e45-4ae099b52f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:41.096727 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3dd55108-b7e8-4b96-9e45-4ae099b52f57 None None] MFA Rules not processed for user `64df3f023787416dbf17847aadd0b95b`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:41.097964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3dd55108-b7e8-4b96-9e45-4ae099b52f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:41.149569 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:41.154157 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780e6da-6c32-4b56-9acd-17c4e1b5f96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:41.157366 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e6da-6c32-4b56-9acd-17c4e1b5f96a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:41.157366 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e6da-6c32-4b56-9acd-17c4e1b5f96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:41.157366 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e6da-6c32-4b56-9acd-17c4e1b5f96a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:41.157366 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780e6da-6c32-4b56-9acd-17c4e1b5f96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:41.160126 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780e6da-6c32-4b56-9acd-17c4e1b5f96a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:41.177873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1225/2464] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:32:41.179006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780e6da-6c32-4b56-9acd-17c4e1b5f96a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:41.190477 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1240/2465] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:41.192024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780e6da-6c32-4b56-9acd-17c4e1b5f96a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:41.194069 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd55108-b7e8-4b96-9e45-4ae099b52f57 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:41.199652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4f44a-95ab-4f9d-aa21-4b74ec6f8235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:41.199652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4f44a-95ab-4f9d-aa21-4b74ec6f8235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:41.205507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4f44a-95ab-4f9d-aa21-4b74ec6f8235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:41.205507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4f44a-95ab-4f9d-aa21-4b74ec6f8235 admin admin] PATH_INFO: `/v3/projects/c7100b27d56d4a5ebb4899abaed35eaa/users/f00a6eeea1fd4a47b9b04a57d81dd2a7/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:41.211048 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd55108-b7e8-4b96-9e45-4ae099b52f57 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:41.216822 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83464c97-a7d1-408d-a233-7a8f6b6b6418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:41.217718 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83464c97-a7d1-408d-a233-7a8f6b6b6418 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:41.217987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83464c97-a7d1-408d-a233-7a8f6b6b6418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:41.218330 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83464c97-a7d1-408d-a233-7a8f6b6b6418 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:41.219217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83464c97-a7d1-408d-a233-7a8f6b6b6418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:41.221164 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83464c97-a7d1-408d-a233-7a8f6b6b6418 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:41.225188 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4f44a-95ab-4f9d-aa21-4b74ec6f8235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7100b27d56d4a5ebb4899abaed35eaa, user_id=f00a6eeea1fd4a47b9b04a57d81dd2a7, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:41.228211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4f44a-95ab-4f9d-aa21-4b74ec6f8235 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:41.247891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1226/2466] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:41 2022] PUT /identity/v3/projects/c7100b27d56d4a5ebb4899abaed35eaa/users/f00a6eeea1fd4a47b9b04a57d81dd2a7/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:41.255585 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1241/2467] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:41 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:32:41.256150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bd769-3bfa-4a15-92aa-fbe453150643 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:41.256150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bd769-3bfa-4a15-92aa-fbe453150643 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:41.256150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bd769-3bfa-4a15-92aa-fbe453150643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:41.257895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83464c97-a7d1-408d-a233-7a8f6b6b6418 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:41.273075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9a3bd769-3bfa-4a15-92aa-fbe453150643 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:41.274545 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9a3bd769-3bfa-4a15-92aa-fbe453150643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:41.343289 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83464c97-a7d1-408d-a233-7a8f6b6b6418 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:41.349452 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b7147-1f82-47cb-bb65-6e5c2990df8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:41.350314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b7147-1f82-47cb-bb65-6e5c2990df8e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:41.350591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b7147-1f82-47cb-bb65-6e5c2990df8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:41.350926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b7147-1f82-47cb-bb65-6e5c2990df8e admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:41.351586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b7147-1f82-47cb-bb65-6e5c2990df8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:41.353622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b7147-1f82-47cb-bb65-6e5c2990df8e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:41.356318 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1227/2468] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:41.363331 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bd769-3bfa-4a15-92aa-fbe453150643 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:41.364826 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9a3bd769-3bfa-4a15-92aa-fbe453150643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:41.386413 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1242/2469] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:32:41 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:32:41.390315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b7147-1f82-47cb-bb65-6e5c2990df8e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:41.403916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b7147-1f82-47cb-bb65-6e5c2990df8e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:41.422339 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e13d0-0fa0-42fd-82a9-c6031156d9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:41.423873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e13d0-0fa0-42fd-82a9-c6031156d9bf admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:41.424418 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e13d0-0fa0-42fd-82a9-c6031156d9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:41.424988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e13d0-0fa0-42fd-82a9-c6031156d9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:41.426422 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e13d0-0fa0-42fd-82a9-c6031156d9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:41.429968 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e13d0-0fa0-42fd-82a9-c6031156d9bf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:41.450988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1243/2470] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:41.454986 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e13d0-0fa0-42fd-82a9-c6031156d9bf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:41.459967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bd769-3bfa-4a15-92aa-fbe453150643 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:41.465378 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a2cfe-e713-4dc4-89f5-716ca1c0aea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:41.466201 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a2cfe-e713-4dc4-89f5-716ca1c0aea8 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:41.466543 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a2cfe-e713-4dc4-89f5-716ca1c0aea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:41.466825 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a2cfe-e713-4dc4-89f5-716ca1c0aea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:41.468571 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e13d0-0fa0-42fd-82a9-c6031156d9bf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:41.474311 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65ed22-f8e9-448f-acd8-35cef082160d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:41.475615 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65ed22-f8e9-448f-acd8-35cef082160d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:41.476064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65ed22-f8e9-448f-acd8-35cef082160d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:41.476581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65ed22-f8e9-448f-acd8-35cef082160d admin admin] PATH_INFO: `/v3/projects/19b25304d561439995cc1d5340f427f9/users/19156529facd4b1dbe433a4f8d718cbd/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:41.479352 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a2cfe-e713-4dc4-89f5-716ca1c0aea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:41.481179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a2cfe-e713-4dc4-89f5-716ca1c0aea8 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:41.488933 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:41.497296 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65ed22-f8e9-448f-acd8-35cef082160d admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b25304d561439995cc1d5340f427f9, user_id=19156529facd4b1dbe433a4f8d718cbd, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:41.501135 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65ed22-f8e9-448f-acd8-35cef082160d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:41.504720 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1228/2471] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:32:41.519396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1244/2472] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:41 2022] PUT /identity/v3/projects/19b25304d561439995cc1d5340f427f9/users/19156529facd4b1dbe433a4f8d718cbd/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:32:41.523677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a2cfe-e713-4dc4-89f5-716ca1c0aea8 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:41.536279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a2cfe-e713-4dc4-89f5-716ca1c0aea8 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:41.606983 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e01b80-13e2-409a-8f19-e6fed55816b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:41.607681 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e01b80-13e2-409a-8f19-e6fed55816b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:41.607974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e01b80-13e2-409a-8f19-e6fed55816b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:41.608251 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e01b80-13e2-409a-8f19-e6fed55816b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:41.608997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e01b80-13e2-409a-8f19-e6fed55816b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:41.611161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e01b80-13e2-409a-8f19-e6fed55816b1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:41.626372 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1229/2473] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:41.629896 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65ed22-f8e9-448f-acd8-35cef082160d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:41.642913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65ed22-f8e9-448f-acd8-35cef082160d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:41.647992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec552a-12ca-42d1-8686-4ce428e82ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:41.649004 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec552a-12ca-42d1-8686-4ce428e82ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:41.649366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec552a-12ca-42d1-8686-4ce428e82ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:41.649718 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec552a-12ca-42d1-8686-4ce428e82ffc admin admin] PATH_INFO: `/v3/projects/19b25304d561439995cc1d5340f427f9/users/19156529facd4b1dbe433a4f8d718cbd/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:41.651825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec552a-12ca-42d1-8686-4ce428e82ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b25304d561439995cc1d5340f427f9, user_id=19156529facd4b1dbe433a4f8d718cbd, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:41.655453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec552a-12ca-42d1-8686-4ce428e82ffc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:41.668794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1245/2474] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:41 2022] PUT /identity/v3/projects/19b25304d561439995cc1d5340f427f9/users/19156529facd4b1dbe433a4f8d718cbd/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:41.684757 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c098b-84a2-4599-b480-a0de2668db74 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:41.685397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c098b-84a2-4599-b480-a0de2668db74 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:41.685798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c098b-84a2-4599-b480-a0de2668db74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:41.725395 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a67c098b-84a2-4599-b480-a0de2668db74 None None] MFA Rules not processed for user `19156529facd4b1dbe433a4f8d718cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:41.726714 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a67c098b-84a2-4599-b480-a0de2668db74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:41.812014 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1230/2475] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:41.828208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec552a-12ca-42d1-8686-4ce428e82ffc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:41.829579 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b8ec552a-12ca-42d1-8686-4ce428e82ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:41.929216 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec552a-12ca-42d1-8686-4ce428e82ffc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:41.933622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474868b-784e-4e34-a110-251d262e3d50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:41.934613 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474868b-784e-4e34-a110-251d262e3d50 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:41.934942 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474868b-784e-4e34-a110-251d262e3d50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:41.935249 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474868b-784e-4e34-a110-251d262e3d50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:41.947695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:41.951988 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474868b-784e-4e34-a110-251d262e3d50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:41.956686 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474868b-784e-4e34-a110-251d262e3d50 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:41.974104 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1246/2476] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:32:42.053690 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c098b-84a2-4599-b480-a0de2668db74 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:42.066210 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c098b-84a2-4599-b480-a0de2668db74 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:42.071247 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eedf24-8c33-43a3-8bf8-8da3b75bc7bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:42.071922 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eedf24-8c33-43a3-8bf8-8da3b75bc7bc service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:42.072217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eedf24-8c33-43a3-8bf8-8da3b75bc7bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:42.072494 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eedf24-8c33-43a3-8bf8-8da3b75bc7bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:42.151523 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eedf24-8c33-43a3-8bf8-8da3b75bc7bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:42.154344 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eedf24-8c33-43a3-8bf8-8da3b75bc7bc service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:42.167146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1231/2477] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:32:42.238024 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6bf9c-de84-49ab-8355-cf9d38cb9097 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:42.238343 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6bf9c-de84-49ab-8355-cf9d38cb9097 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:42.238614 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6bf9c-de84-49ab-8355-cf9d38cb9097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:42.273986 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-27b6bf9c-de84-49ab-8355-cf9d38cb9097 None None] MFA Rules not processed for user `f00a6eeea1fd4a47b9b04a57d81dd2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:42.275406 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-27b6bf9c-de84-49ab-8355-cf9d38cb9097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:42.376163 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1247/2478] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:42.380974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eedf24-8c33-43a3-8bf8-8da3b75bc7bc service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:42.409747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:42.468190 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eedf24-8c33-43a3-8bf8-8da3b75bc7bc service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:42.473039 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91e52a-ccb6-4497-8644-fcdbefc8736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:42.473709 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91e52a-ccb6-4497-8644-fcdbefc8736c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:42.473995 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91e52a-ccb6-4497-8644-fcdbefc8736c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:42.474303 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91e52a-ccb6-4497-8644-fcdbefc8736c admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:42.475011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91e52a-ccb6-4497-8644-fcdbefc8736c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:42.476937 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91e52a-ccb6-4497-8644-fcdbefc8736c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:42.512858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1232/2479] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:42 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:42.515159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6bf9c-de84-49ab-8355-cf9d38cb9097 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:42.526643 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6bf9c-de84-49ab-8355-cf9d38cb9097 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:42.589416 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37495d52-ec10-41c7-bf8b-e0ff74b7b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:42.590163 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37495d52-ec10-41c7-bf8b-e0ff74b7b5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:42.590476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37495d52-ec10-41c7-bf8b-e0ff74b7b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:42.590754 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37495d52-ec10-41c7-bf8b-e0ff74b7b5c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:42.591450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37495d52-ec10-41c7-bf8b-e0ff74b7b5c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:42.593375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37495d52-ec10-41c7-bf8b-e0ff74b7b5c5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:42.618625 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1248/2480] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:32:42 2022] POST /identity/v3/users => generated 309 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:42.624577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91e52a-ccb6-4497-8644-fcdbefc8736c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:42.638055 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91e52a-ccb6-4497-8644-fcdbefc8736c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:42.644581 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ec90f-b661-46ee-8f8d-342f9d07820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:42.645364 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ec90f-b661-46ee-8f8d-342f9d07820d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:42.645677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ec90f-b661-46ee-8f8d-342f9d07820d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:42.646071 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ec90f-b661-46ee-8f8d-342f9d07820d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:42.646854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ec90f-b661-46ee-8f8d-342f9d07820d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:42.648524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ec90f-b661-46ee-8f8d-342f9d07820d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:42.661631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1233/2481] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:32:42.666084 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37495d52-ec10-41c7-bf8b-e0ff74b7b5c5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:42.677136 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37495d52-ec10-41c7-bf8b-e0ff74b7b5c5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:42.690888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ecf23-7711-4416-b8a3-77a5a01f87bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:42.692015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ecf23-7711-4416-b8a3-77a5a01f87bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:42.692302 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ecf23-7711-4416-b8a3-77a5a01f87bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:42.692584 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ecf23-7711-4416-b8a3-77a5a01f87bd admin admin] PATH_INFO: `/v3/projects/b70021555c9844c09b4e6a297a8fc9cf/users/8e3f752a618744629cbe551e6961ba5c/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:42.709508 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ecf23-7711-4416-b8a3-77a5a01f87bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70021555c9844c09b4e6a297a8fc9cf, user_id=8e3f752a618744629cbe551e6961ba5c, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:42.712802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ecf23-7711-4416-b8a3-77a5a01f87bd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:42.728178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1249/2482] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:42 2022] PUT /identity/v3/projects/b70021555c9844c09b4e6a297a8fc9cf/users/8e3f752a618744629cbe551e6961ba5c/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:42.732984 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ec90f-b661-46ee-8f8d-342f9d07820d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:42.744141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ec90f-b661-46ee-8f8d-342f9d07820d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:42.824178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5a11d-688f-42e7-8593-b30543c4696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:42.824861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5a11d-688f-42e7-8593-b30543c4696c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:42.825167 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5a11d-688f-42e7-8593-b30543c4696c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:42.825462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5a11d-688f-42e7-8593-b30543c4696c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:42.826272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5a11d-688f-42e7-8593-b30543c4696c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:42.827906 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5a11d-688f-42e7-8593-b30543c4696c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:42.841004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1234/2483] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:42.848233 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ecf23-7711-4416-b8a3-77a5a01f87bd admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:42.859165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ecf23-7711-4416-b8a3-77a5a01f87bd admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:42.864464 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282334d-b9d4-4a8c-96b9-0bf70fb0cc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:42.865446 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282334d-b9d4-4a8c-96b9-0bf70fb0cc09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:42.865728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282334d-b9d4-4a8c-96b9-0bf70fb0cc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:42.866009 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282334d-b9d4-4a8c-96b9-0bf70fb0cc09 admin admin] PATH_INFO: `/v3/projects/b70021555c9844c09b4e6a297a8fc9cf/users/8e3f752a618744629cbe551e6961ba5c/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:42.868114 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282334d-b9d4-4a8c-96b9-0bf70fb0cc09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70021555c9844c09b4e6a297a8fc9cf, user_id=8e3f752a618744629cbe551e6961ba5c, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:42.870930 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282334d-b9d4-4a8c-96b9-0bf70fb0cc09 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:42.882050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1250/2484] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:42 2022] PUT /identity/v3/projects/b70021555c9844c09b4e6a297a8fc9cf/users/8e3f752a618744629cbe551e6961ba5c/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:43.619342 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0082d-9d36-4340-a65d-2bea8b5ad2fa None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:43.620674 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0082d-9d36-4340-a65d-2bea8b5ad2fa None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:43.620674 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0082d-9d36-4340-a65d-2bea8b5ad2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:43.663925 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9fd0082d-9d36-4340-a65d-2bea8b5ad2fa None None] MFA Rules not processed for user `8e3f752a618744629cbe551e6961ba5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:43.665727 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9fd0082d-9d36-4340-a65d-2bea8b5ad2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:43.759604 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1235/2485] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:44.994559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282334d-b9d4-4a8c-96b9-0bf70fb0cc09 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:45.045326 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:45.071180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282334d-b9d4-4a8c-96b9-0bf70fb0cc09 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:45.076327 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c87fd1-1b27-46a7-bebe-59cb2d067b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:45.077219 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c87fd1-1b27-46a7-bebe-59cb2d067b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:45.077502 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c87fd1-1b27-46a7-bebe-59cb2d067b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:45.077782 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c87fd1-1b27-46a7-bebe-59cb2d067b3d admin admin] PATH_INFO: `/v3/users/f00a6eeea1fd4a47b9b04a57d81dd2a7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:45.079587 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c87fd1-1b27-46a7-bebe-59cb2d067b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00a6eeea1fd4a47b9b04a57d81dd2a7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:45.081701 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c87fd1-1b27-46a7-bebe-59cb2d067b3d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:45.139031 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-15c87fd1-1b27-46a7-bebe-59cb2d067b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00a6eeea1fd4a47b9b04a57d81dd2a7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:45.146698 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-15c87fd1-1b27-46a7-bebe-59cb2d067b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00a6eeea1fd4a47b9b04a57d81dd2a7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:45.147601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-15c87fd1-1b27-46a7-bebe-59cb2d067b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00a6eeea1fd4a47b9b04a57d81dd2a7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:45.148208 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-15c87fd1-1b27-46a7-bebe-59cb2d067b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00a6eeea1fd4a47b9b04a57d81dd2a7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:45.163198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-15c87fd1-1b27-46a7-bebe-59cb2d067b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00a6eeea1fd4a47b9b04a57d81dd2a7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:45.178913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1251/2486] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:32:44 2022] DELETE /identity/v3/users/f00a6eeea1fd4a47b9b04a57d81dd2a7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:45.399781 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0082d-9d36-4340-a65d-2bea8b5ad2fa None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:45.413384 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0082d-9d36-4340-a65d-2bea8b5ad2fa None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:45.433797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:45.488183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0569943-c6a3-4285-a691-0e506bab7104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:45.489154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0569943-c6a3-4285-a691-0e506bab7104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:45.489509 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0569943-c6a3-4285-a691-0e506bab7104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:45.489900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0569943-c6a3-4285-a691-0e506bab7104 admin admin] PATH_INFO: `/v3/projects/c7100b27d56d4a5ebb4899abaed35eaa` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:45.491436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0569943-c6a3-4285-a691-0e506bab7104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7100b27d56d4a5ebb4899abaed35eaa)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:45.493470 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0569943-c6a3-4285-a691-0e506bab7104 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:45.558475 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d0569943-c6a3-4285-a691-0e506bab7104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7100b27d56d4a5ebb4899abaed35eaa', 'request_id': 'req-d0569943-c6a3-4285-a691-0e506bab7104'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:45.567250 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d0569943-c6a3-4285-a691-0e506bab7104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7100b27d56d4a5ebb4899abaed35eaa', 'request_id': 'req-d0569943-c6a3-4285-a691-0e506bab7104'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:45.576126 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d0569943-c6a3-4285-a691-0e506bab7104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7100b27d56d4a5ebb4899abaed35eaa', 'request_id': 'req-d0569943-c6a3-4285-a691-0e506bab7104'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:45.589784 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d0569943-c6a3-4285-a691-0e506bab7104 admin admin] The token cache is being invalidate because project c7100b27d56d4a5ebb4899abaed35eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:45.590112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d0569943-c6a3-4285-a691-0e506bab7104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:45.591115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d0569943-c6a3-4285-a691-0e506bab7104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:45.592851 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1236/2487] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:45 2022] DELETE /identity/v3/projects/c7100b27d56d4a5ebb4899abaed35eaa => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:45.597854 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c87fd1-1b27-46a7-bebe-59cb2d067b3d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:45.599459 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-15c87fd1-1b27-46a7-bebe-59cb2d067b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:45.613659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c87fd1-1b27-46a7-bebe-59cb2d067b3d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:45.683467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96687cf-d2c3-40b9-88df-2a5262ac3ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:45.684770 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96687cf-d2c3-40b9-88df-2a5262ac3ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:45.685235 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96687cf-d2c3-40b9-88df-2a5262ac3ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:45.685621 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96687cf-d2c3-40b9-88df-2a5262ac3ced admin admin] PATH_INFO: `/v3/users/8e3f752a618744629cbe551e6961ba5c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:45.687073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96687cf-d2c3-40b9-88df-2a5262ac3ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e3f752a618744629cbe551e6961ba5c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:45.689352 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96687cf-d2c3-40b9-88df-2a5262ac3ced admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:45.744200 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e96687cf-d2c3-40b9-88df-2a5262ac3ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e3f752a618744629cbe551e6961ba5c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:45.751314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e96687cf-d2c3-40b9-88df-2a5262ac3ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e3f752a618744629cbe551e6961ba5c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:45.751978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e96687cf-d2c3-40b9-88df-2a5262ac3ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e3f752a618744629cbe551e6961ba5c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:45.752588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e96687cf-d2c3-40b9-88df-2a5262ac3ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e3f752a618744629cbe551e6961ba5c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:45.754473 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:45.766446 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e96687cf-d2c3-40b9-88df-2a5262ac3ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e3f752a618744629cbe551e6961ba5c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:45.779566 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1252/2488] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:32:45 2022] DELETE /identity/v3/users/8e3f752a618744629cbe551e6961ba5c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:45.984471 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0569943-c6a3-4285-a691-0e506bab7104 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:45.986146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d0569943-c6a3-4285-a691-0e506bab7104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:46.000499 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0569943-c6a3-4285-a691-0e506bab7104 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:46.076579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fcea7-a86c-4197-b72b-aaa1da1ee5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:46.077462 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fcea7-a86c-4197-b72b-aaa1da1ee5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:46.077746 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fcea7-a86c-4197-b72b-aaa1da1ee5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:46.078180 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fcea7-a86c-4197-b72b-aaa1da1ee5d7 admin admin] PATH_INFO: `/v3/projects/b70021555c9844c09b4e6a297a8fc9cf` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:46.079510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fcea7-a86c-4197-b72b-aaa1da1ee5d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b70021555c9844c09b4e6a297a8fc9cf)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:46.081492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fcea7-a86c-4197-b72b-aaa1da1ee5d7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:46.134379 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:46.135580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c49fcea7-a86c-4197-b72b-aaa1da1ee5d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70021555c9844c09b4e6a297a8fc9cf', 'request_id': 'req-c49fcea7-a86c-4197-b72b-aaa1da1ee5d7'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:46.146327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c49fcea7-a86c-4197-b72b-aaa1da1ee5d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70021555c9844c09b4e6a297a8fc9cf', 'request_id': 'req-c49fcea7-a86c-4197-b72b-aaa1da1ee5d7'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:46.153417 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c49fcea7-a86c-4197-b72b-aaa1da1ee5d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70021555c9844c09b4e6a297a8fc9cf', 'request_id': 'req-c49fcea7-a86c-4197-b72b-aaa1da1ee5d7'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:46.166458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c49fcea7-a86c-4197-b72b-aaa1da1ee5d7 admin admin] The token cache is being invalidate because project b70021555c9844c09b4e6a297a8fc9cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:46.166747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c49fcea7-a86c-4197-b72b-aaa1da1ee5d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:46.167406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c49fcea7-a86c-4197-b72b-aaa1da1ee5d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:46.168987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1237/2489] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:45 2022] DELETE /identity/v3/projects/b70021555c9844c09b4e6a297a8fc9cf => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:46.176750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb689d6-345a-46c1-885b-deafb64e55b2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:46.177273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb689d6-345a-46c1-885b-deafb64e55b2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:46.177392 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb689d6-345a-46c1-885b-deafb64e55b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:46.197704 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6eb689d6-345a-46c1-885b-deafb64e55b2 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:46.199016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6eb689d6-345a-46c1-885b-deafb64e55b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:46.280711 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1253/2490] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:46.289467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eb780-ed49-4289-90c2-4022a0fa134d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:46.289772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eb780-ed49-4289-90c2-4022a0fa134d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:46.291370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eb780-ed49-4289-90c2-4022a0fa134d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:46.315652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-239eb780-ed49-4289-90c2-4022a0fa134d None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:46.316943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-239eb780-ed49-4289-90c2-4022a0fa134d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:46.326090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1238/2491] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:46.330499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb689d6-345a-46c1-885b-deafb64e55b2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:46.341634 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb689d6-345a-46c1-885b-deafb64e55b2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:46.348106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397593c5-6150-4a2c-bc74-eb5f29c745c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:46.348764 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397593c5-6150-4a2c-bc74-eb5f29c745c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:46.349042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397593c5-6150-4a2c-bc74-eb5f29c745c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:46.349323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397593c5-6150-4a2c-bc74-eb5f29c745c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:46.350140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397593c5-6150-4a2c-bc74-eb5f29c745c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:32:46.350457 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397593c5-6150-4a2c-bc74-eb5f29c745c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:46.352622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397593c5-6150-4a2c-bc74-eb5f29c745c6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:46.365767 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1254/2492] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:32:46.370211 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239eb780-ed49-4289-90c2-4022a0fa134d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:46.380696 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239eb780-ed49-4289-90c2-4022a0fa134d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:46.386678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2773ce2-1135-40d2-9c8b-9fbc9af298f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:46.387464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2773ce2-1135-40d2-9c8b-9fbc9af298f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:46.387800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2773ce2-1135-40d2-9c8b-9fbc9af298f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:46.388131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2773ce2-1135-40d2-9c8b-9fbc9af298f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:46.388917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2773ce2-1135-40d2-9c8b-9fbc9af298f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:46.391974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2773ce2-1135-40d2-9c8b-9fbc9af298f3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:46.420299 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1239/2493] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:46 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:46.424614 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397593c5-6150-4a2c-bc74-eb5f29c745c6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:46.435080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397593c5-6150-4a2c-bc74-eb5f29c745c6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:46.504963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323cc37-c075-4ff2-8720-1739e4f561f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:46.504963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323cc37-c075-4ff2-8720-1739e4f561f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:46.504963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323cc37-c075-4ff2-8720-1739e4f561f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:46.506290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323cc37-c075-4ff2-8720-1739e4f561f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:46.507089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323cc37-c075-4ff2-8720-1739e4f561f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:46.509012 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323cc37-c075-4ff2-8720-1739e4f561f3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:46.536561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1255/2494] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:32:46 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:46.541137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2773ce2-1135-40d2-9c8b-9fbc9af298f3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:46.551763 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2773ce2-1135-40d2-9c8b-9fbc9af298f3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:46.556396 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abad46d-da6e-4ee0-8099-3d0b332442d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:46.557065 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abad46d-da6e-4ee0-8099-3d0b332442d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:46.557343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abad46d-da6e-4ee0-8099-3d0b332442d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:46.557692 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abad46d-da6e-4ee0-8099-3d0b332442d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:46.558469 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abad46d-da6e-4ee0-8099-3d0b332442d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:46.560197 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abad46d-da6e-4ee0-8099-3d0b332442d7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:46.577437 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1240/2495] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:46.578671 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323cc37-c075-4ff2-8720-1739e4f561f3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:46.594952 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323cc37-c075-4ff2-8720-1739e4f561f3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:46.600047 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba039527-d68c-496e-94b4-ab6e2ddc12f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:46.600858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039527-d68c-496e-94b4-ab6e2ddc12f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:46.601016 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039527-d68c-496e-94b4-ab6e2ddc12f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:46.601309 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039527-d68c-496e-94b4-ab6e2ddc12f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:46.602035 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba039527-d68c-496e-94b4-ab6e2ddc12f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:46.603766 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba039527-d68c-496e-94b4-ab6e2ddc12f4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:46.618685 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1256/2496] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:46.619769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abad46d-da6e-4ee0-8099-3d0b332442d7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:46.632990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abad46d-da6e-4ee0-8099-3d0b332442d7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:46.637833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bbf05-22f8-4db8-8db6-c8555f225354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:46.638914 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bbf05-22f8-4db8-8db6-c8555f225354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:46.639198 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bbf05-22f8-4db8-8db6-c8555f225354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:46.639478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bbf05-22f8-4db8-8db6-c8555f225354 admin admin] PATH_INFO: `/v3/projects/57d6b1c429e64b0c901b967cccef2afc/users/3c7dc4aec3674a5794fdcffac2e2a29f/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:46.663271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bbf05-22f8-4db8-8db6-c8555f225354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d6b1c429e64b0c901b967cccef2afc, user_id=3c7dc4aec3674a5794fdcffac2e2a29f, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:46.663271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bbf05-22f8-4db8-8db6-c8555f225354 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:46.686619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1241/2497] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:46 2022] PUT /identity/v3/projects/57d6b1c429e64b0c901b967cccef2afc/users/3c7dc4aec3674a5794fdcffac2e2a29f/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:46.703765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cf6f9-b0c8-4bb2-bffd-ad151f012982 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:46.704062 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cf6f9-b0c8-4bb2-bffd-ad151f012982 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:46.704360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cf6f9-b0c8-4bb2-bffd-ad151f012982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:46.752770 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e98cf6f9-b0c8-4bb2-bffd-ad151f012982 None None] MFA Rules not processed for user `3c7dc4aec3674a5794fdcffac2e2a29f`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:46.753763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e98cf6f9-b0c8-4bb2-bffd-ad151f012982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:46.793411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:46.861663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1257/2498] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:46.869019 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bbf05-22f8-4db8-8db6-c8555f225354 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:46.987304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bbf05-22f8-4db8-8db6-c8555f225354 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:46.993794 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab2eb2-eff8-43c8-a2f4-64349007aac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:46.994903 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab2eb2-eff8-43c8-a2f4-64349007aac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:46.995347 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab2eb2-eff8-43c8-a2f4-64349007aac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:46.995746 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab2eb2-eff8-43c8-a2f4-64349007aac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:46.996665 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab2eb2-eff8-43c8-a2f4-64349007aac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:46.999562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab2eb2-eff8-43c8-a2f4-64349007aac9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:47.043117 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1242/2499] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:46 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:47.048321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cf6f9-b0c8-4bb2-bffd-ad151f012982 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:47.061338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cf6f9-b0c8-4bb2-bffd-ad151f012982 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:47.139760 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0b882-c93a-440c-ac16-6d4a9509039d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:47.140485 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0b882-c93a-440c-ac16-6d4a9509039d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:47.140791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0b882-c93a-440c-ac16-6d4a9509039d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:47.141056 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0b882-c93a-440c-ac16-6d4a9509039d admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:47.141774 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0b882-c93a-440c-ac16-6d4a9509039d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:47.143821 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0b882-c93a-440c-ac16-6d4a9509039d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:47.165875 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1258/2500] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:32:47 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:32:47.169921 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab2eb2-eff8-43c8-a2f4-64349007aac9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:47.181504 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab2eb2-eff8-43c8-a2f4-64349007aac9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:47.186537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b5f9a-9987-4cfd-a99e-a344db2bddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:47.187229 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b5f9a-9987-4cfd-a99e-a344db2bddf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:47.189534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b5f9a-9987-4cfd-a99e-a344db2bddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:47.189534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b5f9a-9987-4cfd-a99e-a344db2bddf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:47.189534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b5f9a-9987-4cfd-a99e-a344db2bddf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:47.191869 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b5f9a-9987-4cfd-a99e-a344db2bddf7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:47.208705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1243/2501] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:47.215111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0b882-c93a-440c-ac16-6d4a9509039d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:47.229544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0b882-c93a-440c-ac16-6d4a9509039d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:47.234725 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1a02b-1252-4ad6-9804-44b333d4d112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:47.235673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1a02b-1252-4ad6-9804-44b333d4d112 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:47.235974 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1a02b-1252-4ad6-9804-44b333d4d112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:47.236257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1a02b-1252-4ad6-9804-44b333d4d112 admin admin] PATH_INFO: `/v3/projects/3c68f7ed36ba460daa28f8a98eca0823/users/ad0810712ce8452581849d99d4e40481/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:47.257405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1a02b-1252-4ad6-9804-44b333d4d112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c68f7ed36ba460daa28f8a98eca0823, user_id=ad0810712ce8452581849d99d4e40481, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:47.261325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1a02b-1252-4ad6-9804-44b333d4d112 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:47.277243 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1259/2502] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:47 2022] PUT /identity/v3/projects/3c68f7ed36ba460daa28f8a98eca0823/users/ad0810712ce8452581849d99d4e40481/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:47.282108 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b5f9a-9987-4cfd-a99e-a344db2bddf7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:47.294205 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b5f9a-9987-4cfd-a99e-a344db2bddf7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:47.342243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:47.359263 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0aa4ce-a032-4974-93af-08ee42593293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:47.359948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0aa4ce-a032-4974-93af-08ee42593293 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:47.360231 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0aa4ce-a032-4974-93af-08ee42593293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:47.360505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0aa4ce-a032-4974-93af-08ee42593293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:47.361248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0aa4ce-a032-4974-93af-08ee42593293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:47.362953 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0aa4ce-a032-4974-93af-08ee42593293 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:47.373942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1244/2503] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:47.378391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1a02b-1252-4ad6-9804-44b333d4d112 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:47.388966 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1a02b-1252-4ad6-9804-44b333d4d112 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:47.394279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a5988-2440-4bed-945e-a0a125ce794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:47.395202 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a5988-2440-4bed-945e-a0a125ce794c admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:47.395505 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a5988-2440-4bed-945e-a0a125ce794c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:47.395763 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a5988-2440-4bed-945e-a0a125ce794c admin admin] PATH_INFO: `/v3/projects/3c68f7ed36ba460daa28f8a98eca0823/users/ad0810712ce8452581849d99d4e40481/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:47.397745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a5988-2440-4bed-945e-a0a125ce794c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c68f7ed36ba460daa28f8a98eca0823, user_id=ad0810712ce8452581849d99d4e40481, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:47.400469 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a5988-2440-4bed-945e-a0a125ce794c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:47.412063 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1260/2504] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:47 2022] PUT /identity/v3/projects/3c68f7ed36ba460daa28f8a98eca0823/users/ad0810712ce8452581849d99d4e40481/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:47.423287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713c20e-df8e-4263-bb6b-87f442380149 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:47.423287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713c20e-df8e-4263-bb6b-87f442380149 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:47.423984 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713c20e-df8e-4263-bb6b-87f442380149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:47.452759 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b713c20e-df8e-4263-bb6b-87f442380149 None None] MFA Rules not processed for user `ad0810712ce8452581849d99d4e40481`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:47.454238 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b713c20e-df8e-4263-bb6b-87f442380149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:47.533217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1245/2505] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:47.549910 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a5988-2440-4bed-945e-a0a125ce794c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:47.552305 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-510a5988-2440-4bed-945e-a0a125ce794c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:47.632042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a5988-2440-4bed-945e-a0a125ce794c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:47.636072 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f017635-52a2-40ae-83c6-dae8fccccfd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:47.636750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f017635-52a2-40ae-83c6-dae8fccccfd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:47.637038 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f017635-52a2-40ae-83c6-dae8fccccfd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:47.637318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f017635-52a2-40ae-83c6-dae8fccccfd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:47.648155 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f017635-52a2-40ae-83c6-dae8fccccfd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:47.649622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f017635-52a2-40ae-83c6-dae8fccccfd5 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:47.660299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1261/2506] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:32:47.692318 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713c20e-df8e-4263-bb6b-87f442380149 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:47.798270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713c20e-df8e-4263-bb6b-87f442380149 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:47.804629 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c0d30-55a8-4078-9658-01b47e26989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:47.805491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0d30-55a8-4078-9658-01b47e26989d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:47.805775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0d30-55a8-4078-9658-01b47e26989d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:47.806059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0d30-55a8-4078-9658-01b47e26989d admin admin] PATH_INFO: `/v3/users/3c7dc4aec3674a5794fdcffac2e2a29f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:47.807367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c0d30-55a8-4078-9658-01b47e26989d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7dc4aec3674a5794fdcffac2e2a29f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:47.810025 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c0d30-55a8-4078-9658-01b47e26989d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:47.886116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a01c0d30-55a8-4078-9658-01b47e26989d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7dc4aec3674a5794fdcffac2e2a29f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:47.902320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a01c0d30-55a8-4078-9658-01b47e26989d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7dc4aec3674a5794fdcffac2e2a29f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:47.915427 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a01c0d30-55a8-4078-9658-01b47e26989d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7dc4aec3674a5794fdcffac2e2a29f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:47.916450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a01c0d30-55a8-4078-9658-01b47e26989d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7dc4aec3674a5794fdcffac2e2a29f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:47.926544 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:47.942693 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a01c0d30-55a8-4078-9658-01b47e26989d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7dc4aec3674a5794fdcffac2e2a29f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:47.955292 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1246/2507] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:32:47 2022] DELETE /identity/v3/users/3c7dc4aec3674a5794fdcffac2e2a29f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:47.967230 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242a93d-71d1-4081-b684-60013644298a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:47.967513 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242a93d-71d1-4081-b684-60013644298a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:47.967799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242a93d-71d1-4081-b684-60013644298a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:47.990688 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4242a93d-71d1-4081-b684-60013644298a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:47.993223 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4242a93d-71d1-4081-b684-60013644298a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:48.023336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:48.110492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1262/2508] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:48.124102 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c0d30-55a8-4078-9658-01b47e26989d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:48.128929 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a01c0d30-55a8-4078-9658-01b47e26989d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:48.275773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c0d30-55a8-4078-9658-01b47e26989d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:48.284677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00d8ee-f8f7-4df8-9ac7-2b5a14889fbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:48.285911 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00d8ee-f8f7-4df8-9ac7-2b5a14889fbe service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:48.286436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00d8ee-f8f7-4df8-9ac7-2b5a14889fbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:48.287233 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00d8ee-f8f7-4df8-9ac7-2b5a14889fbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:48.306975 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00d8ee-f8f7-4df8-9ac7-2b5a14889fbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:48.309858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00d8ee-f8f7-4df8-9ac7-2b5a14889fbe service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:48.330892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1247/2509] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:32:48.776198 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242a93d-71d1-4081-b684-60013644298a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:48.778916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4242a93d-71d1-4081-b684-60013644298a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:48.800353 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242a93d-71d1-4081-b684-60013644298a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:48.809218 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cccaf2-36be-4ddd-9127-205ef701f359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:48.810814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cccaf2-36be-4ddd-9127-205ef701f359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:48.811341 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cccaf2-36be-4ddd-9127-205ef701f359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:48.811873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cccaf2-36be-4ddd-9127-205ef701f359 admin admin] PATH_INFO: `/v3/projects/57d6b1c429e64b0c901b967cccef2afc` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:48.814035 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cccaf2-36be-4ddd-9127-205ef701f359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d6b1c429e64b0c901b967cccef2afc)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:48.818318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cccaf2-36be-4ddd-9127-205ef701f359 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:48.905277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f7cccaf2-36be-4ddd-9127-205ef701f359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d6b1c429e64b0c901b967cccef2afc', 'request_id': 'req-f7cccaf2-36be-4ddd-9127-205ef701f359'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:48.918594 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f7cccaf2-36be-4ddd-9127-205ef701f359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d6b1c429e64b0c901b967cccef2afc', 'request_id': 'req-f7cccaf2-36be-4ddd-9127-205ef701f359'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:48.930668 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f7cccaf2-36be-4ddd-9127-205ef701f359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d6b1c429e64b0c901b967cccef2afc', 'request_id': 'req-f7cccaf2-36be-4ddd-9127-205ef701f359'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:48.956635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f7cccaf2-36be-4ddd-9127-205ef701f359 admin admin] The token cache is being invalidate because project 57d6b1c429e64b0c901b967cccef2afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:48.956924 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f7cccaf2-36be-4ddd-9127-205ef701f359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:48.957721 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f7cccaf2-36be-4ddd-9127-205ef701f359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:48.959537 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1263/2510] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:48 2022] DELETE /identity/v3/projects/57d6b1c429e64b0c901b967cccef2afc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:48.964416 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00d8ee-f8f7-4df8-9ac7-2b5a14889fbe service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:48.976794 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00d8ee-f8f7-4df8-9ac7-2b5a14889fbe service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:49.055023 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81eba7-83b5-467a-ac0a-b021ce91edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:49.056067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81eba7-83b5-467a-ac0a-b021ce91edf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:49.056298 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81eba7-83b5-467a-ac0a-b021ce91edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:49.056496 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81eba7-83b5-467a-ac0a-b021ce91edf8 admin admin] PATH_INFO: `/v3/users/ad0810712ce8452581849d99d4e40481` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:49.057823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81eba7-83b5-467a-ac0a-b021ce91edf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad0810712ce8452581849d99d4e40481)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:49.059823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81eba7-83b5-467a-ac0a-b021ce91edf8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:49.136881 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e81eba7-83b5-467a-ac0a-b021ce91edf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad0810712ce8452581849d99d4e40481'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:49.153973 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e81eba7-83b5-467a-ac0a-b021ce91edf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad0810712ce8452581849d99d4e40481'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:49.164885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e81eba7-83b5-467a-ac0a-b021ce91edf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad0810712ce8452581849d99d4e40481'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:49.165985 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e81eba7-83b5-467a-ac0a-b021ce91edf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad0810712ce8452581849d99d4e40481'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:49.181141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e81eba7-83b5-467a-ac0a-b021ce91edf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad0810712ce8452581849d99d4e40481'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:49.188183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1248/2511] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:32:48 2022] DELETE /identity/v3/users/ad0810712ce8452581849d99d4e40481 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:49.567380 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cccaf2-36be-4ddd-9127-205ef701f359 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:49.569092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f7cccaf2-36be-4ddd-9127-205ef701f359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:49.599313 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cccaf2-36be-4ddd-9127-205ef701f359 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:49.718163 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426479ee-7a58-451e-8530-e5bf2168aba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:49.719370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426479ee-7a58-451e-8530-e5bf2168aba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:49.719930 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426479ee-7a58-451e-8530-e5bf2168aba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:49.720223 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426479ee-7a58-451e-8530-e5bf2168aba9 admin admin] PATH_INFO: `/v3/projects/3c68f7ed36ba460daa28f8a98eca0823` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:49.721671 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426479ee-7a58-451e-8530-e5bf2168aba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c68f7ed36ba460daa28f8a98eca0823)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:49.723721 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426479ee-7a58-451e-8530-e5bf2168aba9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:49.776300 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81eba7-83b5-467a-ac0a-b021ce91edf8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:49.778541 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6e81eba7-83b5-467a-ac0a-b021ce91edf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:49.801638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-426479ee-7a58-451e-8530-e5bf2168aba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c68f7ed36ba460daa28f8a98eca0823', 'request_id': 'req-426479ee-7a58-451e-8530-e5bf2168aba9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:49.808846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81eba7-83b5-467a-ac0a-b021ce91edf8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:49.810292 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:49.812164 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-426479ee-7a58-451e-8530-e5bf2168aba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c68f7ed36ba460daa28f8a98eca0823', 'request_id': 'req-426479ee-7a58-451e-8530-e5bf2168aba9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:49.814761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:49.826262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-426479ee-7a58-451e-8530-e5bf2168aba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c68f7ed36ba460daa28f8a98eca0823', 'request_id': 'req-426479ee-7a58-451e-8530-e5bf2168aba9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:49.846856 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-426479ee-7a58-451e-8530-e5bf2168aba9 admin admin] The token cache is being invalidate because project 3c68f7ed36ba460daa28f8a98eca0823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:49.847367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-426479ee-7a58-451e-8530-e5bf2168aba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:49.848110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-426479ee-7a58-451e-8530-e5bf2168aba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:49.850545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1264/2512] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:49 2022] DELETE /identity/v3/projects/3c68f7ed36ba460daa28f8a98eca0823 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:49.857023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb56ec-0a4d-4945-9c92-a2c5647e4310 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:49.857699 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb56ec-0a4d-4945-9c92-a2c5647e4310 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:49.858358 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb56ec-0a4d-4945-9c92-a2c5647e4310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:49.893118 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9cbb56ec-0a4d-4945-9c92-a2c5647e4310 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:49.895258 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9cbb56ec-0a4d-4945-9c92-a2c5647e4310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:49.917657 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ae75b-ed53-423e-8907-ebd358016284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:49.919589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ae75b-ed53-423e-8907-ebd358016284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:49.920805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ae75b-ed53-423e-8907-ebd358016284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:49.920805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ae75b-ed53-423e-8907-ebd358016284 admin admin] PATH_INFO: `/v3/users/64df3f023787416dbf17847aadd0b95b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:49.924927 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ae75b-ed53-423e-8907-ebd358016284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64df3f023787416dbf17847aadd0b95b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:49.924927 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ae75b-ed53-423e-8907-ebd358016284 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:50.037874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a97ae75b-ed53-423e-8907-ebd358016284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64df3f023787416dbf17847aadd0b95b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:50.056269 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1265/2513] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:50.056395 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a97ae75b-ed53-423e-8907-ebd358016284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64df3f023787416dbf17847aadd0b95b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:50.067964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ac55c-72b2-4d85-93a7-7f0679edf7d7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:50.067964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ac55c-72b2-4d85-93a7-7f0679edf7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:50.067964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ac55c-72b2-4d85-93a7-7f0679edf7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:50.075727 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a97ae75b-ed53-423e-8907-ebd358016284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64df3f023787416dbf17847aadd0b95b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:50.077954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a97ae75b-ed53-423e-8907-ebd358016284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64df3f023787416dbf17847aadd0b95b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:50.089299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-645ac55c-72b2-4d85-93a7-7f0679edf7d7 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:50.091074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-645ac55c-72b2-4d85-93a7-7f0679edf7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:50.101884 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a97ae75b-ed53-423e-8907-ebd358016284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64df3f023787416dbf17847aadd0b95b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:50.103898 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1266/2514] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:50.114300 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ac55c-72b2-4d85-93a7-7f0679edf7d7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:50.116400 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1249/2515] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:32:49 2022] DELETE /identity/v3/users/64df3f023787416dbf17847aadd0b95b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:50.126353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e5fea-620e-4523-bb3c-8af5633b77d7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:50.126353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e5fea-620e-4523-bb3c-8af5633b77d7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:50.126353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e5fea-620e-4523-bb3c-8af5633b77d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:50.133873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ac55c-72b2-4d85-93a7-7f0679edf7d7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:50.151534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d72e5fea-620e-4523-bb3c-8af5633b77d7 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:50.152904 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d72e5fea-620e-4523-bb3c-8af5633b77d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:50.206357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f140f1-d5f7-436f-b65a-31bdacbb11ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:50.207060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f140f1-d5f7-436f-b65a-31bdacbb11ec admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:50.207349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f140f1-d5f7-436f-b65a-31bdacbb11ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:50.207630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f140f1-d5f7-436f-b65a-31bdacbb11ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:50.208390 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f140f1-d5f7-436f-b65a-31bdacbb11ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:32:50.208702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f140f1-d5f7-436f-b65a-31bdacbb11ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:50.210371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f140f1-d5f7-436f-b65a-31bdacbb11ec admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:50.227597 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1267/2516] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:32:50.229218 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f140f1-d5f7-436f-b65a-31bdacbb11ec admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:50.234762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1250/2517] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:50.246856 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e5fea-620e-4523-bb3c-8af5633b77d7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:50.249184 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d72e5fea-620e-4523-bb3c-8af5633b77d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:50.253101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f140f1-d5f7-436f-b65a-31bdacbb11ec admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:50.261108 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc4ffa-cf93-4982-a596-900d08442823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:50.262306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc4ffa-cf93-4982-a596-900d08442823 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:50.262748 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc4ffa-cf93-4982-a596-900d08442823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:50.263176 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc4ffa-cf93-4982-a596-900d08442823 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:50.264497 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc4ffa-cf93-4982-a596-900d08442823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:50.268467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc4ffa-cf93-4982-a596-900d08442823 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:50.308523 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:50.310178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1268/2518] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:50 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:32:50.315769 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc4ffa-cf93-4982-a596-900d08442823 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:50.351480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e5fea-620e-4523-bb3c-8af5633b77d7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:50.393490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:50.413676 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea85686-4c38-4e0c-b746-5b704db8fbac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:50.414695 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea85686-4c38-4e0c-b746-5b704db8fbac service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:50.414978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc4ffa-cf93-4982-a596-900d08442823 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:50.415568 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea85686-4c38-4e0c-b746-5b704db8fbac service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:50.415897 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea85686-4c38-4e0c-b746-5b704db8fbac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:50.420170 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee91bd-03ec-4969-89f4-f5f1ab37747a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:50.420846 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee91bd-03ec-4969-89f4-f5f1ab37747a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:50.421127 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee91bd-03ec-4969-89f4-f5f1ab37747a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:50.421424 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee91bd-03ec-4969-89f4-f5f1ab37747a admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:50.422527 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee91bd-03ec-4969-89f4-f5f1ab37747a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:50.425008 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee91bd-03ec-4969-89f4-f5f1ab37747a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:50.428547 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea85686-4c38-4e0c-b746-5b704db8fbac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:50.430079 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea85686-4c38-4e0c-b746-5b704db8fbac service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:50.444968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1251/2519] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:32:50.450200 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1269/2520] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:32:50 2022] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:32:50.455304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea85686-4c38-4e0c-b746-5b704db8fbac service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:50.467100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea85686-4c38-4e0c-b746-5b704db8fbac service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:50.472339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802fedd-1e91-4e6e-b56c-16bd6d4263df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:50.473033 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802fedd-1e91-4e6e-b56c-16bd6d4263df admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:50.473680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802fedd-1e91-4e6e-b56c-16bd6d4263df admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:50.473680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802fedd-1e91-4e6e-b56c-16bd6d4263df admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:50.474425 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802fedd-1e91-4e6e-b56c-16bd6d4263df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:50.476019 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802fedd-1e91-4e6e-b56c-16bd6d4263df admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:50.489597 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1252/2521] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:50.494548 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee91bd-03ec-4969-89f4-f5f1ab37747a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:50.505635 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee91bd-03ec-4969-89f4-f5f1ab37747a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:50.511626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f95ca-7287-420a-9882-561991bbbfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:50.512352 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f95ca-7287-420a-9882-561991bbbfb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:50.512637 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f95ca-7287-420a-9882-561991bbbfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:50.512916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f95ca-7287-420a-9882-561991bbbfb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:50.513676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f95ca-7287-420a-9882-561991bbbfb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:50.515857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f95ca-7287-420a-9882-561991bbbfb4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:50.528820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1270/2522] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:32:50.535392 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802fedd-1e91-4e6e-b56c-16bd6d4263df admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:50.555215 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802fedd-1e91-4e6e-b56c-16bd6d4263df admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:50.565263 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7913b-4588-4c34-9b4b-1694806d6609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:50.567177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7913b-4588-4c34-9b4b-1694806d6609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:50.567609 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7913b-4588-4c34-9b4b-1694806d6609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:50.568198 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7913b-4588-4c34-9b4b-1694806d6609 admin admin] PATH_INFO: `/v3/projects/6ab0470730524463a88e79a6ed4fd1e8/users/1ffe790c6f5a4d5bb2ebdd8c2574c448/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:50.598123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7913b-4588-4c34-9b4b-1694806d6609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ab0470730524463a88e79a6ed4fd1e8, user_id=1ffe790c6f5a4d5bb2ebdd8c2574c448, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:50.603838 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7913b-4588-4c34-9b4b-1694806d6609 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:50.625567 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1253/2523] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:50 2022] PUT /identity/v3/projects/6ab0470730524463a88e79a6ed4fd1e8/users/1ffe790c6f5a4d5bb2ebdd8c2574c448/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:50.649003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62b0e3-1c34-4e36-a79b-82874610e490 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:50.649003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62b0e3-1c34-4e36-a79b-82874610e490 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:50.649003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62b0e3-1c34-4e36-a79b-82874610e490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:50.698769 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9f62b0e3-1c34-4e36-a79b-82874610e490 None None] MFA Rules not processed for user `1ffe790c6f5a4d5bb2ebdd8c2574c448`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:50.700919 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9f62b0e3-1c34-4e36-a79b-82874610e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:50.808675 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1271/2524] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:50.813900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7913b-4588-4c34-9b4b-1694806d6609 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:50.865360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62b0e3-1c34-4e36-a79b-82874610e490 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:50.869994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9f62b0e3-1c34-4e36-a79b-82874610e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:50.941449 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7913b-4588-4c34-9b4b-1694806d6609 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:50.948028 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9982dd3-22cd-455a-abce-01cc743ced58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:50.949103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9982dd3-22cd-455a-abce-01cc743ced58 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:50.949571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9982dd3-22cd-455a-abce-01cc743ced58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:50.949935 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9982dd3-22cd-455a-abce-01cc743ced58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:50.950930 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9982dd3-22cd-455a-abce-01cc743ced58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:50.953141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9982dd3-22cd-455a-abce-01cc743ced58 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:50.965138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62b0e3-1c34-4e36-a79b-82874610e490 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:50.972174 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12024153-33b5-4924-82d4-a341c33dce92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:50.973108 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12024153-33b5-4924-82d4-a341c33dce92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:50.973428 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12024153-33b5-4924-82d4-a341c33dce92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:50.973765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12024153-33b5-4924-82d4-a341c33dce92 admin admin] PATH_INFO: `/v3/projects/f41880cd8144477190f7fa37535eefa3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:50.975372 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12024153-33b5-4924-82d4-a341c33dce92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41880cd8144477190f7fa37535eefa3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:50.977509 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12024153-33b5-4924-82d4-a341c33dce92 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:50.986263 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1254/2525] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:50 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:32:50.992761 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9982dd3-22cd-455a-abce-01cc743ced58 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:51.050830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-12024153-33b5-4924-82d4-a341c33dce92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41880cd8144477190f7fa37535eefa3', 'request_id': 'req-12024153-33b5-4924-82d4-a341c33dce92'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:51.057293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:51.061561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:51.064981 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-12024153-33b5-4924-82d4-a341c33dce92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41880cd8144477190f7fa37535eefa3', 'request_id': 'req-12024153-33b5-4924-82d4-a341c33dce92'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:51.075611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-12024153-33b5-4924-82d4-a341c33dce92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41880cd8144477190f7fa37535eefa3', 'request_id': 'req-12024153-33b5-4924-82d4-a341c33dce92'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:51.107059 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-12024153-33b5-4924-82d4-a341c33dce92 admin admin] The token cache is being invalidate because project f41880cd8144477190f7fa37535eefa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:51.108460 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-12024153-33b5-4924-82d4-a341c33dce92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:51.108916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-12024153-33b5-4924-82d4-a341c33dce92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:51.115427 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9982dd3-22cd-455a-abce-01cc743ced58 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:51.115604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1272/2526] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:50 2022] DELETE /identity/v3/projects/f41880cd8144477190f7fa37535eefa3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:51.117277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12024153-33b5-4924-82d4-a341c33dce92 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:51.120586 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-12024153-33b5-4924-82d4-a341c33dce92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:51.249429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1142e-1959-4bab-b881-233b3a151abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:51.250740 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1142e-1959-4bab-b881-233b3a151abf admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:51.251325 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1142e-1959-4bab-b881-233b3a151abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:51.251908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1142e-1959-4bab-b881-233b3a151abf admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:51.253220 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1142e-1959-4bab-b881-233b3a151abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:51.256967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1142e-1959-4bab-b881-233b3a151abf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:51.257859 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12024153-33b5-4924-82d4-a341c33dce92 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:51.265999 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44efc8-5dc3-4665-b6d3-fd8e819dba19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:51.267600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44efc8-5dc3-4665-b6d3-fd8e819dba19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:51.268073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44efc8-5dc3-4665-b6d3-fd8e819dba19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:51.268525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44efc8-5dc3-4665-b6d3-fd8e819dba19 admin admin] PATH_INFO: `/v3/users/19156529facd4b1dbe433a4f8d718cbd` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:51.271398 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44efc8-5dc3-4665-b6d3-fd8e819dba19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19156529facd4b1dbe433a4f8d718cbd)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:51.275358 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44efc8-5dc3-4665-b6d3-fd8e819dba19 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:51.305081 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1255/2527] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:32:50 2022] POST /identity/v3/users => generated 297 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:32:51.306628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1142e-1959-4bab-b881-233b3a151abf admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:51.308706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-25d1142e-1959-4bab-b881-233b3a151abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:51.326769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1142e-1959-4bab-b881-233b3a151abf admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:51.333968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bacc16-2fe2-4510-bfe8-1e9b6516f227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:51.334948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bacc16-2fe2-4510-bfe8-1e9b6516f227 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:51.335288 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bacc16-2fe2-4510-bfe8-1e9b6516f227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:51.335575 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bacc16-2fe2-4510-bfe8-1e9b6516f227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:51.336346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bacc16-2fe2-4510-bfe8-1e9b6516f227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:51.338340 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bacc16-2fe2-4510-bfe8-1e9b6516f227 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:51.357351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1256/2528] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:51.358800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bacc16-2fe2-4510-bfe8-1e9b6516f227 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:51.375145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7c44efc8-5dc3-4665-b6d3-fd8e819dba19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19156529facd4b1dbe433a4f8d718cbd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:51.394283 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7c44efc8-5dc3-4665-b6d3-fd8e819dba19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19156529facd4b1dbe433a4f8d718cbd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:51.396655 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7c44efc8-5dc3-4665-b6d3-fd8e819dba19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19156529facd4b1dbe433a4f8d718cbd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:51.397929 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7c44efc8-5dc3-4665-b6d3-fd8e819dba19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19156529facd4b1dbe433a4f8d718cbd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:51.398563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bacc16-2fe2-4510-bfe8-1e9b6516f227 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:51.406435 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1688402-355a-4b0a-b952-2b64c5934a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:51.407866 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1688402-355a-4b0a-b952-2b64c5934a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:51.408286 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1688402-355a-4b0a-b952-2b64c5934a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:51.408704 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1688402-355a-4b0a-b952-2b64c5934a96 admin admin] PATH_INFO: `/v3/projects/0ce205736bb4441d80f45c5189f1c4b6/users/4ab06ffbae49413d9ef0fd8f8099e0e5/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:51.430113 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7c44efc8-5dc3-4665-b6d3-fd8e819dba19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19156529facd4b1dbe433a4f8d718cbd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:51.439380 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1688402-355a-4b0a-b952-2b64c5934a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce205736bb4441d80f45c5189f1c4b6, user_id=4ab06ffbae49413d9ef0fd8f8099e0e5, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:51.445055 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1688402-355a-4b0a-b952-2b64c5934a96 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:51.463540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1273/2529] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:32:51 2022] DELETE /identity/v3/users/19156529facd4b1dbe433a4f8d718cbd => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:51.465326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1257/2530] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:51 2022] PUT /identity/v3/projects/0ce205736bb4441d80f45c5189f1c4b6/users/4ab06ffbae49413d9ef0fd8f8099e0e5/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:32:51.469564 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44efc8-5dc3-4665-b6d3-fd8e819dba19 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:51.473304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7c44efc8-5dc3-4665-b6d3-fd8e819dba19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:51.596321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44efc8-5dc3-4665-b6d3-fd8e819dba19 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:51.604946 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c92d67-2e9c-4b8e-ad46-637eb5fc6b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:51.605967 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c92d67-2e9c-4b8e-ad46-637eb5fc6b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:51.606369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c92d67-2e9c-4b8e-ad46-637eb5fc6b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:51.606755 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c92d67-2e9c-4b8e-ad46-637eb5fc6b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:51.607695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c92d67-2e9c-4b8e-ad46-637eb5fc6b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:51.609589 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c92d67-2e9c-4b8e-ad46-637eb5fc6b32 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:51.618026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:51.627606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1274/2531] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:32:51.631339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1688402-355a-4b0a-b952-2b64c5934a96 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:51.748153 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1688402-355a-4b0a-b952-2b64c5934a96 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:51.755151 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0ccc-2608-4349-b35f-935a0e7a305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:51.757101 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0ccc-2608-4349-b35f-935a0e7a305b admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:51.757628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0ccc-2608-4349-b35f-935a0e7a305b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:51.758122 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0ccc-2608-4349-b35f-935a0e7a305b admin admin] PATH_INFO: `/v3/projects/0ce205736bb4441d80f45c5189f1c4b6/users/4ab06ffbae49413d9ef0fd8f8099e0e5/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:51.760430 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a0ccc-2608-4349-b35f-935a0e7a305b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce205736bb4441d80f45c5189f1c4b6, user_id=4ab06ffbae49413d9ef0fd8f8099e0e5, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:51.763375 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a0ccc-2608-4349-b35f-935a0e7a305b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:51.778121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1258/2532] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:51 2022] PUT /identity/v3/projects/0ce205736bb4441d80f45c5189f1c4b6/users/4ab06ffbae49413d9ef0fd8f8099e0e5/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:51.788665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3ebf9-d755-4bef-91b9-6667b5d9bb7b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:51.789019 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3ebf9-d755-4bef-91b9-6667b5d9bb7b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:51.789837 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3ebf9-d755-4bef-91b9-6667b5d9bb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:51.828277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e8a3ebf9-d755-4bef-91b9-6667b5d9bb7b None None] MFA Rules not processed for user `4ab06ffbae49413d9ef0fd8f8099e0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:51.831483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e8a3ebf9-d755-4bef-91b9-6667b5d9bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:51.918975 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0ccc-2608-4349-b35f-935a0e7a305b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:51.921100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-389a0ccc-2608-4349-b35f-935a0e7a305b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:51.993056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:51.994805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1275/2533] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:52.013043 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3ebf9-d755-4bef-91b9-6667b5d9bb7b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:52.014856 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e8a3ebf9-d755-4bef-91b9-6667b5d9bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:52.068539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0ccc-2608-4349-b35f-935a0e7a305b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:52.075930 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd1d27-c8e5-445c-ba0d-99e362a20484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:52.076887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd1d27-c8e5-445c-ba0d-99e362a20484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:52.077179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd1d27-c8e5-445c-ba0d-99e362a20484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:52.077750 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd1d27-c8e5-445c-ba0d-99e362a20484 admin admin] PATH_INFO: `/v3/projects/19b25304d561439995cc1d5340f427f9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:52.079496 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd1d27-c8e5-445c-ba0d-99e362a20484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b25304d561439995cc1d5340f427f9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:52.082051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd1d27-c8e5-445c-ba0d-99e362a20484 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:52.137725 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3ebf9-d755-4bef-91b9-6667b5d9bb7b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:52.160721 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bcdd1d27-c8e5-445c-ba0d-99e362a20484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b25304d561439995cc1d5340f427f9', 'request_id': 'req-bcdd1d27-c8e5-445c-ba0d-99e362a20484'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:52.173865 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bcdd1d27-c8e5-445c-ba0d-99e362a20484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b25304d561439995cc1d5340f427f9', 'request_id': 'req-bcdd1d27-c8e5-445c-ba0d-99e362a20484'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:52.185625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bcdd1d27-c8e5-445c-ba0d-99e362a20484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b25304d561439995cc1d5340f427f9', 'request_id': 'req-bcdd1d27-c8e5-445c-ba0d-99e362a20484'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:52.201791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bcdd1d27-c8e5-445c-ba0d-99e362a20484 admin admin] The token cache is being invalidate because project 19b25304d561439995cc1d5340f427f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:52.202089 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bcdd1d27-c8e5-445c-ba0d-99e362a20484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:52.202886 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bcdd1d27-c8e5-445c-ba0d-99e362a20484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:52.204991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1259/2534] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:51 2022] DELETE /identity/v3/projects/19b25304d561439995cc1d5340f427f9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:32:52.210052 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ca8a-041c-466f-ab19-d9eb7fdd9b1f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:52.210380 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ca8a-041c-466f-ab19-d9eb7fdd9b1f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:52.210664 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ca8a-041c-466f-ab19-d9eb7fdd9b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:52.221876 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170540c7-5c44-46d4-8fc0-47e847d3b6ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:52.222792 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170540c7-5c44-46d4-8fc0-47e847d3b6ee service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:52.223147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170540c7-5c44-46d4-8fc0-47e847d3b6ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:52.223463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170540c7-5c44-46d4-8fc0-47e847d3b6ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:52.226204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-170540c7-5c44-46d4-8fc0-47e847d3b6ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:52.232483 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f521ca8a-041c-466f-ab19-d9eb7fdd9b1f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:52.234264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f521ca8a-041c-466f-ab19-d9eb7fdd9b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:52.316997 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:52.327884 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1260/2535] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:52.333406 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170540c7-5c44-46d4-8fc0-47e847d3b6ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:52.335136 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170540c7-5c44-46d4-8fc0-47e847d3b6ee service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:52.335732 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61ce93-afa9-4533-9c86-397356fbdad1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:52.336039 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61ce93-afa9-4533-9c86-397356fbdad1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:52.336320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61ce93-afa9-4533-9c86-397356fbdad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:52.347254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1276/2536] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:32:52.360228 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bb61ce93-afa9-4533-9c86-397356fbdad1 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:52.362755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bb61ce93-afa9-4533-9c86-397356fbdad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:52.376513 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1261/2537] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:52.382762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170540c7-5c44-46d4-8fc0-47e847d3b6ee service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:52.400382 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170540c7-5c44-46d4-8fc0-47e847d3b6ee service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:52.406155 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77b3f3-7b3d-401b-bce4-b3f34d9e317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:52.407622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77b3f3-7b3d-401b-bce4-b3f34d9e317b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:52.407904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77b3f3-7b3d-401b-bce4-b3f34d9e317b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:52.408178 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77b3f3-7b3d-401b-bce4-b3f34d9e317b admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:52.408925 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77b3f3-7b3d-401b-bce4-b3f34d9e317b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:32:52.409229 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77b3f3-7b3d-401b-bce4-b3f34d9e317b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:52.410893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77b3f3-7b3d-401b-bce4-b3f34d9e317b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:52.430082 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1277/2538] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:32:52.435537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61ce93-afa9-4533-9c86-397356fbdad1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:52.446397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61ce93-afa9-4533-9c86-397356fbdad1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:52.451539 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48875513-38e4-45d8-b5a3-3b317df5c3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:52.452302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48875513-38e4-45d8-b5a3-3b317df5c3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:52.452800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48875513-38e4-45d8-b5a3-3b317df5c3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:52.452800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48875513-38e4-45d8-b5a3-3b317df5c3f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:52.454770 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48875513-38e4-45d8-b5a3-3b317df5c3f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:52.456805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48875513-38e4-45d8-b5a3-3b317df5c3f3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:52.493224 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1262/2539] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:52 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:52.494673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77b3f3-7b3d-401b-bce4-b3f34d9e317b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:52.507821 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77b3f3-7b3d-401b-bce4-b3f34d9e317b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:52.594440 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bbbcd-64b8-416e-a37b-d9afab61d1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:52.595335 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bbbcd-64b8-416e-a37b-d9afab61d1cf admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:52.595827 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bbbcd-64b8-416e-a37b-d9afab61d1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:52.596298 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bbbcd-64b8-416e-a37b-d9afab61d1cf admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:52.597384 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bbbcd-64b8-416e-a37b-d9afab61d1cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:52.599818 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bbbcd-64b8-416e-a37b-d9afab61d1cf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:52.627786 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1278/2540] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:32:52 2022] POST /identity/v3/users => generated 282 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:52.633338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48875513-38e4-45d8-b5a3-3b317df5c3f3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:52.649667 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48875513-38e4-45d8-b5a3-3b317df5c3f3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:52.655707 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3851e-622d-4898-90db-133c70375b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:52.657517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3851e-622d-4898-90db-133c70375b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:52.657946 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3851e-622d-4898-90db-133c70375b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:52.658323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3851e-622d-4898-90db-133c70375b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:52.659581 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3851e-622d-4898-90db-133c70375b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:52.662429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3851e-622d-4898-90db-133c70375b25 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:52.679772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1263/2541] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:52.684181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bbbcd-64b8-416e-a37b-d9afab61d1cf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:52.695731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bbbcd-64b8-416e-a37b-d9afab61d1cf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:52.701172 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058f29a-d03c-430b-b182-ad7b35887e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:52.701867 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058f29a-d03c-430b-b182-ad7b35887e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:52.702304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058f29a-d03c-430b-b182-ad7b35887e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:52.702688 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058f29a-d03c-430b-b182-ad7b35887e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:52.704132 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058f29a-d03c-430b-b182-ad7b35887e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:52.705733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058f29a-d03c-430b-b182-ad7b35887e81 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:52.717433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1279/2542] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:52.723623 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3851e-622d-4898-90db-133c70375b25 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:52.737470 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3851e-622d-4898-90db-133c70375b25 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:52.742529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b1a26-c61c-4bc0-a7e7-89c86fe9484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:52.743594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b1a26-c61c-4bc0-a7e7-89c86fe9484b admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:52.743941 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b1a26-c61c-4bc0-a7e7-89c86fe9484b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:52.744281 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b1a26-c61c-4bc0-a7e7-89c86fe9484b admin admin] PATH_INFO: `/v3/projects/d6c619f916b2414e9355ac222d9c1aa7/users/3cc39fa137a440aa9634c5772701e5ed/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:52.761192 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b1a26-c61c-4bc0-a7e7-89c86fe9484b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c619f916b2414e9355ac222d9c1aa7, user_id=3cc39fa137a440aa9634c5772701e5ed, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:52.769412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b1a26-c61c-4bc0-a7e7-89c86fe9484b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:52.776833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:52.788429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1264/2543] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:52 2022] PUT /identity/v3/projects/d6c619f916b2414e9355ac222d9c1aa7/users/3cc39fa137a440aa9634c5772701e5ed/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:52.808663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4fbf6-5914-43aa-9045-45927561c5f6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:52.808947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4fbf6-5914-43aa-9045-45927561c5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:52.809291 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4fbf6-5914-43aa-9045-45927561c5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:52.811966 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b1a26-c61c-4bc0-a7e7-89c86fe9484b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:52.843096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-39b4fbf6-5914-43aa-9045-45927561c5f6 None None] MFA Rules not processed for user `3cc39fa137a440aa9634c5772701e5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:52.845941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-39b4fbf6-5914-43aa-9045-45927561c5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:52.892197 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b1a26-c61c-4bc0-a7e7-89c86fe9484b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:52.898119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba1631-338b-4228-8474-b561e1abb8da tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab06ffbae49413d9ef0fd8f8099e0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ce205736bb4441d80f45c5189f1c4b6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:52.898835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba1631-338b-4228-8474-b561e1abb8da tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:52.899105 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba1631-338b-4228-8474-b561e1abb8da tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:52.899416 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba1631-338b-4228-8474-b561e1abb8da tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:52.900996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba1631-338b-4228-8474-b561e1abb8da tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:32:52.900996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba1631-338b-4228-8474-b561e1abb8da tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:52.902112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba1631-338b-4228-8474-b561e1abb8da tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:52.916016 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1265/2544] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:32:52.920440 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba1631-338b-4228-8474-b561e1abb8da tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:52.932596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba1631-338b-4228-8474-b561e1abb8da tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:52.938553 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6239c94-9941-4fd9-a66f-7ca219fca6f8 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab06ffbae49413d9ef0fd8f8099e0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ce205736bb4441d80f45c5189f1c4b6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:52.939277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6239c94-9941-4fd9-a66f-7ca219fca6f8 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:52.939597 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6239c94-9941-4fd9-a66f-7ca219fca6f8 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:52.939883 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6239c94-9941-4fd9-a66f-7ca219fca6f8 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:52.940579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6239c94-9941-4fd9-a66f-7ca219fca6f8 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:52.942559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6239c94-9941-4fd9-a66f-7ca219fca6f8 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:52.946875 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1280/2545] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:52.952112 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4fbf6-5914-43aa-9045-45927561c5f6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:52.976746 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1266/2546] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:52 2022] POST /identity/v3/projects => generated 355 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:32:52.981397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6239c94-9941-4fd9-a66f-7ca219fca6f8 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:53.020147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:53.038912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4fbf6-5914-43aa-9045-45927561c5f6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:53.062591 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6239c94-9941-4fd9-a66f-7ca219fca6f8 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:53.068368 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda26ab3-579e-4b9b-a85b-9421e352a19d tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab06ffbae49413d9ef0fd8f8099e0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ce205736bb4441d80f45c5189f1c4b6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:53.069456 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda26ab3-579e-4b9b-a85b-9421e352a19d tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:53.070487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda26ab3-579e-4b9b-a85b-9421e352a19d tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:53.070487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda26ab3-579e-4b9b-a85b-9421e352a19d tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:53.071829 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda26ab3-579e-4b9b-a85b-9421e352a19d tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:32:53.072270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda26ab3-579e-4b9b-a85b-9421e352a19d tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:53.074029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda26ab3-579e-4b9b-a85b-9421e352a19d tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:53.091628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1267/2547] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:32:53.129766 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86721d7b-ed4a-4fec-a3d8-e68091826e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:53.131131 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86721d7b-ed4a-4fec-a3d8-e68091826e42 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:53.131743 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86721d7b-ed4a-4fec-a3d8-e68091826e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:53.132324 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86721d7b-ed4a-4fec-a3d8-e68091826e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:53.133497 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86721d7b-ed4a-4fec-a3d8-e68091826e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:53.135975 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86721d7b-ed4a-4fec-a3d8-e68091826e42 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:53.142349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda26ab3-579e-4b9b-a85b-9421e352a19d tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:53.160649 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda26ab3-579e-4b9b-a85b-9421e352a19d tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:53.170949 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1281/2548] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:52 2022] POST /identity/v3/projects => generated 363 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:53.179658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86721d7b-ed4a-4fec-a3d8-e68091826e42 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:53.179783 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab06ffbae49413d9ef0fd8f8099e0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ce205736bb4441d80f45c5189f1c4b6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:53.179783 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:53.179783 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:53.180049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] PATH_INFO: `/v3/projects/c27c54ec0a4d4919a7f3270e67a0ca43` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:53.182457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c27c54ec0a4d4919a7f3270e67a0ca43)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:53.186619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:53.274385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86721d7b-ed4a-4fec-a3d8-e68091826e42 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:53.282026 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c27c54ec0a4d4919a7f3270e67a0ca43', 'request_id': 'req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:53.299420 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c27c54ec0a4d4919a7f3270e67a0ca43', 'request_id': 'req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:53.305776 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:53.308294 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c27c54ec0a4d4919a7f3270e67a0ca43', 'request_id': 'req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:53.324902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] The token cache is being invalidate because project c27c54ec0a4d4919a7f3270e67a0ca43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:53.324902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:53.325942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:53.334706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1268/2549] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:53 2022] DELETE /identity/v3/projects/c27c54ec0a4d4919a7f3270e67a0ca43 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:53.355841 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e396f-4806-453a-9e35-b19d02cd51c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:53.356519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e396f-4806-453a-9e35-b19d02cd51c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:53.356746 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e396f-4806-453a-9e35-b19d02cd51c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:53.357028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e396f-4806-453a-9e35-b19d02cd51c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:53.357801 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e396f-4806-453a-9e35-b19d02cd51c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:53.360028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e396f-4806-453a-9e35-b19d02cd51c6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:53.392116 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1282/2550] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:32:53 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:32:53.393932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:53.395691 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:53.412131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3da85-e40f-4c27-a9bd-99d9cbc37dc2 tempest-VolumeQuotaClassesTest-1907032895 tempest-VolumeQuotaClassesTest-1907032895-project-admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:53.421583 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fe4ea-4185-4096-a483-cfca77419848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:53.423261 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fe4ea-4185-4096-a483-cfca77419848 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:53.423760 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fe4ea-4185-4096-a483-cfca77419848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:53.424209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fe4ea-4185-4096-a483-cfca77419848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:53.425731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fe4ea-4185-4096-a483-cfca77419848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:53.428259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fe4ea-4185-4096-a483-cfca77419848 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:53.448816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1269/2551] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:53.449556 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e396f-4806-453a-9e35-b19d02cd51c6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:53.469523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e396f-4806-453a-9e35-b19d02cd51c6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:53.487938 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9380758-d806-46e9-9326-8864338750f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:53.489392 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9380758-d806-46e9-9326-8864338750f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:53.489931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9380758-d806-46e9-9326-8864338750f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:53.490464 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9380758-d806-46e9-9326-8864338750f6 admin admin] PATH_INFO: `/v3/projects/a662ef15081e457a8320e98f01a082d6/users/f55c0e870a1444e1a5c7f4ac94db1043/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:53.514660 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:53.522521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9380758-d806-46e9-9326-8864338750f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a662ef15081e457a8320e98f01a082d6, user_id=f55c0e870a1444e1a5c7f4ac94db1043, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:53.528023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9380758-d806-46e9-9326-8864338750f6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:53.553728 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1283/2552] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:53 2022] PUT /identity/v3/projects/a662ef15081e457a8320e98f01a082d6/users/f55c0e870a1444e1a5c7f4ac94db1043/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:53.556006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fe4ea-4185-4096-a483-cfca77419848 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:53.571432 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fe4ea-4185-4096-a483-cfca77419848 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:53.648679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9380758-d806-46e9-9326-8864338750f6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:53.650530 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e9380758-d806-46e9-9326-8864338750f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:53.655802 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bee04-012e-4c26-87c5-cb89f30c93dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:53.656567 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bee04-012e-4c26-87c5-cb89f30c93dc admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:53.656854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bee04-012e-4c26-87c5-cb89f30c93dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:53.657137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bee04-012e-4c26-87c5-cb89f30c93dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:53.657892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20bee04-012e-4c26-87c5-cb89f30c93dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:53.659611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20bee04-012e-4c26-87c5-cb89f30c93dc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:53.665670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9380758-d806-46e9-9326-8864338750f6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:53.671592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1270/2553] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:53.674295 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923ef13-c3fe-4c1f-9cc6-c3049a4eaf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:53.676059 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923ef13-c3fe-4c1f-9cc6-c3049a4eaf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:53.676581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923ef13-c3fe-4c1f-9cc6-c3049a4eaf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:53.676773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bee04-012e-4c26-87c5-cb89f30c93dc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:53.677120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923ef13-c3fe-4c1f-9cc6-c3049a4eaf00 admin admin] PATH_INFO: `/v3/users/1ffe790c6f5a4d5bb2ebdd8c2574c448` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:53.679456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923ef13-c3fe-4c1f-9cc6-c3049a4eaf00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ffe790c6f5a4d5bb2ebdd8c2574c448)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:53.684520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923ef13-c3fe-4c1f-9cc6-c3049a4eaf00 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:53.687803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bee04-012e-4c26-87c5-cb89f30c93dc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:53.693311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6fd47-3679-4e51-92d6-dda9d9dde416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:53.694287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6fd47-3679-4e51-92d6-dda9d9dde416 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:53.694593 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6fd47-3679-4e51-92d6-dda9d9dde416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:53.694856 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6fd47-3679-4e51-92d6-dda9d9dde416 admin admin] PATH_INFO: `/v3/projects/a662ef15081e457a8320e98f01a082d6/users/f55c0e870a1444e1a5c7f4ac94db1043/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:53.696965 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6fd47-3679-4e51-92d6-dda9d9dde416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a662ef15081e457a8320e98f01a082d6, user_id=f55c0e870a1444e1a5c7f4ac94db1043, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:53.699739 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6fd47-3679-4e51-92d6-dda9d9dde416 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:53.713041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1271/2554] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:53 2022] PUT /identity/v3/projects/a662ef15081e457a8320e98f01a082d6/users/f55c0e870a1444e1a5c7f4ac94db1043/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:32:53.725884 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50302a-bd7e-4b5f-8e12-47500bb63d08 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:53.726307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50302a-bd7e-4b5f-8e12-47500bb63d08 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:53.726597 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50302a-bd7e-4b5f-8e12-47500bb63d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:53.753554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f923ef13-c3fe-4c1f-9cc6-c3049a4eaf00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ffe790c6f5a4d5bb2ebdd8c2574c448'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:53.761482 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f923ef13-c3fe-4c1f-9cc6-c3049a4eaf00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ffe790c6f5a4d5bb2ebdd8c2574c448'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:53.762280 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f923ef13-c3fe-4c1f-9cc6-c3049a4eaf00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ffe790c6f5a4d5bb2ebdd8c2574c448'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:53.762914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f923ef13-c3fe-4c1f-9cc6-c3049a4eaf00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ffe790c6f5a4d5bb2ebdd8c2574c448'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:53.771048 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0f50302a-bd7e-4b5f-8e12-47500bb63d08 None None] MFA Rules not processed for user `f55c0e870a1444e1a5c7f4ac94db1043`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:53.773248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0f50302a-bd7e-4b5f-8e12-47500bb63d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:53.777668 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f923ef13-c3fe-4c1f-9cc6-c3049a4eaf00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ffe790c6f5a4d5bb2ebdd8c2574c448'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:53.794936 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1284/2555] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:32:53 2022] DELETE /identity/v3/users/1ffe790c6f5a4d5bb2ebdd8c2574c448 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:32:53.801581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c258e1-e3eb-40de-8f00-c2aabd0857c3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:53.801873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c258e1-e3eb-40de-8f00-c2aabd0857c3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:53.802181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c258e1-e3eb-40de-8f00-c2aabd0857c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:53.820672 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-07c258e1-e3eb-40de-8f00-c2aabd0857c3 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:53.821923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-07c258e1-e3eb-40de-8f00-c2aabd0857c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:53.881513 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1272/2556] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:53 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:53.898131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50302a-bd7e-4b5f-8e12-47500bb63d08 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:53.899914 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0f50302a-bd7e-4b5f-8e12-47500bb63d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:53.921248 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1285/2557] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:53.935002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c258e1-e3eb-40de-8f00-c2aabd0857c3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:53.937658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-07c258e1-e3eb-40de-8f00-c2aabd0857c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:53.972366 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:53.980352 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50302a-bd7e-4b5f-8e12-47500bb63d08 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:54.022689 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c258e1-e3eb-40de-8f00-c2aabd0857c3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:54.027639 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c558-8e6c-440b-bc13-0220e85fce32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:54.028534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c558-8e6c-440b-bc13-0220e85fce32 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:54.028953 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c558-8e6c-440b-bc13-0220e85fce32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:54.029366 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c558-8e6c-440b-bc13-0220e85fce32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:54.041831 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6c558-8e6c-440b-bc13-0220e85fce32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:54.043369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6c558-8e6c-440b-bc13-0220e85fce32 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:54.052891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231696c-456f-4ed4-b248-40ab83fea3bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:54.054029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231696c-456f-4ed4-b248-40ab83fea3bb service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:54.054600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231696c-456f-4ed4-b248-40ab83fea3bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:54.055091 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231696c-456f-4ed4-b248-40ab83fea3bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:54.055660 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1286/2558] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:32:54.156349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231696c-456f-4ed4-b248-40ab83fea3bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:54.158288 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231696c-456f-4ed4-b248-40ab83fea3bb service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:54.170492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1273/2559] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:53 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:32:54.266316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c558-8e6c-440b-bc13-0220e85fce32 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:54.281912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c558-8e6c-440b-bc13-0220e85fce32 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:54.289289 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc76f20-36d1-43b1-88a3-d68ed63cebc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:54.290658 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc76f20-36d1-43b1-88a3-d68ed63cebc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:54.291073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc76f20-36d1-43b1-88a3-d68ed63cebc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:54.291583 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc76f20-36d1-43b1-88a3-d68ed63cebc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:54.294652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ddc76f20-36d1-43b1-88a3-d68ed63cebc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:54.302941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:54.393620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc76f20-36d1-43b1-88a3-d68ed63cebc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:54.395266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc76f20-36d1-43b1-88a3-d68ed63cebc3 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:54.406480 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1287/2560] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:54 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:32:54.436415 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231696c-456f-4ed4-b248-40ab83fea3bb service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:54.439182 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2231696c-456f-4ed4-b248-40ab83fea3bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:54.457563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231696c-456f-4ed4-b248-40ab83fea3bb service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:54.462589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:54.463513 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:54.463817 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:54.464109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3 admin admin] PATH_INFO: `/v3/projects/6ab0470730524463a88e79a6ed4fd1e8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:54.471556 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ab0470730524463a88e79a6ed4fd1e8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:54.473796 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:54.557277 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ab0470730524463a88e79a6ed4fd1e8', 'request_id': 'req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:54.571133 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ab0470730524463a88e79a6ed4fd1e8', 'request_id': 'req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:54.583597 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ab0470730524463a88e79a6ed4fd1e8', 'request_id': 'req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:54.600942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3 admin admin] The token cache is being invalidate because project 6ab0470730524463a88e79a6ed4fd1e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:54.601321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:54.602150 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:54.605264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1274/2561] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:54 2022] DELETE /identity/v3/projects/6ab0470730524463a88e79a6ed4fd1e8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:54.609812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc76f20-36d1-43b1-88a3-d68ed63cebc3 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:54.636723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc76f20-36d1-43b1-88a3-d68ed63cebc3 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:54.732229 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ead07-52cb-46a1-9431-fcc85566fb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:54.733884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ead07-52cb-46a1-9431-fcc85566fb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:54.734471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ead07-52cb-46a1-9431-fcc85566fb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:54.734947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ead07-52cb-46a1-9431-fcc85566fb50 admin admin] PATH_INFO: `/v3/users/4ab06ffbae49413d9ef0fd8f8099e0e5` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:54.737240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ead07-52cb-46a1-9431-fcc85566fb50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ab06ffbae49413d9ef0fd8f8099e0e5)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:54.741074 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ead07-52cb-46a1-9431-fcc85566fb50 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:54.808363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f95ead07-52cb-46a1-9431-fcc85566fb50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ab06ffbae49413d9ef0fd8f8099e0e5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:54.820461 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f95ead07-52cb-46a1-9431-fcc85566fb50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ab06ffbae49413d9ef0fd8f8099e0e5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:54.821727 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f95ead07-52cb-46a1-9431-fcc85566fb50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ab06ffbae49413d9ef0fd8f8099e0e5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:54.822766 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f95ead07-52cb-46a1-9431-fcc85566fb50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ab06ffbae49413d9ef0fd8f8099e0e5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:54.843094 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f95ead07-52cb-46a1-9431-fcc85566fb50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ab06ffbae49413d9ef0fd8f8099e0e5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:54.861637 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1288/2562] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:32:54 2022] DELETE /identity/v3/users/4ab06ffbae49413d9ef0fd8f8099e0e5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:55.220573 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:55.222978 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:55.240040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21b740-4b6c-44ad-87f1-1dc9ad6a04d3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:55.311988 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:55.358546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea04a3-5d43-422d-a897-632b41581eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:55.360698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea04a3-5d43-422d-a897-632b41581eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:55.361266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea04a3-5d43-422d-a897-632b41581eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:55.361801 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea04a3-5d43-422d-a897-632b41581eb9 admin admin] PATH_INFO: `/v3/projects/0ce205736bb4441d80f45c5189f1c4b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:55.364310 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea04a3-5d43-422d-a897-632b41581eb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce205736bb4441d80f45c5189f1c4b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:55.368169 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea04a3-5d43-422d-a897-632b41581eb9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:55.443702 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-79ea04a3-5d43-422d-a897-632b41581eb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce205736bb4441d80f45c5189f1c4b6', 'request_id': 'req-79ea04a3-5d43-422d-a897-632b41581eb9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:55.454600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-79ea04a3-5d43-422d-a897-632b41581eb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce205736bb4441d80f45c5189f1c4b6', 'request_id': 'req-79ea04a3-5d43-422d-a897-632b41581eb9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:55.461811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-79ea04a3-5d43-422d-a897-632b41581eb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce205736bb4441d80f45c5189f1c4b6', 'request_id': 'req-79ea04a3-5d43-422d-a897-632b41581eb9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:55.474803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-79ea04a3-5d43-422d-a897-632b41581eb9 admin admin] The token cache is being invalidate because project 0ce205736bb4441d80f45c5189f1c4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:55.475091 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-79ea04a3-5d43-422d-a897-632b41581eb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:55.475804 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-79ea04a3-5d43-422d-a897-632b41581eb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:55.477445 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1275/2563] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:55 2022] DELETE /identity/v3/projects/0ce205736bb4441d80f45c5189f1c4b6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:32:55.483259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13902b-029a-48bf-b346-8323c2840426 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:55.483814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13902b-029a-48bf-b346-8323c2840426 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:55.483814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13902b-029a-48bf-b346-8323c2840426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:55.504452 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6b13902b-029a-48bf-b346-8323c2840426 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:55.506187 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6b13902b-029a-48bf-b346-8323c2840426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:55.532254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:55.587081 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1289/2564] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:55.602124 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2e63b-0db2-4806-88ea-a19abce137f8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:55.602673 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2e63b-0db2-4806-88ea-a19abce137f8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:55.603188 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2e63b-0db2-4806-88ea-a19abce137f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:55.628285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-abb2e63b-0db2-4806-88ea-a19abce137f8 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:55.629619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-abb2e63b-0db2-4806-88ea-a19abce137f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:55.643041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1276/2565] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:55.651199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13902b-029a-48bf-b346-8323c2840426 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:55.665857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13902b-029a-48bf-b346-8323c2840426 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:55.673449 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd768e-0408-42f3-96cf-ce62726b93d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:55.674649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd768e-0408-42f3-96cf-ce62726b93d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:55.675221 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd768e-0408-42f3-96cf-ce62726b93d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:55.676516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd768e-0408-42f3-96cf-ce62726b93d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:55.677150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd768e-0408-42f3-96cf-ce62726b93d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:32:55.677624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd768e-0408-42f3-96cf-ce62726b93d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:55.680521 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd768e-0408-42f3-96cf-ce62726b93d1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:55.699061 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1290/2566] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:32:55.711660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2e63b-0db2-4806-88ea-a19abce137f8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:55.727944 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2e63b-0db2-4806-88ea-a19abce137f8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:55.736935 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41f6b3-e3ec-4bb2-b01b-06ad00d0ec6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:55.738322 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41f6b3-e3ec-4bb2-b01b-06ad00d0ec6d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:55.738957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41f6b3-e3ec-4bb2-b01b-06ad00d0ec6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:55.739329 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41f6b3-e3ec-4bb2-b01b-06ad00d0ec6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:55.740751 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41f6b3-e3ec-4bb2-b01b-06ad00d0ec6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:55.746016 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41f6b3-e3ec-4bb2-b01b-06ad00d0ec6d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:55.800803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1277/2567] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:55 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:55.802612 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd768e-0408-42f3-96cf-ce62726b93d1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:55.817854 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd768e-0408-42f3-96cf-ce62726b93d1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:55.931785 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70338057-1825-4406-a0bf-efdc81312bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:55.932939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70338057-1825-4406-a0bf-efdc81312bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:55.933438 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70338057-1825-4406-a0bf-efdc81312bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:55.933959 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70338057-1825-4406-a0bf-efdc81312bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:55.935546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70338057-1825-4406-a0bf-efdc81312bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:55.939315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70338057-1825-4406-a0bf-efdc81312bd8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:55.977762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1291/2568] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:32:55 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:55.979230 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41f6b3-e3ec-4bb2-b01b-06ad00d0ec6d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:55.998606 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41f6b3-e3ec-4bb2-b01b-06ad00d0ec6d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:56.007402 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15853ae-325f-4a26-9550-9c46de9ba0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:56.008622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15853ae-325f-4a26-9550-9c46de9ba0bd admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:56.009132 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15853ae-325f-4a26-9550-9c46de9ba0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:56.009669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15853ae-325f-4a26-9550-9c46de9ba0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:56.011059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15853ae-325f-4a26-9550-9c46de9ba0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:56.014276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15853ae-325f-4a26-9550-9c46de9ba0bd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:56.031735 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70338057-1825-4406-a0bf-efdc81312bd8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:56.035960 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-70338057-1825-4406-a0bf-efdc81312bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:56.042107 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1278/2569] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:56.050024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15853ae-325f-4a26-9550-9c46de9ba0bd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:56.058354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70338057-1825-4406-a0bf-efdc81312bd8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:56.064356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a75da-bec8-42a6-ade1-832321a5c3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:56.065429 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a75da-bec8-42a6-ade1-832321a5c3c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:56.065809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a75da-bec8-42a6-ade1-832321a5c3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:56.066185 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a75da-bec8-42a6-ade1-832321a5c3c4 admin admin] PATH_INFO: `/v3/users/e9a3469027814feaa7bbd0d2d4d53db0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:56.067647 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a75da-bec8-42a6-ade1-832321a5c3c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a3469027814feaa7bbd0d2d4d53db0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:56.068061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15853ae-325f-4a26-9550-9c46de9ba0bd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:56.069809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a75da-bec8-42a6-ade1-832321a5c3c4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:56.076002 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274fbf9-525a-4fd4-8d07-10bd1ad98581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:56.077255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274fbf9-525a-4fd4-8d07-10bd1ad98581 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:56.077842 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274fbf9-525a-4fd4-8d07-10bd1ad98581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:56.078416 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274fbf9-525a-4fd4-8d07-10bd1ad98581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:56.079887 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274fbf9-525a-4fd4-8d07-10bd1ad98581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:56.082445 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274fbf9-525a-4fd4-8d07-10bd1ad98581 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:56.101781 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1279/2570] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:56.109026 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274fbf9-525a-4fd4-8d07-10bd1ad98581 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:56.130135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274fbf9-525a-4fd4-8d07-10bd1ad98581 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:56.137894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd92f4-cf03-4b6b-b9a0-f563e7eb0911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:56.139251 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd92f4-cf03-4b6b-b9a0-f563e7eb0911 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:56.139612 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd92f4-cf03-4b6b-b9a0-f563e7eb0911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:56.140006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd92f4-cf03-4b6b-b9a0-f563e7eb0911 admin admin] PATH_INFO: `/v3/projects/1a90239c62054eeeb75e560aaa058059/users/ae5a4eb30b254a488c22971ce4798605/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:56.154781 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3c8a75da-bec8-42a6-ade1-832321a5c3c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a3469027814feaa7bbd0d2d4d53db0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:56.165773 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd92f4-cf03-4b6b-b9a0-f563e7eb0911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a90239c62054eeeb75e560aaa058059, user_id=ae5a4eb30b254a488c22971ce4798605, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:56.168698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd92f4-cf03-4b6b-b9a0-f563e7eb0911 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:56.172221 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3c8a75da-bec8-42a6-ade1-832321a5c3c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a3469027814feaa7bbd0d2d4d53db0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:56.173500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3c8a75da-bec8-42a6-ade1-832321a5c3c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a3469027814feaa7bbd0d2d4d53db0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:56.174603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3c8a75da-bec8-42a6-ade1-832321a5c3c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a3469027814feaa7bbd0d2d4d53db0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:56.189611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1280/2571] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:56 2022] PUT /identity/v3/projects/1a90239c62054eeeb75e560aaa058059/users/ae5a4eb30b254a488c22971ce4798605/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:56.193509 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3c8a75da-bec8-42a6-ade1-832321a5c3c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a3469027814feaa7bbd0d2d4d53db0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:56.209409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace93a7-9fac-4a92-876a-f24212b9b7d6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:56.210849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace93a7-9fac-4a92-876a-f24212b9b7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:56.211208 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace93a7-9fac-4a92-876a-f24212b9b7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:56.220832 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1292/2572] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:32:56 2022] DELETE /identity/v3/users/e9a3469027814feaa7bbd0d2d4d53db0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:56.293664 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bace93a7-9fac-4a92-876a-f24212b9b7d6 None None] MFA Rules not processed for user `ae5a4eb30b254a488c22971ce4798605`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:56.295986 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bace93a7-9fac-4a92-876a-f24212b9b7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:56.366830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:56.414423 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1281/2573] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:56.419605 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a75da-bec8-42a6-ade1-832321a5c3c4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:56.421122 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3c8a75da-bec8-42a6-ade1-832321a5c3c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:56.451158 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:56.500265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace93a7-9fac-4a92-876a-f24212b9b7d6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:56.503528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bace93a7-9fac-4a92-876a-f24212b9b7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:56.541606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a75da-bec8-42a6-ade1-832321a5c3c4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:56.548555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af3a22-5150-498c-8229-8c0de35bc6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:56.548927 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af3a22-5150-498c-8229-8c0de35bc6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:56.549295 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af3a22-5150-498c-8229-8c0de35bc6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:56.549636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af3a22-5150-498c-8229-8c0de35bc6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:56.550490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af3a22-5150-498c-8229-8c0de35bc6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:56.552570 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af3a22-5150-498c-8229-8c0de35bc6c4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:56.594278 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1293/2574] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:56 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:56.599197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af3a22-5150-498c-8229-8c0de35bc6c4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:56.618551 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace93a7-9fac-4a92-876a-f24212b9b7d6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:56.675216 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af3a22-5150-498c-8229-8c0de35bc6c4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:56.680862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0183d-e4dc-4383-8c90-7e0ed3ba8522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:56.681560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0183d-e4dc-4383-8c90-7e0ed3ba8522 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:56.681846 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0183d-e4dc-4383-8c90-7e0ed3ba8522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:56.682119 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0183d-e4dc-4383-8c90-7e0ed3ba8522 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:56.682860 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0183d-e4dc-4383-8c90-7e0ed3ba8522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:56.684897 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0183d-e4dc-4383-8c90-7e0ed3ba8522 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:56.695180 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33735778-c78b-4e13-96ce-04d3e5172f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:56.696080 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33735778-c78b-4e13-96ce-04d3e5172f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:56.696354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33735778-c78b-4e13-96ce-04d3e5172f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:56.696628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33735778-c78b-4e13-96ce-04d3e5172f36 admin admin] PATH_INFO: `/v3/projects/5caefcae86b74ad3938101ead1b3adba` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:56.698109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33735778-c78b-4e13-96ce-04d3e5172f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5caefcae86b74ad3938101ead1b3adba)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:56.700144 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33735778-c78b-4e13-96ce-04d3e5172f36 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:56.723566 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1294/2575] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:32:56 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:56.728983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0183d-e4dc-4383-8c90-7e0ed3ba8522 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:56.747063 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0183d-e4dc-4383-8c90-7e0ed3ba8522 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:56.759412 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-33735778-c78b-4e13-96ce-04d3e5172f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5caefcae86b74ad3938101ead1b3adba', 'request_id': 'req-33735778-c78b-4e13-96ce-04d3e5172f36'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:56.770448 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-33735778-c78b-4e13-96ce-04d3e5172f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5caefcae86b74ad3938101ead1b3adba', 'request_id': 'req-33735778-c78b-4e13-96ce-04d3e5172f36'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:56.777970 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-33735778-c78b-4e13-96ce-04d3e5172f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5caefcae86b74ad3938101ead1b3adba', 'request_id': 'req-33735778-c78b-4e13-96ce-04d3e5172f36'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:56.797852 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-33735778-c78b-4e13-96ce-04d3e5172f36 admin admin] The token cache is being invalidate because project 5caefcae86b74ad3938101ead1b3adba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:56.798156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-33735778-c78b-4e13-96ce-04d3e5172f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:56.798972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-33735778-c78b-4e13-96ce-04d3e5172f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:56.800899 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1282/2576] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:56 2022] DELETE /identity/v3/projects/5caefcae86b74ad3938101ead1b3adba => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:56.806489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33735778-c78b-4e13-96ce-04d3e5172f36 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:56.808607 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-33735778-c78b-4e13-96ce-04d3e5172f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:56.834577 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4701c4-a705-4e6b-8deb-99d7a41506f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:56.835677 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4701c4-a705-4e6b-8deb-99d7a41506f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:56.836129 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4701c4-a705-4e6b-8deb-99d7a41506f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:56.836567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4701c4-a705-4e6b-8deb-99d7a41506f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:56.837767 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4701c4-a705-4e6b-8deb-99d7a41506f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:56.840467 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4701c4-a705-4e6b-8deb-99d7a41506f0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:56.841343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:56.853529 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1295/2577] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:56.858477 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4701c4-a705-4e6b-8deb-99d7a41506f0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:56.860569 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-de4701c4-a705-4e6b-8deb-99d7a41506f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:56.873793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4701c4-a705-4e6b-8deb-99d7a41506f0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:56.882418 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9074c5c-60e7-4207-bc8b-279b51396ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:56.883354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9074c5c-60e7-4207-bc8b-279b51396ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:56.883644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9074c5c-60e7-4207-bc8b-279b51396ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:56.883925 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9074c5c-60e7-4207-bc8b-279b51396ab2 admin admin] PATH_INFO: `/v3/projects/fbfcb10f6a064e8ba782114e8dec6d93/users/52e5d52645d944e281e715f14d74acff/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:56.900884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9074c5c-60e7-4207-bc8b-279b51396ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbfcb10f6a064e8ba782114e8dec6d93, user_id=52e5d52645d944e281e715f14d74acff, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:56.902264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33735778-c78b-4e13-96ce-04d3e5172f36 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:56.903636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9074c5c-60e7-4207-bc8b-279b51396ab2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:56.907967 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376577d-35d8-445c-9c11-bc71a48ca8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:56.909748 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376577d-35d8-445c-9c11-bc71a48ca8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:56.910102 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376577d-35d8-445c-9c11-bc71a48ca8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:56.910650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376577d-35d8-445c-9c11-bc71a48ca8a5 admin admin] PATH_INFO: `/v3/users/74af58b2c44f4e5cb56eeb9aa2bf1ae0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:56.912179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376577d-35d8-445c-9c11-bc71a48ca8a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74af58b2c44f4e5cb56eeb9aa2bf1ae0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:56.914590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376577d-35d8-445c-9c11-bc71a48ca8a5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:56.915570 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:56.921648 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1296/2578] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:56 2022] PUT /identity/v3/projects/fbfcb10f6a064e8ba782114e8dec6d93/users/52e5d52645d944e281e715f14d74acff/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:32:56.928707 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9074c5c-60e7-4207-bc8b-279b51396ab2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:56.972426 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c376577d-35d8-445c-9c11-bc71a48ca8a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74af58b2c44f4e5cb56eeb9aa2bf1ae0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:56.979650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c376577d-35d8-445c-9c11-bc71a48ca8a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74af58b2c44f4e5cb56eeb9aa2bf1ae0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:56.988487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c376577d-35d8-445c-9c11-bc71a48ca8a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74af58b2c44f4e5cb56eeb9aa2bf1ae0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:56.989204 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c376577d-35d8-445c-9c11-bc71a48ca8a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74af58b2c44f4e5cb56eeb9aa2bf1ae0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:57.006256 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c376577d-35d8-445c-9c11-bc71a48ca8a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74af58b2c44f4e5cb56eeb9aa2bf1ae0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:57.013253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1283/2579] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:32:56 2022] DELETE /identity/v3/users/74af58b2c44f4e5cb56eeb9aa2bf1ae0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:32:57.037520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9074c5c-60e7-4207-bc8b-279b51396ab2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:57.116295 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82bc0a-8479-42db-b65a-b648913d1ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:57.116295 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82bc0a-8479-42db-b65a-b648913d1ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:57.116295 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82bc0a-8479-42db-b65a-b648913d1ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:57.116295 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82bc0a-8479-42db-b65a-b648913d1ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:57.117130 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82bc0a-8479-42db-b65a-b648913d1ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:57.117130 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82bc0a-8479-42db-b65a-b648913d1ad1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:57.128249 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1297/2580] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:32:57.135365 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376577d-35d8-445c-9c11-bc71a48ca8a5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:57.137658 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c376577d-35d8-445c-9c11-bc71a48ca8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:57.162145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376577d-35d8-445c-9c11-bc71a48ca8a5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:57.170610 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40515eb-3cdb-4065-a4e0-dbdf2972da64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:57.172253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40515eb-3cdb-4065-a4e0-dbdf2972da64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:57.172766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40515eb-3cdb-4065-a4e0-dbdf2972da64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:57.173151 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40515eb-3cdb-4065-a4e0-dbdf2972da64 admin admin] PATH_INFO: `/v3/projects/fbfcb10f6a064e8ba782114e8dec6d93/users/52e5d52645d944e281e715f14d74acff/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:57.177181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40515eb-3cdb-4065-a4e0-dbdf2972da64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbfcb10f6a064e8ba782114e8dec6d93, user_id=52e5d52645d944e281e715f14d74acff, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:57.180877 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40515eb-3cdb-4065-a4e0-dbdf2972da64 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:57.195391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1284/2581] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:57 2022] PUT /identity/v3/projects/fbfcb10f6a064e8ba782114e8dec6d93/users/52e5d52645d944e281e715f14d74acff/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:57.206637 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e8dfc-8fb3-4342-8cd3-f566e8623d4e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:57.206921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e8dfc-8fb3-4342-8cd3-f566e8623d4e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:57.207190 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e8dfc-8fb3-4342-8cd3-f566e8623d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:57.243814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d64e8dfc-8fb3-4342-8cd3-f566e8623d4e None None] MFA Rules not processed for user `52e5d52645d944e281e715f14d74acff`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:57.245842 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d64e8dfc-8fb3-4342-8cd3-f566e8623d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:57.295506 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40515eb-3cdb-4065-a4e0-dbdf2972da64 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:57.298595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b40515eb-3cdb-4065-a4e0-dbdf2972da64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:57.357483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1298/2582] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:57.371797 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e8dfc-8fb3-4342-8cd3-f566e8623d4e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:57.373857 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d64e8dfc-8fb3-4342-8cd3-f566e8623d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:57.402663 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40515eb-3cdb-4065-a4e0-dbdf2972da64 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:57.409918 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:57.410167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:57.411775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:57.412172 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:57.412594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72 admin admin] PATH_INFO: `/v3/projects/3e0bb06931f243a7b425a3b37ac271b5` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:57.414295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0bb06931f243a7b425a3b37ac271b5)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:57.416916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:57.443110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e8dfc-8fb3-4342-8cd3-f566e8623d4e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:57.446883 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73522cc0-1d93-4d79-aed8-b0b2c798c318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:57.447555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73522cc0-1d93-4d79-aed8-b0b2c798c318 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:57.447848 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73522cc0-1d93-4d79-aed8-b0b2c798c318 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:57.448124 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73522cc0-1d93-4d79-aed8-b0b2c798c318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:57.459561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73522cc0-1d93-4d79-aed8-b0b2c798c318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:57.462995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73522cc0-1d93-4d79-aed8-b0b2c798c318 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:57.468650 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:57.481154 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1299/2583] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:32:57.494653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0bb06931f243a7b425a3b37ac271b5', 'request_id': 'req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:57.508435 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0bb06931f243a7b425a3b37ac271b5', 'request_id': 'req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:57.520131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0bb06931f243a7b425a3b37ac271b5', 'request_id': 'req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:57.534646 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72 admin admin] The token cache is being invalidate because project 3e0bb06931f243a7b425a3b37ac271b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:32:57.534972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:57.535777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:32:57.541782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1285/2584] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:32:57 2022] DELETE /identity/v3/projects/3e0bb06931f243a7b425a3b37ac271b5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:57.544172 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5be6-dd05-437f-a4a5-3a191a0871e2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:57.547807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5be6-dd05-437f-a4a5-3a191a0871e2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:57.547807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5be6-dd05-437f-a4a5-3a191a0871e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:57.572522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-abdf5be6-dd05-437f-a4a5-3a191a0871e2 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:57.573820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-abdf5be6-dd05-437f-a4a5-3a191a0871e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:57.635266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:57.636828 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:57.677854 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1300/2585] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:57.693114 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40721567-28dd-483b-ab3f-6f43b63d2578 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:57.696555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40721567-28dd-483b-ab3f-6f43b63d2578 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:57.696555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40721567-28dd-483b-ab3f-6f43b63d2578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:57.722709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-40721567-28dd-483b-ab3f-6f43b63d2578 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:57.724325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-40721567-28dd-483b-ab3f-6f43b63d2578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:57.729804 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814f15f-194f-4b7b-b3c6-92bc4a1b2b72 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:57.739762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1301/2586] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:32:57.740619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a8db3-f339-46ae-a727-917615ca0c21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:57.740619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a8db3-f339-46ae-a727-917615ca0c21 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:57.740619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a8db3-f339-46ae-a727-917615ca0c21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:57.740619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a8db3-f339-46ae-a727-917615ca0c21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:57.742259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40721567-28dd-483b-ab3f-6f43b63d2578 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:57.743908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-686a8db3-f339-46ae-a727-917615ca0c21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:57.759609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40721567-28dd-483b-ab3f-6f43b63d2578 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:57.773214 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992a5f9-745b-4ecc-bda4-a7ac94f4baa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:57.773920 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992a5f9-745b-4ecc-bda4-a7ac94f4baa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:57.774203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992a5f9-745b-4ecc-bda4-a7ac94f4baa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:57.774520 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992a5f9-745b-4ecc-bda4-a7ac94f4baa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:57.775312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992a5f9-745b-4ecc-bda4-a7ac94f4baa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:32:57.775623 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992a5f9-745b-4ecc-bda4-a7ac94f4baa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:57.777276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992a5f9-745b-4ecc-bda4-a7ac94f4baa7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:57.794032 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1302/2587] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:32:57.795296 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992a5f9-745b-4ecc-bda4-a7ac94f4baa7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:57.806172 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992a5f9-745b-4ecc-bda4-a7ac94f4baa7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:57.811419 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652fcdc-7d4f-4b30-b658-4d4d56420881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:57.812416 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652fcdc-7d4f-4b30-b658-4d4d56420881 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:57.812672 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652fcdc-7d4f-4b30-b658-4d4d56420881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:57.812768 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652fcdc-7d4f-4b30-b658-4d4d56420881 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:57.813683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652fcdc-7d4f-4b30-b658-4d4d56420881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:57.815732 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652fcdc-7d4f-4b30-b658-4d4d56420881 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:57.854585 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1303/2588] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:32:57 2022] POST /identity/v3/projects => generated 397 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:57.859513 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652fcdc-7d4f-4b30-b658-4d4d56420881 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:57.859749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a8db3-f339-46ae-a727-917615ca0c21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:57.861570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a8db3-f339-46ae-a727-917615ca0c21 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:57.874985 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1286/2589] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:32:57.952416 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652fcdc-7d4f-4b30-b658-4d4d56420881 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:57.960068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8911b-752e-4ad0-8aa8-359032da63b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:57.961195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8911b-752e-4ad0-8aa8-359032da63b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:57.961608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8911b-752e-4ad0-8aa8-359032da63b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:57.962027 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8911b-752e-4ad0-8aa8-359032da63b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:57.963275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8911b-752e-4ad0-8aa8-359032da63b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:57.966813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8911b-752e-4ad0-8aa8-359032da63b5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:58.004505 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1304/2590] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:32:57 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:32:58.006873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a8db3-f339-46ae-a727-917615ca0c21 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:58.024873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a8db3-f339-46ae-a727-917615ca0c21 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:58.029971 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999863d1-76d2-4218-94dd-a63bb6c53f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:58.030829 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999863d1-76d2-4218-94dd-a63bb6c53f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:58.031119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999863d1-76d2-4218-94dd-a63bb6c53f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:58.031406 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999863d1-76d2-4218-94dd-a63bb6c53f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:58.032521 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999863d1-76d2-4218-94dd-a63bb6c53f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:58.034032 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999863d1-76d2-4218-94dd-a63bb6c53f29 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:58.047500 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1287/2591] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:58.053149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8911b-752e-4ad0-8aa8-359032da63b5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:58.066275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8911b-752e-4ad0-8aa8-359032da63b5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:58.072321 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fb317-d87d-4ed1-a5ba-acefa139d702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:58.073035 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fb317-d87d-4ed1-a5ba-acefa139d702 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:58.073319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fb317-d87d-4ed1-a5ba-acefa139d702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:58.073596 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fb317-d87d-4ed1-a5ba-acefa139d702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:58.074603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fb317-d87d-4ed1-a5ba-acefa139d702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:58.076284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fb317-d87d-4ed1-a5ba-acefa139d702 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:58.099254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1305/2592] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:32:58.104740 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999863d1-76d2-4218-94dd-a63bb6c53f29 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:58.129331 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999863d1-76d2-4218-94dd-a63bb6c53f29 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:58.144105 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa70e72-1365-4185-985f-e2cae100d772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:58.145317 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa70e72-1365-4185-985f-e2cae100d772 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:58.145786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa70e72-1365-4185-985f-e2cae100d772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:58.146429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa70e72-1365-4185-985f-e2cae100d772 admin admin] PATH_INFO: `/v3/projects/c58bdfa734954715a1ce66a02141a5c0/users/0e381184c8454bfc81bcf80a0122a8de/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:58.167161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa70e72-1365-4185-985f-e2cae100d772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58bdfa734954715a1ce66a02141a5c0, user_id=0e381184c8454bfc81bcf80a0122a8de, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:58.169989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa70e72-1365-4185-985f-e2cae100d772 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:58.188624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1288/2593] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:32:58 2022] PUT /identity/v3/projects/c58bdfa734954715a1ce66a02141a5c0/users/0e381184c8454bfc81bcf80a0122a8de/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:32:58.204778 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7122e6-a5bf-418e-9217-2ecaa8ef7e95 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:58.205219 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7122e6-a5bf-418e-9217-2ecaa8ef7e95 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:58.205819 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7122e6-a5bf-418e-9217-2ecaa8ef7e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:58.236899 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:58.261475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9d7122e6-a5bf-418e-9217-2ecaa8ef7e95 None None] MFA Rules not processed for user `0e381184c8454bfc81bcf80a0122a8de`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:32:58.267018 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9d7122e6-a5bf-418e-9217-2ecaa8ef7e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:32:58.409262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1306/2594] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:32:58.422364 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa70e72-1365-4185-985f-e2cae100d772 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:32:58.461756 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:58.488119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa70e72-1365-4185-985f-e2cae100d772 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:32:58.492075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee5542-2153-4d77-8e54-714fffc5d97f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:32:58.492786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee5542-2153-4d77-8e54-714fffc5d97f service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:32:58.493075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee5542-2153-4d77-8e54-714fffc5d97f service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:32:58.493352 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee5542-2153-4d77-8e54-714fffc5d97f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:32:58.504428 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee5542-2153-4d77-8e54-714fffc5d97f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:32:58.506051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee5542-2153-4d77-8e54-714fffc5d97f service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:32:58.517588 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1289/2595] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:32:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:00.703368 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7122e6-a5bf-418e-9217-2ecaa8ef7e95 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:00.705015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9d7122e6-a5bf-418e-9217-2ecaa8ef7e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:00.777399 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7122e6-a5bf-418e-9217-2ecaa8ef7e95 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:00.782138 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0614d-9a34-4f42-8a80-3fed8bad8488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:00.783068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0614d-9a34-4f42-8a80-3fed8bad8488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:00.783487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0614d-9a34-4f42-8a80-3fed8bad8488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:00.783775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0614d-9a34-4f42-8a80-3fed8bad8488 admin admin] PATH_INFO: `/v3/users/ae5a4eb30b254a488c22971ce4798605` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:00.785070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0614d-9a34-4f42-8a80-3fed8bad8488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae5a4eb30b254a488c22971ce4798605)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:00.787077 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0614d-9a34-4f42-8a80-3fed8bad8488 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:00.843248 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e2a0614d-9a34-4f42-8a80-3fed8bad8488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae5a4eb30b254a488c22971ce4798605'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:00.852589 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e2a0614d-9a34-4f42-8a80-3fed8bad8488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae5a4eb30b254a488c22971ce4798605'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:00.854126 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e2a0614d-9a34-4f42-8a80-3fed8bad8488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae5a4eb30b254a488c22971ce4798605'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:00.855700 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e2a0614d-9a34-4f42-8a80-3fed8bad8488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae5a4eb30b254a488c22971ce4798605'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:00.874263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e2a0614d-9a34-4f42-8a80-3fed8bad8488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae5a4eb30b254a488c22971ce4798605'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:00.892144 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1307/2596] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:00 2022] DELETE /identity/v3/users/ae5a4eb30b254a488c22971ce4798605 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:00.897126 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2229a0-14cf-4574-9ef4-c44f576e9cca None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:00.897668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2229a0-14cf-4574-9ef4-c44f576e9cca None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:00.897668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2229a0-14cf-4574-9ef4-c44f576e9cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:00.917126 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cf2229a0-14cf-4574-9ef4-c44f576e9cca None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:00.918390 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cf2229a0-14cf-4574-9ef4-c44f576e9cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:00.985756 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1290/2597] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:00.997326 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0614d-9a34-4f42-8a80-3fed8bad8488 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:00.999778 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e2a0614d-9a34-4f42-8a80-3fed8bad8488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:01.023712 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:01.069276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0614d-9a34-4f42-8a80-3fed8bad8488 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:01.073977 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435de2a-9678-404d-a288-b25622d3640d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:01.074691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435de2a-9678-404d-a288-b25622d3640d service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:01.074974 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435de2a-9678-404d-a288-b25622d3640d service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:01.075282 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435de2a-9678-404d-a288-b25622d3640d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:01.086422 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435de2a-9678-404d-a288-b25622d3640d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:01.087905 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435de2a-9678-404d-a288-b25622d3640d service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:01.098725 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1308/2598] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:01.359942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2229a0-14cf-4574-9ef4-c44f576e9cca None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:01.361873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cf2229a0-14cf-4574-9ef4-c44f576e9cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:01.374905 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2229a0-14cf-4574-9ef4-c44f576e9cca None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:01.380316 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967336f-301e-4e39-946d-dbba6999b1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:01.381236 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967336f-301e-4e39-946d-dbba6999b1ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:01.381520 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967336f-301e-4e39-946d-dbba6999b1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:01.381797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967336f-301e-4e39-946d-dbba6999b1ce admin admin] PATH_INFO: `/v3/users/3cc39fa137a440aa9634c5772701e5ed` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:01.383079 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967336f-301e-4e39-946d-dbba6999b1ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cc39fa137a440aa9634c5772701e5ed)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:01.385833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967336f-301e-4e39-946d-dbba6999b1ce admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:01.440242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435de2a-9678-404d-a288-b25622d3640d service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:01.442509 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4435de2a-9678-404d-a288-b25622d3640d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:01.461075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c967336f-301e-4e39-946d-dbba6999b1ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cc39fa137a440aa9634c5772701e5ed'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:01.469431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435de2a-9678-404d-a288-b25622d3640d service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:01.471343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c967336f-301e-4e39-946d-dbba6999b1ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cc39fa137a440aa9634c5772701e5ed'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:01.475907 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f52eaf-0769-42a3-ad87-65bbdd717adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:01.476820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f52eaf-0769-42a3-ad87-65bbdd717adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:01.477113 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f52eaf-0769-42a3-ad87-65bbdd717adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:01.477394 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f52eaf-0769-42a3-ad87-65bbdd717adb admin admin] PATH_INFO: `/v3/projects/1a90239c62054eeeb75e560aaa058059` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:01.478972 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f52eaf-0769-42a3-ad87-65bbdd717adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a90239c62054eeeb75e560aaa058059)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:01.481170 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f52eaf-0769-42a3-ad87-65bbdd717adb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:01.489804 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c967336f-301e-4e39-946d-dbba6999b1ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cc39fa137a440aa9634c5772701e5ed'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:01.490637 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c967336f-301e-4e39-946d-dbba6999b1ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cc39fa137a440aa9634c5772701e5ed'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:01.508233 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c967336f-301e-4e39-946d-dbba6999b1ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cc39fa137a440aa9634c5772701e5ed'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:01.520868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1291/2599] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:01 2022] DELETE /identity/v3/users/3cc39fa137a440aa9634c5772701e5ed => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:01.530293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a287e6a-aca0-4316-9bd4-bf66643c186b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:01.530857 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a287e6a-aca0-4316-9bd4-bf66643c186b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:01.531373 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a287e6a-aca0-4316-9bd4-bf66643c186b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:01.556819 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e3f52eaf-0769-42a3-ad87-65bbdd717adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a90239c62054eeeb75e560aaa058059', 'request_id': 'req-e3f52eaf-0769-42a3-ad87-65bbdd717adb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:01.563879 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8a287e6a-aca0-4316-9bd4-bf66643c186b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:01.565154 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8a287e6a-aca0-4316-9bd4-bf66643c186b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:01.566929 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e3f52eaf-0769-42a3-ad87-65bbdd717adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a90239c62054eeeb75e560aaa058059', 'request_id': 'req-e3f52eaf-0769-42a3-ad87-65bbdd717adb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:01.577642 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e3f52eaf-0769-42a3-ad87-65bbdd717adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a90239c62054eeeb75e560aaa058059', 'request_id': 'req-e3f52eaf-0769-42a3-ad87-65bbdd717adb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:01.601809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e3f52eaf-0769-42a3-ad87-65bbdd717adb admin admin] The token cache is being invalidate because project 1a90239c62054eeeb75e560aaa058059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:01.602152 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e3f52eaf-0769-42a3-ad87-65bbdd717adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:01.602927 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e3f52eaf-0769-42a3-ad87-65bbdd717adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:01.607323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1309/2600] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:01 2022] DELETE /identity/v3/projects/1a90239c62054eeeb75e560aaa058059 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:33:01.611379 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f52eaf-0769-42a3-ad87-65bbdd717adb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:01.614935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e3f52eaf-0769-42a3-ad87-65bbdd717adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:01.639642 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:01.667670 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1292/2601] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:01.681833 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a287e6a-aca0-4316-9bd4-bf66643c186b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:01.683951 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8a287e6a-aca0-4316-9bd4-bf66643c186b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:01.740233 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f52eaf-0769-42a3-ad87-65bbdd717adb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:01.747002 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421dfd7-d686-481f-905c-305092550a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:01.748119 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421dfd7-d686-481f-905c-305092550a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:01.748533 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421dfd7-d686-481f-905c-305092550a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:01.748895 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421dfd7-d686-481f-905c-305092550a7f admin admin] PATH_INFO: `/v3/users/52e5d52645d944e281e715f14d74acff` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:01.752140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421dfd7-d686-481f-905c-305092550a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e5d52645d944e281e715f14d74acff)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:01.756177 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421dfd7-d686-481f-905c-305092550a7f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:01.794880 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a287e6a-aca0-4316-9bd4-bf66643c186b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:01.800633 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199300e-7ae2-455a-a8c4-100c012a51b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:01.801791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199300e-7ae2-455a-a8c4-100c012a51b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:01.802295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199300e-7ae2-455a-a8c4-100c012a51b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:01.803511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199300e-7ae2-455a-a8c4-100c012a51b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:01.819582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199300e-7ae2-455a-a8c4-100c012a51b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:01.821641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199300e-7ae2-455a-a8c4-100c012a51b9 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:01.827796 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:01.830104 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2421dfd7-d686-481f-905c-305092550a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e5d52645d944e281e715f14d74acff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:01.837798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1293/2602] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:01.848416 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2421dfd7-d686-481f-905c-305092550a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e5d52645d944e281e715f14d74acff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:01.850807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2421dfd7-d686-481f-905c-305092550a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e5d52645d944e281e715f14d74acff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:01.851965 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2421dfd7-d686-481f-905c-305092550a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e5d52645d944e281e715f14d74acff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:01.873433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2421dfd7-d686-481f-905c-305092550a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e5d52645d944e281e715f14d74acff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:01.893194 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1310/2603] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:01 2022] DELETE /identity/v3/users/52e5d52645d944e281e715f14d74acff => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:02.385885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199300e-7ae2-455a-a8c4-100c012a51b9 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:02.389369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a199300e-7ae2-455a-a8c4-100c012a51b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:02.415219 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199300e-7ae2-455a-a8c4-100c012a51b9 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:02.461103 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421dfd7-d686-481f-905c-305092550a7f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:02.463333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2421dfd7-d686-481f-905c-305092550a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:02.557391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e8b47-f097-4926-80fa-7de2d65868b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:02.559002 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e8b47-f097-4926-80fa-7de2d65868b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:02.559611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e8b47-f097-4926-80fa-7de2d65868b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:02.560028 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e8b47-f097-4926-80fa-7de2d65868b3 admin admin] PATH_INFO: `/v3/projects/d6c619f916b2414e9355ac222d9c1aa7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:02.562328 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e8b47-f097-4926-80fa-7de2d65868b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c619f916b2414e9355ac222d9c1aa7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:02.565639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e8b47-f097-4926-80fa-7de2d65868b3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:02.573400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421dfd7-d686-481f-905c-305092550a7f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:02.579709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32efe76-872e-4789-89fb-f5b03860df01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:02.580723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32efe76-872e-4789-89fb-f5b03860df01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:02.581076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32efe76-872e-4789-89fb-f5b03860df01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:02.581455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32efe76-872e-4789-89fb-f5b03860df01 admin admin] PATH_INFO: `/v3/projects/fbfcb10f6a064e8ba782114e8dec6d93` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:02.583202 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32efe76-872e-4789-89fb-f5b03860df01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbfcb10f6a064e8ba782114e8dec6d93)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:02.585162 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32efe76-872e-4789-89fb-f5b03860df01 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:02.663056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e11e8b47-f097-4926-80fa-7de2d65868b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c619f916b2414e9355ac222d9c1aa7', 'request_id': 'req-e11e8b47-f097-4926-80fa-7de2d65868b3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:02.677764 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e11e8b47-f097-4926-80fa-7de2d65868b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c619f916b2414e9355ac222d9c1aa7', 'request_id': 'req-e11e8b47-f097-4926-80fa-7de2d65868b3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:02.686073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c32efe76-872e-4789-89fb-f5b03860df01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbfcb10f6a064e8ba782114e8dec6d93', 'request_id': 'req-c32efe76-872e-4789-89fb-f5b03860df01'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:02.689725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e11e8b47-f097-4926-80fa-7de2d65868b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c619f916b2414e9355ac222d9c1aa7', 'request_id': 'req-e11e8b47-f097-4926-80fa-7de2d65868b3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:02.697299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c32efe76-872e-4789-89fb-f5b03860df01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbfcb10f6a064e8ba782114e8dec6d93', 'request_id': 'req-c32efe76-872e-4789-89fb-f5b03860df01'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:02.709155 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e11e8b47-f097-4926-80fa-7de2d65868b3 admin admin] The token cache is being invalidate because project d6c619f916b2414e9355ac222d9c1aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:02.709749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e11e8b47-f097-4926-80fa-7de2d65868b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:02.710762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c32efe76-872e-4789-89fb-f5b03860df01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbfcb10f6a064e8ba782114e8dec6d93', 'request_id': 'req-c32efe76-872e-4789-89fb-f5b03860df01'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:02.711363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e11e8b47-f097-4926-80fa-7de2d65868b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:02.717024 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1294/2604] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:02 2022] DELETE /identity/v3/projects/d6c619f916b2414e9355ac222d9c1aa7 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:02.718404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e8b47-f097-4926-80fa-7de2d65868b3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:02.720816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e11e8b47-f097-4926-80fa-7de2d65868b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:02.736691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c32efe76-872e-4789-89fb-f5b03860df01 admin admin] The token cache is being invalidate because project fbfcb10f6a064e8ba782114e8dec6d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:02.737191 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c32efe76-872e-4789-89fb-f5b03860df01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:02.738250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c32efe76-872e-4789-89fb-f5b03860df01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:02.745186 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1311/2605] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:02 2022] DELETE /identity/v3/projects/fbfcb10f6a064e8ba782114e8dec6d93 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:02.751333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bb27f-a802-41be-8201-df3123c7e63f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:02.751939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bb27f-a802-41be-8201-df3123c7e63f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:02.752417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bb27f-a802-41be-8201-df3123c7e63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:02.766798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:02.783275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2e4bb27f-a802-41be-8201-df3123c7e63f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:02.785315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2e4bb27f-a802-41be-8201-df3123c7e63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:02.845627 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e8b47-f097-4926-80fa-7de2d65868b3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:02.879952 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:02.912326 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1312/2606] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:02.925430 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10445386-b774-4fa3-95e8-4536ec9907c7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:02.926301 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10445386-b774-4fa3-95e8-4536ec9907c7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:02.926844 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10445386-b774-4fa3-95e8-4536ec9907c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:02.961339 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-10445386-b774-4fa3-95e8-4536ec9907c7 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:02.961676 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40d7c9-72c2-424a-b343-f91df154cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:02.962964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40d7c9-72c2-424a-b343-f91df154cead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:02.963358 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-10445386-b774-4fa3-95e8-4536ec9907c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:02.963558 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40d7c9-72c2-424a-b343-f91df154cead admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:02.963823 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40d7c9-72c2-424a-b343-f91df154cead admin admin] PATH_INFO: `/v3/users/f55c0e870a1444e1a5c7f4ac94db1043` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:02.965984 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40d7c9-72c2-424a-b343-f91df154cead admin admin] RBAC: Authorizing `identity:delete_user(user_id=f55c0e870a1444e1a5c7f4ac94db1043)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:02.970341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40d7c9-72c2-424a-b343-f91df154cead admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:02.977550 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1313/2607] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:02.987706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10445386-b774-4fa3-95e8-4536ec9907c7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:03.011008 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10445386-b774-4fa3-95e8-4536ec9907c7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:03.019251 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246c0b9-e283-41a9-8b83-8c94b0d1da0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:03.020340 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246c0b9-e283-41a9-8b83-8c94b0d1da0a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:03.020866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246c0b9-e283-41a9-8b83-8c94b0d1da0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:03.021384 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246c0b9-e283-41a9-8b83-8c94b0d1da0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:03.022654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246c0b9-e283-41a9-8b83-8c94b0d1da0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:33:03.023053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246c0b9-e283-41a9-8b83-8c94b0d1da0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:03.025503 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246c0b9-e283-41a9-8b83-8c94b0d1da0a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:03.045370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1314/2608] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:33:03.052447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246c0b9-e283-41a9-8b83-8c94b0d1da0a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:03.067011 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fc40d7c9-72c2-424a-b343-f91df154cead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f55c0e870a1444e1a5c7f4ac94db1043'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:03.071711 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246c0b9-e283-41a9-8b83-8c94b0d1da0a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:03.075566 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fc40d7c9-72c2-424a-b343-f91df154cead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f55c0e870a1444e1a5c7f4ac94db1043'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:03.081501 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b004a-e9a1-4d83-b695-3b72343c820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:03.082671 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b004a-e9a1-4d83-b695-3b72343c820a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:03.083170 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b004a-e9a1-4d83-b695-3b72343c820a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:03.083631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b004a-e9a1-4d83-b695-3b72343c820a admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:03.084863 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b004a-e9a1-4d83-b695-3b72343c820a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:03.087192 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fc40d7c9-72c2-424a-b343-f91df154cead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f55c0e870a1444e1a5c7f4ac94db1043'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:03.088322 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fc40d7c9-72c2-424a-b343-f91df154cead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f55c0e870a1444e1a5c7f4ac94db1043'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:03.088631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b004a-e9a1-4d83-b695-3b72343c820a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:03.107675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fc40d7c9-72c2-424a-b343-f91df154cead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f55c0e870a1444e1a5c7f4ac94db1043'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:03.116803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1295/2609] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:02 2022] DELETE /identity/v3/users/f55c0e870a1444e1a5c7f4ac94db1043 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:03.159943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1315/2610] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:03 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:03.164266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40d7c9-72c2-424a-b343-f91df154cead admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:03.166083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fc40d7c9-72c2-424a-b343-f91df154cead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:03.282382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:03.322676 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40d7c9-72c2-424a-b343-f91df154cead admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:03.427771 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678af66-fe27-480c-8867-db9140708386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:03.429209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678af66-fe27-480c-8867-db9140708386 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:03.429560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678af66-fe27-480c-8867-db9140708386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:03.429955 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678af66-fe27-480c-8867-db9140708386 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:03.431055 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678af66-fe27-480c-8867-db9140708386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:03.433415 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678af66-fe27-480c-8867-db9140708386 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:03.496846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1296/2611] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:03 2022] POST /identity/v3/users => generated 288 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:33:03.501306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b004a-e9a1-4d83-b695-3b72343c820a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:03.513139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b004a-e9a1-4d83-b695-3b72343c820a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:03.520012 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f0c04-173f-4ca0-9fcf-814e7d930685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:03.520711 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f0c04-173f-4ca0-9fcf-814e7d930685 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:03.521008 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f0c04-173f-4ca0-9fcf-814e7d930685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:03.521272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f0c04-173f-4ca0-9fcf-814e7d930685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:03.522011 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f0c04-173f-4ca0-9fcf-814e7d930685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:03.524419 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f0c04-173f-4ca0-9fcf-814e7d930685 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:03.541657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1316/2612] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:03.546042 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678af66-fe27-480c-8867-db9140708386 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:03.557269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678af66-fe27-480c-8867-db9140708386 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:03.562581 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3447d40-51f0-4dc4-91f9-2fe1f8080e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:03.563704 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3447d40-51f0-4dc4-91f9-2fe1f8080e2a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:03.564164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3447d40-51f0-4dc4-91f9-2fe1f8080e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:03.564608 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3447d40-51f0-4dc4-91f9-2fe1f8080e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:03.565822 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3447d40-51f0-4dc4-91f9-2fe1f8080e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:03.568175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3447d40-51f0-4dc4-91f9-2fe1f8080e2a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:03.584804 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1297/2613] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:03.586875 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f0c04-173f-4ca0-9fcf-814e7d930685 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:03.599033 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f0c04-173f-4ca0-9fcf-814e7d930685 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:03.605561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba73698-68e8-495f-9553-8d97f842d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:03.606535 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba73698-68e8-495f-9553-8d97f842d8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:03.606819 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba73698-68e8-495f-9553-8d97f842d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:03.607145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba73698-68e8-495f-9553-8d97f842d8d9 admin admin] PATH_INFO: `/v3/projects/d0d046cc159d44a4a2e7b2e9d9f2024f/users/66926d9e836a4c50b9a8409096390df2/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:03.635771 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba73698-68e8-495f-9553-8d97f842d8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d046cc159d44a4a2e7b2e9d9f2024f, user_id=66926d9e836a4c50b9a8409096390df2, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:03.638583 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba73698-68e8-495f-9553-8d97f842d8d9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:03.656693 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1317/2614] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:03 2022] PUT /identity/v3/projects/d0d046cc159d44a4a2e7b2e9d9f2024f/users/66926d9e836a4c50b9a8409096390df2/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:33:03.674869 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ccabe-dfa9-485a-b7c6-31b9ebfb7729 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:03.676560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ccabe-dfa9-485a-b7c6-31b9ebfb7729 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:03.677198 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ccabe-dfa9-485a-b7c6-31b9ebfb7729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:03.686127 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba73698-68e8-495f-9553-8d97f842d8d9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:03.688012 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1ba73698-68e8-495f-9553-8d97f842d8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:03.738147 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-504ccabe-dfa9-485a-b7c6-31b9ebfb7729 None None] MFA Rules not processed for user `66926d9e836a4c50b9a8409096390df2`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:03.740821 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-504ccabe-dfa9-485a-b7c6-31b9ebfb7729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:03.812051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba73698-68e8-495f-9553-8d97f842d8d9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:03.824154 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:03.826456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:03.827055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:03.827974 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31 admin admin] PATH_INFO: `/v3/projects/a662ef15081e457a8320e98f01a082d6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:03.831534 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a662ef15081e457a8320e98f01a082d6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:03.835166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:03.873235 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1298/2615] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:03.879756 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ccabe-dfa9-485a-b7c6-31b9ebfb7729 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:03.895341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ccabe-dfa9-485a-b7c6-31b9ebfb7729 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:03.901235 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a662ef15081e457a8320e98f01a082d6', 'request_id': 'req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:03.912694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a662ef15081e457a8320e98f01a082d6', 'request_id': 'req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:03.927135 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a662ef15081e457a8320e98f01a082d6', 'request_id': 'req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:03.949987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31 admin admin] The token cache is being invalidate because project a662ef15081e457a8320e98f01a082d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:03.950632 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:03.952024 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:03.954815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1318/2616] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:03 2022] DELETE /identity/v3/projects/a662ef15081e457a8320e98f01a082d6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:33:03.955331 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:03.956801 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:03.967984 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:03.980207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adab326-fe41-421a-821a-e664a8754d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:03.980999 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adab326-fe41-421a-821a-e664a8754d2c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:03.981370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adab326-fe41-421a-821a-e664a8754d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:03.981719 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adab326-fe41-421a-821a-e664a8754d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:03.982584 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adab326-fe41-421a-821a-e664a8754d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:03.985496 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adab326-fe41-421a-821a-e664a8754d2c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:03.997316 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:04.026991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1299/2617] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:03 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:04.028864 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e4a96-2961-4a1e-8b15-346eacbc4313 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:04.029146 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e4a96-2961-4a1e-8b15-346eacbc4313 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:04.029439 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e4a96-2961-4a1e-8b15-346eacbc4313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:04.052488 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2a2e4a96-2961-4a1e-8b15-346eacbc4313 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:04.053725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2a2e4a96-2961-4a1e-8b15-346eacbc4313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:04.066241 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbad6e4-0029-4935-a878-d7f0a6ba9f31 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:04.148145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1300/2618] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:04.148809 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e4a96-2961-4a1e-8b15-346eacbc4313 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:04.150911 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2a2e4a96-2961-4a1e-8b15-346eacbc4313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:04.163349 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e4a96-2961-4a1e-8b15-346eacbc4313 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:04.169699 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277d94d-0954-4c53-9803-81073e6be21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:04.170445 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d94d-0954-4c53-9803-81073e6be21b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:04.170736 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d94d-0954-4c53-9803-81073e6be21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:04.170916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138e286-0627-4043-afce-ae02412150bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:04.171053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d94d-0954-4c53-9803-81073e6be21b admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:04.172005 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277d94d-0954-4c53-9803-81073e6be21b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:04.173600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138e286-0627-4043-afce-ae02412150bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:04.174097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138e286-0627-4043-afce-ae02412150bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:04.174273 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277d94d-0954-4c53-9803-81073e6be21b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:04.174650 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138e286-0627-4043-afce-ae02412150bd admin admin] PATH_INFO: `/v3/users/0e381184c8454bfc81bcf80a0122a8de` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:04.176418 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138e286-0627-4043-afce-ae02412150bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e381184c8454bfc81bcf80a0122a8de)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:04.179283 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138e286-0627-4043-afce-ae02412150bd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:04.205215 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1301/2619] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:04 2022] POST /identity/v3/users => generated 289 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:04.207658 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288387bf-0bec-44f1-b4e0-1d739a2d0847 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:04.208258 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288387bf-0bec-44f1-b4e0-1d739a2d0847 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:04.208756 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288387bf-0bec-44f1-b4e0-1d739a2d0847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:04.244885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-288387bf-0bec-44f1-b4e0-1d739a2d0847 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:04.247082 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-288387bf-0bec-44f1-b4e0-1d739a2d0847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:04.255540 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2138e286-0627-4043-afce-ae02412150bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e381184c8454bfc81bcf80a0122a8de'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:04.262603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1302/2620] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:04.263665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2138e286-0627-4043-afce-ae02412150bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e381184c8454bfc81bcf80a0122a8de'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:04.264409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2138e286-0627-4043-afce-ae02412150bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e381184c8454bfc81bcf80a0122a8de'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:04.265034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2138e286-0627-4043-afce-ae02412150bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e381184c8454bfc81bcf80a0122a8de'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:04.268924 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288387bf-0bec-44f1-b4e0-1d739a2d0847 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:04.282039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2138e286-0627-4043-afce-ae02412150bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e381184c8454bfc81bcf80a0122a8de'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:04.288306 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288387bf-0bec-44f1-b4e0-1d739a2d0847 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:04.299669 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506eaac3-acaa-4598-84cb-23d50215b60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:04.301186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506eaac3-acaa-4598-84cb-23d50215b60d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:04.301581 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506eaac3-acaa-4598-84cb-23d50215b60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:04.302133 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506eaac3-acaa-4598-84cb-23d50215b60d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:04.303421 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506eaac3-acaa-4598-84cb-23d50215b60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:04.304395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1319/2621] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:03 2022] DELETE /identity/v3/users/0e381184c8454bfc81bcf80a0122a8de => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:04.305231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138e286-0627-4043-afce-ae02412150bd admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:04.306726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506eaac3-acaa-4598-84cb-23d50215b60d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:04.306860 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2138e286-0627-4043-afce-ae02412150bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:04.330301 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1303/2622] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:04.330661 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ec7bf-94a5-43f1-9cc0-372a0beec33a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:04.331136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ec7bf-94a5-43f1-9cc0-372a0beec33a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:04.331943 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ec7bf-94a5-43f1-9cc0-372a0beec33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:04.358431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:04.364109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4b1ec7bf-94a5-43f1-9cc0-372a0beec33a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:04.366315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4b1ec7bf-94a5-43f1-9cc0-372a0beec33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:04.402457 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138e286-0627-4043-afce-ae02412150bd admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:04.409199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6bca1-c4e9-47c4-adf2-d360bd0dbae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:04.409629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6bca1-c4e9-47c4-adf2-d360bd0dbae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:04.409979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6bca1-c4e9-47c4-adf2-d360bd0dbae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:04.410360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6bca1-c4e9-47c4-adf2-d360bd0dbae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:04.411189 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6bca1-c4e9-47c4-adf2-d360bd0dbae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:33:04.411619 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6bca1-c4e9-47c4-adf2-d360bd0dbae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:04.413395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6bca1-c4e9-47c4-adf2-d360bd0dbae4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:04.431901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1320/2623] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:33:04.431901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6bca1-c4e9-47c4-adf2-d360bd0dbae4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:04.433584 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-01c6bca1-c4e9-47c4-adf2-d360bd0dbae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:04.448631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6bca1-c4e9-47c4-adf2-d360bd0dbae4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:04.454659 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df70a3-401b-4910-a58a-7ba67ebf6dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:04.455794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df70a3-401b-4910-a58a-7ba67ebf6dce admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:04.456028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df70a3-401b-4910-a58a-7ba67ebf6dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:04.456384 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df70a3-401b-4910-a58a-7ba67ebf6dce admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:04.457224 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df70a3-401b-4910-a58a-7ba67ebf6dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:04.459096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df70a3-401b-4910-a58a-7ba67ebf6dce admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:04.476030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1321/2624] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:04.476030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df70a3-401b-4910-a58a-7ba67ebf6dce admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:04.486213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df70a3-401b-4910-a58a-7ba67ebf6dce admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:04.496628 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fdc2c-a00f-4ed9-9289-33d185cf5ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:04.497590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1304/2625] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:04.498747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ec7bf-94a5-43f1-9cc0-372a0beec33a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:04.503141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fdc2c-a00f-4ed9-9289-33d185cf5ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:04.503672 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fdc2c-a00f-4ed9-9289-33d185cf5ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:04.504104 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fdc2c-a00f-4ed9-9289-33d185cf5ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:04.505180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fdc2c-a00f-4ed9-9289-33d185cf5ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:04.507421 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fdc2c-a00f-4ed9-9289-33d185cf5ed5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:04.510944 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ec7bf-94a5-43f1-9cc0-372a0beec33a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:04.519226 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a8988-d2bf-4552-b528-852b369bf96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:04.520404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a8988-d2bf-4552-b528-852b369bf96a admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:04.520961 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a8988-d2bf-4552-b528-852b369bf96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:04.521316 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a8988-d2bf-4552-b528-852b369bf96a admin admin] PATH_INFO: `/v3/projects/40a4447a878a4a079143315eb8d93016/users/2b13e244a4af45d29e8cac9f40775f68/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:04.543854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a8988-d2bf-4552-b528-852b369bf96a admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a4447a878a4a079143315eb8d93016, user_id=2b13e244a4af45d29e8cac9f40775f68, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:04.545946 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1322/2626] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:04 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:04.547750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fdc2c-a00f-4ed9-9289-33d185cf5ed5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:04.548030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a8988-d2bf-4552-b528-852b369bf96a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:04.555818 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-135fdc2c-a00f-4ed9-9289-33d185cf5ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:04.570295 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1305/2627] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:04 2022] PUT /identity/v3/projects/40a4447a878a4a079143315eb8d93016/users/2b13e244a4af45d29e8cac9f40775f68/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:04.571065 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a8988-d2bf-4552-b528-852b369bf96a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:04.630058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:04.673148 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fdc2c-a00f-4ed9-9289-33d185cf5ed5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:04.684273 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a8988-d2bf-4552-b528-852b369bf96a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:04.689583 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab024b-a8cd-4f4c-8842-d055f8472061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:04.690330 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab024b-a8cd-4f4c-8842-d055f8472061 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:04.690616 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab024b-a8cd-4f4c-8842-d055f8472061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:04.690953 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab024b-a8cd-4f4c-8842-d055f8472061 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:04.691860 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab024b-a8cd-4f4c-8842-d055f8472061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:04.693987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab024b-a8cd-4f4c-8842-d055f8472061 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:04.719292 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1306/2628] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:04 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:04.720816 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f35c8-a9d8-4db4-b830-aaa9d2a04280 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:04.721165 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f35c8-a9d8-4db4-b830-aaa9d2a04280 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:04.721457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f35c8-a9d8-4db4-b830-aaa9d2a04280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:04.754736 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-503f35c8-a9d8-4db4-b830-aaa9d2a04280 None None] MFA Rules not processed for user `2b13e244a4af45d29e8cac9f40775f68`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:04.756218 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-503f35c8-a9d8-4db4-b830-aaa9d2a04280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:04.769307 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa6087-a1ef-41ac-aa14-2ad54866ee4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:04.770063 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa6087-a1ef-41ac-aa14-2ad54866ee4f service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:04.770390 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa6087-a1ef-41ac-aa14-2ad54866ee4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:04.770729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa6087-a1ef-41ac-aa14-2ad54866ee4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:04.784783 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa6087-a1ef-41ac-aa14-2ad54866ee4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:04.792622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa6087-a1ef-41ac-aa14-2ad54866ee4f service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:04.808309 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1323/2629] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:04.809224 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa6087-a1ef-41ac-aa14-2ad54866ee4f service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:04.828199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa6087-a1ef-41ac-aa14-2ad54866ee4f service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:04.839211 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0d300-ae16-4a15-84a6-51e5b41fdd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:04.839937 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0d300-ae16-4a15-84a6-51e5b41fdd1b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:04.840270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0d300-ae16-4a15-84a6-51e5b41fdd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:04.840488 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0d300-ae16-4a15-84a6-51e5b41fdd1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:04.841256 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0d300-ae16-4a15-84a6-51e5b41fdd1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:04.843734 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0d300-ae16-4a15-84a6-51e5b41fdd1b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:04.858974 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1324/2630] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:04.863209 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0d300-ae16-4a15-84a6-51e5b41fdd1b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:04.867397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1307/2631] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:04.872410 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f35c8-a9d8-4db4-b830-aaa9d2a04280 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:04.895693 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f35c8-a9d8-4db4-b830-aaa9d2a04280 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:04.906901 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efa58d-0404-4882-a95a-c54cb47da167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:04.907715 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efa58d-0404-4882-a95a-c54cb47da167 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:04.908009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efa58d-0404-4882-a95a-c54cb47da167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:04.908445 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efa58d-0404-4882-a95a-c54cb47da167 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:04.909320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efa58d-0404-4882-a95a-c54cb47da167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:04.909735 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0d300-ae16-4a15-84a6-51e5b41fdd1b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:04.916728 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efa58d-0404-4882-a95a-c54cb47da167 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:04.920756 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd2ae4-9ac0-4e4d-a22c-eb40d0b6b365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:04.922768 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd2ae4-9ac0-4e4d-a22c-eb40d0b6b365 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:04.923543 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd2ae4-9ac0-4e4d-a22c-eb40d0b6b365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:04.924140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd2ae4-9ac0-4e4d-a22c-eb40d0b6b365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:04.924994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd2ae4-9ac0-4e4d-a22c-eb40d0b6b365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:04.926891 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd2ae4-9ac0-4e4d-a22c-eb40d0b6b365 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:04.946883 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1325/2632] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:33:04.951369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd2ae4-9ac0-4e4d-a22c-eb40d0b6b365 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:04.971176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1308/2633] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:04 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:04.972161 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efa58d-0404-4882-a95a-c54cb47da167 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:04.972709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd2ae4-9ac0-4e4d-a22c-eb40d0b6b365 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:05.033411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:05.092694 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efa58d-0404-4882-a95a-c54cb47da167 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:05.104081 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35740b8f-d4e7-4f8f-a79d-9ae8898f9852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:05.105434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35740b8f-d4e7-4f8f-a79d-9ae8898f9852 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:05.106026 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35740b8f-d4e7-4f8f-a79d-9ae8898f9852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:05.106655 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f9d9e-a603-4e8e-a993-8187e53d7c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:05.106958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35740b8f-d4e7-4f8f-a79d-9ae8898f9852 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:05.108017 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35740b8f-d4e7-4f8f-a79d-9ae8898f9852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:05.108459 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f9d9e-a603-4e8e-a993-8187e53d7c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:05.108823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f9d9e-a603-4e8e-a993-8187e53d7c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:05.109120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f9d9e-a603-4e8e-a993-8187e53d7c7d admin admin] PATH_INFO: `/v3/projects/653f321f4de645e7a4da310cadfbd6e3/users/8028e55472bc49d9b21d15b3706812ee/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:05.113247 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35740b8f-d4e7-4f8f-a79d-9ae8898f9852 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:05.178405 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1309/2634] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:04 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:05.196769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35740b8f-d4e7-4f8f-a79d-9ae8898f9852 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:05.225954 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35740b8f-d4e7-4f8f-a79d-9ae8898f9852 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:05.238174 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f9d9e-a603-4e8e-a993-8187e53d7c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=653f321f4de645e7a4da310cadfbd6e3, user_id=8028e55472bc49d9b21d15b3706812ee, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:05.243414 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf1ec6-badf-4ec2-ae87-a708af74d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:05.245892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf1ec6-badf-4ec2-ae87-a708af74d765 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:05.246521 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf1ec6-badf-4ec2-ae87-a708af74d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:05.246697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f9d9e-a603-4e8e-a993-8187e53d7c7d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:05.247376 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf1ec6-badf-4ec2-ae87-a708af74d765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:05.248707 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf1ec6-badf-4ec2-ae87-a708af74d765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:05.252100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf1ec6-badf-4ec2-ae87-a708af74d765 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:05.281064 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1310/2635] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:05.298670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1326/2636] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:04 2022] PUT /identity/v3/projects/653f321f4de645e7a4da310cadfbd6e3/users/8028e55472bc49d9b21d15b3706812ee/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:05.299980 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf1ec6-badf-4ec2-ae87-a708af74d765 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:05.307359 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69801a3-b5b0-4cf6-b930-336ade72a359 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:05.307841 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69801a3-b5b0-4cf6-b930-336ade72a359 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:05.308311 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69801a3-b5b0-4cf6-b930-336ade72a359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:05.326715 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf1ec6-badf-4ec2-ae87-a708af74d765 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:05.332679 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:05.372429 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a69801a3-b5b0-4cf6-b930-336ade72a359 None None] MFA Rules not processed for user `8028e55472bc49d9b21d15b3706812ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:05.373878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a69801a3-b5b0-4cf6-b930-336ade72a359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:05.439612 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f8420-4a67-44f9-a87c-18ba0066efd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:05.440271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f8420-4a67-44f9-a87c-18ba0066efd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:05.440568 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f8420-4a67-44f9-a87c-18ba0066efd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:05.440982 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f8420-4a67-44f9-a87c-18ba0066efd2 admin admin] PATH_INFO: `/v3/projects/31bd00eab34847318fc2d2348fa8f064/users/7fce60cce3a84c499b2cf781855ad922/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:05.459140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f8420-4a67-44f9-a87c-18ba0066efd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31bd00eab34847318fc2d2348fa8f064, user_id=7fce60cce3a84c499b2cf781855ad922, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:05.462987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f8420-4a67-44f9-a87c-18ba0066efd2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:05.486174 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1311/2637] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:05 2022] PUT /identity/v3/projects/31bd00eab34847318fc2d2348fa8f064/users/7fce60cce3a84c499b2cf781855ad922/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:05.487494 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f8420-4a67-44f9-a87c-18ba0066efd2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:05.490201 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-df6f8420-4a67-44f9-a87c-18ba0066efd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:05.495206 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1327/2638] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:05.496206 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69801a3-b5b0-4cf6-b930-336ade72a359 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:05.509918 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69801a3-b5b0-4cf6-b930-336ade72a359 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:05.578403 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f8420-4a67-44f9-a87c-18ba0066efd2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:05.584756 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37830f-dfc0-4f91-a5a2-c8c17c259247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:05.585782 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37830f-dfc0-4f91-a5a2-c8c17c259247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:05.586070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37830f-dfc0-4f91-a5a2-c8c17c259247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:05.586385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37830f-dfc0-4f91-a5a2-c8c17c259247 admin admin] PATH_INFO: `/v3/projects/c58bdfa734954715a1ce66a02141a5c0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:05.587948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37830f-dfc0-4f91-a5a2-c8c17c259247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58bdfa734954715a1ce66a02141a5c0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:05.588122 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a3a3d-5107-4814-a005-d32088a652a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:05.589603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a3a3d-5107-4814-a005-d32088a652a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:05.589886 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37830f-dfc0-4f91-a5a2-c8c17c259247 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:05.590098 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a3a3d-5107-4814-a005-d32088a652a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:05.590669 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a3a3d-5107-4814-a005-d32088a652a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:05.592065 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a3a3d-5107-4814-a005-d32088a652a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:05.595938 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a3a3d-5107-4814-a005-d32088a652a2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:05.615101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1328/2639] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:05.616416 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a3a3d-5107-4814-a005-d32088a652a2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:05.631042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a3a3d-5107-4814-a005-d32088a652a2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:05.637391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae334bd9-a585-43eb-816a-27a77713fd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:05.638211 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae334bd9-a585-43eb-816a-27a77713fd9f admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:05.638583 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae334bd9-a585-43eb-816a-27a77713fd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:05.638872 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae334bd9-a585-43eb-816a-27a77713fd9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:05.639600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae334bd9-a585-43eb-816a-27a77713fd9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:05.641710 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae334bd9-a585-43eb-816a-27a77713fd9f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:05.681423 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1329/2640] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:05 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:05.682766 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae334bd9-a585-43eb-816a-27a77713fd9f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:05.689769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ac37830f-dfc0-4f91-a5a2-c8c17c259247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58bdfa734954715a1ce66a02141a5c0', 'request_id': 'req-ac37830f-dfc0-4f91-a5a2-c8c17c259247'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:05.700186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ac37830f-dfc0-4f91-a5a2-c8c17c259247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58bdfa734954715a1ce66a02141a5c0', 'request_id': 'req-ac37830f-dfc0-4f91-a5a2-c8c17c259247'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:05.716562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ac37830f-dfc0-4f91-a5a2-c8c17c259247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58bdfa734954715a1ce66a02141a5c0', 'request_id': 'req-ac37830f-dfc0-4f91-a5a2-c8c17c259247'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:05.724356 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:05.732904 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ac37830f-dfc0-4f91-a5a2-c8c17c259247 admin admin] The token cache is being invalidate because project c58bdfa734954715a1ce66a02141a5c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:05.733360 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ac37830f-dfc0-4f91-a5a2-c8c17c259247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:05.735323 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ac37830f-dfc0-4f91-a5a2-c8c17c259247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:05.738376 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1312/2641] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:05 2022] DELETE /identity/v3/projects/c58bdfa734954715a1ce66a02141a5c0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:05.740354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37830f-dfc0-4f91-a5a2-c8c17c259247 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:05.741237 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ac37830f-dfc0-4f91-a5a2-c8c17c259247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:05.773685 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:05.831042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae334bd9-a585-43eb-816a-27a77713fd9f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:05.838581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce73d9e-d7ce-4abc-b7ad-008e2659bab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:05.839836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce73d9e-d7ce-4abc-b7ad-008e2659bab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:05.840233 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce73d9e-d7ce-4abc-b7ad-008e2659bab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:05.840620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce73d9e-d7ce-4abc-b7ad-008e2659bab5 admin admin] PATH_INFO: `/v3/projects/31bd00eab34847318fc2d2348fa8f064/users/7fce60cce3a84c499b2cf781855ad922/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:05.843349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce73d9e-d7ce-4abc-b7ad-008e2659bab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31bd00eab34847318fc2d2348fa8f064, user_id=7fce60cce3a84c499b2cf781855ad922, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:05.848494 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce73d9e-d7ce-4abc-b7ad-008e2659bab5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:05.863600 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1330/2642] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:05 2022] PUT /identity/v3/projects/31bd00eab34847318fc2d2348fa8f064/users/7fce60cce3a84c499b2cf781855ad922/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:05.879919 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37830f-dfc0-4f91-a5a2-c8c17c259247 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:05.880232 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81940fb-1cc0-4662-9d44-a1ad35edf359 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:05.880995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81940fb-1cc0-4662-9d44-a1ad35edf359 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:05.881389 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81940fb-1cc0-4662-9d44-a1ad35edf359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:05.931998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e81940fb-1cc0-4662-9d44-a1ad35edf359 None None] MFA Rules not processed for user `7fce60cce3a84c499b2cf781855ad922`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:05.933319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e81940fb-1cc0-4662-9d44-a1ad35edf359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:06.054485 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ce728-bc62-4aab-bf11-a64647b1c75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:06.056971 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ce728-bc62-4aab-bf11-a64647b1c75e admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:06.057263 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ce728-bc62-4aab-bf11-a64647b1c75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:06.057605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ce728-bc62-4aab-bf11-a64647b1c75e admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:06.058657 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ce728-bc62-4aab-bf11-a64647b1c75e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:06.061358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ce728-bc62-4aab-bf11-a64647b1c75e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:06.082457 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1331/2643] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:06.083514 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1313/2644] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:05 2022] POST /identity/v3/users => generated 300 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:06.088221 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81940fb-1cc0-4662-9d44-a1ad35edf359 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:06.095476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ce728-bc62-4aab-bf11-a64647b1c75e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:06.097709 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-230ce728-bc62-4aab-bf11-a64647b1c75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:06.108812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81940fb-1cc0-4662-9d44-a1ad35edf359 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:06.121542 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62d0a0-3154-4117-a91d-56b97983af5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:06.122299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62d0a0-3154-4117-a91d-56b97983af5c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:06.122584 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62d0a0-3154-4117-a91d-56b97983af5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:06.122860 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62d0a0-3154-4117-a91d-56b97983af5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:06.123644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62d0a0-3154-4117-a91d-56b97983af5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:06.125415 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62d0a0-3154-4117-a91d-56b97983af5c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:06.143252 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1332/2645] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:06.147687 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62d0a0-3154-4117-a91d-56b97983af5c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:06.161133 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62d0a0-3154-4117-a91d-56b97983af5c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:06.168076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96309ad4-88cb-4bb5-b99c-95a4d3608e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:06.169166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96309ad4-88cb-4bb5-b99c-95a4d3608e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:06.169457 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96309ad4-88cb-4bb5-b99c-95a4d3608e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:06.169757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96309ad4-88cb-4bb5-b99c-95a4d3608e40 admin admin] PATH_INFO: `/v3/projects/ff18f8d3ce2c4868ac424bc40866d438/users/06b4fe0c7f9d4bf88f5c1afa3a19cac4/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:06.188235 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96309ad4-88cb-4bb5-b99c-95a4d3608e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff18f8d3ce2c4868ac424bc40866d438, user_id=06b4fe0c7f9d4bf88f5c1afa3a19cac4, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:06.190814 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ce728-bc62-4aab-bf11-a64647b1c75e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:06.191109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96309ad4-88cb-4bb5-b99c-95a4d3608e40 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:06.194680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e351302-4c1e-44c8-a00a-909aeee509ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:06.195361 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e351302-4c1e-44c8-a00a-909aeee509ce service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:06.195818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e351302-4c1e-44c8-a00a-909aeee509ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:06.195991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e351302-4c1e-44c8-a00a-909aeee509ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:06.207237 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e351302-4c1e-44c8-a00a-909aeee509ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:06.208717 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e351302-4c1e-44c8-a00a-909aeee509ce service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:06.209719 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1333/2646] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:06 2022] PUT /identity/v3/projects/ff18f8d3ce2c4868ac424bc40866d438/users/06b4fe0c7f9d4bf88f5c1afa3a19cac4/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:06.214282 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96309ad4-88cb-4bb5-b99c-95a4d3608e40 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:06.220808 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1314/2647] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:06.294255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e351302-4c1e-44c8-a00a-909aeee509ce service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:06.296842 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5e351302-4c1e-44c8-a00a-909aeee509ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:06.315037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e351302-4c1e-44c8-a00a-909aeee509ce service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:06.328279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96309ad4-88cb-4bb5-b99c-95a4d3608e40 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:06.336997 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74b771-679e-465d-bac0-84313323827d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:06.338183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74b771-679e-465d-bac0-84313323827d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:06.338858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74b771-679e-465d-bac0-84313323827d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:06.339338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74b771-679e-465d-bac0-84313323827d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:06.340730 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74b771-679e-465d-bac0-84313323827d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:06.343893 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74b771-679e-465d-bac0-84313323827d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:06.347928 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:06.369276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1334/2648] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:33:06.371445 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74b771-679e-465d-bac0-84313323827d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:06.386641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74b771-679e-465d-bac0-84313323827d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:06.393946 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d24e5-28a0-400e-ab06-7d357c5ed0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:06.394455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeabe90-cb36-4638-b1b7-9bf84723f667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:06.395007 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeabe90-cb36-4638-b1b7-9bf84723f667 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:06.395270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d24e5-28a0-400e-ab06-7d357c5ed0db admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:06.395385 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeabe90-cb36-4638-b1b7-9bf84723f667 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:06.395567 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeabe90-cb36-4638-b1b7-9bf84723f667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:06.395779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d24e5-28a0-400e-ab06-7d357c5ed0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:06.396049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d24e5-28a0-400e-ab06-7d357c5ed0db admin admin] PATH_INFO: `/v3/projects/ff18f8d3ce2c4868ac424bc40866d438/users/06b4fe0c7f9d4bf88f5c1afa3a19cac4/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:06.397737 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8eeabe90-cb36-4638-b1b7-9bf84723f667 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:06.398490 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d24e5-28a0-400e-ab06-7d357c5ed0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff18f8d3ce2c4868ac424bc40866d438, user_id=06b4fe0c7f9d4bf88f5c1afa3a19cac4, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:06.401250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d24e5-28a0-400e-ab06-7d357c5ed0db admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:06.416494 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1335/2649] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:06 2022] PUT /identity/v3/projects/ff18f8d3ce2c4868ac424bc40866d438/users/06b4fe0c7f9d4bf88f5c1afa3a19cac4/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:33:06.421629 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:06.428199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da767f4e-aef3-4c98-aa16-4fb629bd9189 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:06.428545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da767f4e-aef3-4c98-aa16-4fb629bd9189 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:06.428836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da767f4e-aef3-4c98-aa16-4fb629bd9189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:06.460213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-da767f4e-aef3-4c98-aa16-4fb629bd9189 None None] MFA Rules not processed for user `06b4fe0c7f9d4bf88f5c1afa3a19cac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:06.461458 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-da767f4e-aef3-4c98-aa16-4fb629bd9189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:06.488249 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeabe90-cb36-4638-b1b7-9bf84723f667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:06.489741 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeabe90-cb36-4638-b1b7-9bf84723f667 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:06.500945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1315/2650] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:33:06.553936 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1336/2651] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:33:06.565907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeabe90-cb36-4638-b1b7-9bf84723f667 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:06.576896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeabe90-cb36-4638-b1b7-9bf84723f667 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:06.655288 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550c8de-2f2b-4b42-8c58-71eaf54809b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:06.656171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550c8de-2f2b-4b42-8c58-71eaf54809b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:06.656461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550c8de-2f2b-4b42-8c58-71eaf54809b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:06.656743 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550c8de-2f2b-4b42-8c58-71eaf54809b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:06.667868 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550c8de-2f2b-4b42-8c58-71eaf54809b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:06.669448 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550c8de-2f2b-4b42-8c58-71eaf54809b7 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:06.680616 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1316/2652] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:06.857445 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da767f4e-aef3-4c98-aa16-4fb629bd9189 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:06.946883 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da767f4e-aef3-4c98-aa16-4fb629bd9189 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:06.952921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d951a5-5c92-4a76-8655-e74e61b577db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:06.954678 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d951a5-5c92-4a76-8655-e74e61b577db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:06.955593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d951a5-5c92-4a76-8655-e74e61b577db admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:06.955593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d951a5-5c92-4a76-8655-e74e61b577db admin admin] PATH_INFO: `/v3/users/8028e55472bc49d9b21d15b3706812ee` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:06.957526 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d951a5-5c92-4a76-8655-e74e61b577db admin admin] RBAC: Authorizing `identity:delete_user(user_id=8028e55472bc49d9b21d15b3706812ee)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:06.960045 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d951a5-5c92-4a76-8655-e74e61b577db admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:07.033967 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14d951a5-5c92-4a76-8655-e74e61b577db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8028e55472bc49d9b21d15b3706812ee'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:07.045099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14d951a5-5c92-4a76-8655-e74e61b577db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8028e55472bc49d9b21d15b3706812ee'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:07.045885 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14d951a5-5c92-4a76-8655-e74e61b577db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8028e55472bc49d9b21d15b3706812ee'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:07.046599 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14d951a5-5c92-4a76-8655-e74e61b577db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8028e55472bc49d9b21d15b3706812ee'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:07.065455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:07.067087 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14d951a5-5c92-4a76-8655-e74e61b577db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8028e55472bc49d9b21d15b3706812ee'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:07.099224 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1337/2653] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:06 2022] DELETE /identity/v3/users/8028e55472bc49d9b21d15b3706812ee => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:33:07.105179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14376564-fb3c-4444-bcc9-3ce1bd4938be None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:07.105596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14376564-fb3c-4444-bcc9-3ce1bd4938be None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:07.106039 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14376564-fb3c-4444-bcc9-3ce1bd4938be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:07.137422 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-14376564-fb3c-4444-bcc9-3ce1bd4938be None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:07.138784 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-14376564-fb3c-4444-bcc9-3ce1bd4938be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:07.225716 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1317/2654] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:07.239599 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d951a5-5c92-4a76-8655-e74e61b577db admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:07.241425 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-14d951a5-5c92-4a76-8655-e74e61b577db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:07.319465 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d951a5-5c92-4a76-8655-e74e61b577db admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:07.324367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b98bc-56a9-48b7-8580-b0efbe9ee393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:07.325147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b98bc-56a9-48b7-8580-b0efbe9ee393 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:07.325434 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b98bc-56a9-48b7-8580-b0efbe9ee393 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:07.325714 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b98bc-56a9-48b7-8580-b0efbe9ee393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:07.338981 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b98bc-56a9-48b7-8580-b0efbe9ee393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:07.341929 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b98bc-56a9-48b7-8580-b0efbe9ee393 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:07.359555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1338/2655] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:07.779112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14376564-fb3c-4444-bcc9-3ce1bd4938be None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:07.781466 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-14376564-fb3c-4444-bcc9-3ce1bd4938be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:07.804619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14376564-fb3c-4444-bcc9-3ce1bd4938be None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:07.813896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:07.815429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:07.815975 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:07.816461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884 admin admin] PATH_INFO: `/v3/projects/653f321f4de645e7a4da310cadfbd6e3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:07.819680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=653f321f4de645e7a4da310cadfbd6e3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:07.823619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:07.923603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '653f321f4de645e7a4da310cadfbd6e3', 'request_id': 'req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:07.927286 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:07.941981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '653f321f4de645e7a4da310cadfbd6e3', 'request_id': 'req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:07.952342 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '653f321f4de645e7a4da310cadfbd6e3', 'request_id': 'req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:07.969137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884 admin admin] The token cache is being invalidate because project 653f321f4de645e7a4da310cadfbd6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:07.969745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:07.970755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:07.973149 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1318/2656] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:07 2022] DELETE /identity/v3/projects/653f321f4de645e7a4da310cadfbd6e3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:07.978341 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b98bc-56a9-48b7-8580-b0efbe9ee393 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:07.993749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b98bc-56a9-48b7-8580-b0efbe9ee393 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:08.086941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89231119-bbb4-43c6-83d6-14a945deabb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:08.087876 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89231119-bbb4-43c6-83d6-14a945deabb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:08.088165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89231119-bbb4-43c6-83d6-14a945deabb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:08.088440 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89231119-bbb4-43c6-83d6-14a945deabb9 admin admin] PATH_INFO: `/v3/users/06b4fe0c7f9d4bf88f5c1afa3a19cac4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:08.089834 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89231119-bbb4-43c6-83d6-14a945deabb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b4fe0c7f9d4bf88f5c1afa3a19cac4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:08.091926 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89231119-bbb4-43c6-83d6-14a945deabb9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:08.192451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89231119-bbb4-43c6-83d6-14a945deabb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b4fe0c7f9d4bf88f5c1afa3a19cac4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:08.206315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89231119-bbb4-43c6-83d6-14a945deabb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b4fe0c7f9d4bf88f5c1afa3a19cac4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:08.207657 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89231119-bbb4-43c6-83d6-14a945deabb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b4fe0c7f9d4bf88f5c1afa3a19cac4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:08.208632 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89231119-bbb4-43c6-83d6-14a945deabb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b4fe0c7f9d4bf88f5c1afa3a19cac4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:08.234315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89231119-bbb4-43c6-83d6-14a945deabb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b4fe0c7f9d4bf88f5c1afa3a19cac4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:08.266889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1339/2657] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:07 2022] DELETE /identity/v3/users/06b4fe0c7f9d4bf88f5c1afa3a19cac4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:08.507920 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:08.509484 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:08.615272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb3cad-6d69-41a5-a37b-426cf6ca5884 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:08.704302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234a595-4dfe-41b6-9f0a-15a6cb7d876f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:08.704987 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234a595-4dfe-41b6-9f0a-15a6cb7d876f service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:08.705279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234a595-4dfe-41b6-9f0a-15a6cb7d876f service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:08.706074 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234a595-4dfe-41b6-9f0a-15a6cb7d876f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:08.709212 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b234a595-4dfe-41b6-9f0a-15a6cb7d876f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:08.745798 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89231119-bbb4-43c6-83d6-14a945deabb9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:08.748142 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-89231119-bbb4-43c6-83d6-14a945deabb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:08.788616 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:08.838885 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234a595-4dfe-41b6-9f0a-15a6cb7d876f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:08.840411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234a595-4dfe-41b6-9f0a-15a6cb7d876f service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:08.854829 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1319/2658] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:33:08.897159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89231119-bbb4-43c6-83d6-14a945deabb9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:08.905710 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d559c-b55f-45e5-83e7-8b71f80937f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:08.907052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d559c-b55f-45e5-83e7-8b71f80937f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:08.907564 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d559c-b55f-45e5-83e7-8b71f80937f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:08.908051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d559c-b55f-45e5-83e7-8b71f80937f6 admin admin] PATH_INFO: `/v3/projects/ff18f8d3ce2c4868ac424bc40866d438` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:08.910964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d559c-b55f-45e5-83e7-8b71f80937f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff18f8d3ce2c4868ac424bc40866d438)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:08.915277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d559c-b55f-45e5-83e7-8b71f80937f6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:08.982017 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-de2d559c-b55f-45e5-83e7-8b71f80937f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff18f8d3ce2c4868ac424bc40866d438', 'request_id': 'req-de2d559c-b55f-45e5-83e7-8b71f80937f6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:08.990507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-de2d559c-b55f-45e5-83e7-8b71f80937f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff18f8d3ce2c4868ac424bc40866d438', 'request_id': 'req-de2d559c-b55f-45e5-83e7-8b71f80937f6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:09.000803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-de2d559c-b55f-45e5-83e7-8b71f80937f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff18f8d3ce2c4868ac424bc40866d438', 'request_id': 'req-de2d559c-b55f-45e5-83e7-8b71f80937f6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:09.020254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-de2d559c-b55f-45e5-83e7-8b71f80937f6 admin admin] The token cache is being invalidate because project ff18f8d3ce2c4868ac424bc40866d438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:09.020816 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-de2d559c-b55f-45e5-83e7-8b71f80937f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:09.021566 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-de2d559c-b55f-45e5-83e7-8b71f80937f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:09.024042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1340/2659] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:08 2022] DELETE /identity/v3/projects/ff18f8d3ce2c4868ac424bc40866d438 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:33:09.030021 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9862d-c5ec-4fc0-bb55-614f83cf48cc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:09.030373 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9862d-c5ec-4fc0-bb55-614f83cf48cc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:09.030670 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9862d-c5ec-4fc0-bb55-614f83cf48cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:09.052731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-40f9862d-c5ec-4fc0-bb55-614f83cf48cc None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:09.054082 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-40f9862d-c5ec-4fc0-bb55-614f83cf48cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:09.136898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:09.141202 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1320/2660] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:09.149340 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4ce9d-2aae-4972-8968-6053c28c1576 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:09.149663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4ce9d-2aae-4972-8968-6053c28c1576 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:09.149876 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4ce9d-2aae-4972-8968-6053c28c1576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:09.170823 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-61a4ce9d-2aae-4972-8968-6053c28c1576 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:09.172168 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-61a4ce9d-2aae-4972-8968-6053c28c1576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:09.180670 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1341/2661] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:33:09.185307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9862d-c5ec-4fc0-bb55-614f83cf48cc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:09.197041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9862d-c5ec-4fc0-bb55-614f83cf48cc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:09.203039 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2575a-dd3e-439f-922a-2fbd4713cbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:09.204341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2575a-dd3e-439f-922a-2fbd4713cbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:09.204918 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2575a-dd3e-439f-922a-2fbd4713cbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:09.205460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2575a-dd3e-439f-922a-2fbd4713cbc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:09.206405 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2575a-dd3e-439f-922a-2fbd4713cbc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:33:09.206898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2575a-dd3e-439f-922a-2fbd4713cbc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:09.208921 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2575a-dd3e-439f-922a-2fbd4713cbc8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:09.224140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1321/2662] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:33:09.229260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4ce9d-2aae-4972-8968-6053c28c1576 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:09.240143 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4ce9d-2aae-4972-8968-6053c28c1576 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:09.245123 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c469f-49a9-49ba-b6d1-02d38d14a421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:09.245873 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c469f-49a9-49ba-b6d1-02d38d14a421 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:09.246162 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c469f-49a9-49ba-b6d1-02d38d14a421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:09.246471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c469f-49a9-49ba-b6d1-02d38d14a421 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:09.247195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c469f-49a9-49ba-b6d1-02d38d14a421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:09.249170 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c469f-49a9-49ba-b6d1-02d38d14a421 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:09.281276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1342/2663] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:09 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:09.287792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2575a-dd3e-439f-922a-2fbd4713cbc8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:09.306200 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2575a-dd3e-439f-922a-2fbd4713cbc8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:09.408393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6072c13-75b9-4908-b359-e142fe6b3c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:09.409252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6072c13-75b9-4908-b359-e142fe6b3c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:09.409633 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6072c13-75b9-4908-b359-e142fe6b3c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:09.410052 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6072c13-75b9-4908-b359-e142fe6b3c7b admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:09.411300 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6072c13-75b9-4908-b359-e142fe6b3c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:09.413487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6072c13-75b9-4908-b359-e142fe6b3c7b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:09.448072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1322/2664] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:09 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:09.454519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c469f-49a9-49ba-b6d1-02d38d14a421 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:09.468484 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c469f-49a9-49ba-b6d1-02d38d14a421 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:09.475150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09372d-be58-4641-a596-8d205b92c7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:09.475940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09372d-be58-4641-a596-8d205b92c7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:09.476300 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09372d-be58-4641-a596-8d205b92c7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:09.476645 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09372d-be58-4641-a596-8d205b92c7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:09.477495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09372d-be58-4641-a596-8d205b92c7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:09.480377 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09372d-be58-4641-a596-8d205b92c7c4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:09.496555 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1343/2665] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:09.503800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6072c13-75b9-4908-b359-e142fe6b3c7b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:09.522979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6072c13-75b9-4908-b359-e142fe6b3c7b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:09.532892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371e2e2-3a44-4ed4-a262-d88741224ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:09.534070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371e2e2-3a44-4ed4-a262-d88741224ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:09.534717 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371e2e2-3a44-4ed4-a262-d88741224ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:09.535218 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371e2e2-3a44-4ed4-a262-d88741224ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:09.536677 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371e2e2-3a44-4ed4-a262-d88741224ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:09.540207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371e2e2-3a44-4ed4-a262-d88741224ef2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:09.563050 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1323/2666] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:09.568117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09372d-be58-4641-a596-8d205b92c7c4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:09.579806 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09372d-be58-4641-a596-8d205b92c7c4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:09.587481 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56026307-b5c9-4435-be53-828106f6cd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:09.589130 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56026307-b5c9-4435-be53-828106f6cd88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:09.589591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56026307-b5c9-4435-be53-828106f6cd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:09.590105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56026307-b5c9-4435-be53-828106f6cd88 admin admin] PATH_INFO: `/v3/projects/ad2d25d0027a40938de5220a7bfd0951/users/2cc7f2da58e34dc9bf4964b91e6087fd/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:09.618158 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56026307-b5c9-4435-be53-828106f6cd88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2d25d0027a40938de5220a7bfd0951, user_id=2cc7f2da58e34dc9bf4964b91e6087fd, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:09.621759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56026307-b5c9-4435-be53-828106f6cd88 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:09.643481 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1344/2667] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:09 2022] PUT /identity/v3/projects/ad2d25d0027a40938de5220a7bfd0951/users/2cc7f2da58e34dc9bf4964b91e6087fd/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:09.655797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c49b7-1c38-4e23-be76-ad6d1892ea7f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:09.656159 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c49b7-1c38-4e23-be76-ad6d1892ea7f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:09.656411 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c49b7-1c38-4e23-be76-ad6d1892ea7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:09.703884 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cd0c49b7-1c38-4e23-be76-ad6d1892ea7f None None] MFA Rules not processed for user `2cc7f2da58e34dc9bf4964b91e6087fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:09.705477 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cd0c49b7-1c38-4e23-be76-ad6d1892ea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:09.818619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1324/2668] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:09.826309 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56026307-b5c9-4435-be53-828106f6cd88 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:09.853300 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c49b7-1c38-4e23-be76-ad6d1892ea7f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:09.854955 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cd0c49b7-1c38-4e23-be76-ad6d1892ea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:09.908693 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:09.933272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:09.951383 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56026307-b5c9-4435-be53-828106f6cd88 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:09.963849 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1ef3-19bb-429a-9819-7e810f7c33ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:09.965327 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1ef3-19bb-429a-9819-7e810f7c33ad admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:09.965914 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1ef3-19bb-429a-9819-7e810f7c33ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:09.966536 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1ef3-19bb-429a-9819-7e810f7c33ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:09.967845 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d1ef3-19bb-429a-9819-7e810f7c33ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:09.971262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d1ef3-19bb-429a-9819-7e810f7c33ad admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:09.978722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c49b7-1c38-4e23-be76-ad6d1892ea7f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:09.987052 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6af74-ad2c-462e-8ced-b9bf8062af20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:09.988505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6af74-ad2c-462e-8ced-b9bf8062af20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:09.989456 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6af74-ad2c-462e-8ced-b9bf8062af20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:09.989605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6af74-ad2c-462e-8ced-b9bf8062af20 admin admin] PATH_INFO: `/v3/users/66926d9e836a4c50b9a8409096390df2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:09.992183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6af74-ad2c-462e-8ced-b9bf8062af20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66926d9e836a4c50b9a8409096390df2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:09.996422 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6af74-ad2c-462e-8ced-b9bf8062af20 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:10.021584 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1345/2669] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:09 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:10.025941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1ef3-19bb-429a-9819-7e810f7c33ad admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:10.086516 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc6af74-ad2c-462e-8ced-b9bf8062af20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66926d9e836a4c50b9a8409096390df2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:10.102875 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc6af74-ad2c-462e-8ced-b9bf8062af20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66926d9e836a4c50b9a8409096390df2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:10.131156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc6af74-ad2c-462e-8ced-b9bf8062af20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66926d9e836a4c50b9a8409096390df2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:10.135184 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc6af74-ad2c-462e-8ced-b9bf8062af20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66926d9e836a4c50b9a8409096390df2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:10.149054 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1ef3-19bb-429a-9819-7e810f7c33ad admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:10.157871 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb730f7e-9773-47b2-a73b-fc75cc806bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:10.159524 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb730f7e-9773-47b2-a73b-fc75cc806bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:10.160061 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb730f7e-9773-47b2-a73b-fc75cc806bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:10.160744 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb730f7e-9773-47b2-a73b-fc75cc806bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:10.162404 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb730f7e-9773-47b2-a73b-fc75cc806bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:10.167197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb730f7e-9773-47b2-a73b-fc75cc806bb6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:10.188917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc6af74-ad2c-462e-8ced-b9bf8062af20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66926d9e836a4c50b9a8409096390df2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:10.217008 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1325/2670] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:09 2022] DELETE /identity/v3/users/66926d9e836a4c50b9a8409096390df2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:10.223402 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2055faf-b87a-4c13-807a-edb5018a5c5b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:10.224238 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2055faf-b87a-4c13-807a-edb5018a5c5b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:10.226290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1346/2671] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:10 2022] POST /identity/v3/users => generated 298 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:10.227246 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2055faf-b87a-4c13-807a-edb5018a5c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:10.231405 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb730f7e-9773-47b2-a73b-fc75cc806bb6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:10.238039 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fb730f7e-9773-47b2-a73b-fc75cc806bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:10.266409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb730f7e-9773-47b2-a73b-fc75cc806bb6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:10.286239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d2055faf-b87a-4c13-807a-edb5018a5c5b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:10.289099 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d2055faf-b87a-4c13-807a-edb5018a5c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:10.372792 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f368f9-d9c2-45b0-9d68-46fb5d99555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:10.373970 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f368f9-d9c2-45b0-9d68-46fb5d99555b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:10.374716 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f368f9-d9c2-45b0-9d68-46fb5d99555b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:10.375391 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f368f9-d9c2-45b0-9d68-46fb5d99555b admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:10.376826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f368f9-d9c2-45b0-9d68-46fb5d99555b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:10.380169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f368f9-d9c2-45b0-9d68-46fb5d99555b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:10.411076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1347/2672] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:10.412632 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f368f9-d9c2-45b0-9d68-46fb5d99555b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:10.429541 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1326/2673] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:10.439572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f368f9-d9c2-45b0-9d68-46fb5d99555b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:10.449676 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99380ece-d51e-46b3-b758-9246d206f936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:10.452091 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99380ece-d51e-46b3-b758-9246d206f936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:10.452816 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99380ece-d51e-46b3-b758-9246d206f936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:10.453440 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99380ece-d51e-46b3-b758-9246d206f936 admin admin] PATH_INFO: `/v3/projects/60eb4f716b94422eab2834b5890d378f/users/8168b7ac377947b5b99a33ae0e0e362a/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:10.455490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2055faf-b87a-4c13-807a-edb5018a5c5b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:10.457052 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d2055faf-b87a-4c13-807a-edb5018a5c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:10.483051 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99380ece-d51e-46b3-b758-9246d206f936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60eb4f716b94422eab2834b5890d378f, user_id=8168b7ac377947b5b99a33ae0e0e362a, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:10.488617 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99380ece-d51e-46b3-b758-9246d206f936 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:10.514672 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1348/2674] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:10 2022] PUT /identity/v3/projects/60eb4f716b94422eab2834b5890d378f/users/8168b7ac377947b5b99a33ae0e0e362a/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:10.521306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99380ece-d51e-46b3-b758-9246d206f936 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:10.545126 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2055faf-b87a-4c13-807a-edb5018a5c5b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:10.569742 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:10.574503 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:10.624262 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910f119-0347-46ff-b285-d62628be1a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:10.625002 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910f119-0347-46ff-b285-d62628be1a3d service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:10.625288 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910f119-0347-46ff-b285-d62628be1a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:10.625759 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910f119-0347-46ff-b285-d62628be1a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:10.650813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99380ece-d51e-46b3-b758-9246d206f936 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:10.658009 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adf161-c19c-4f22-8112-bbad6ef5d98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:10.659416 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adf161-c19c-4f22-8112-bbad6ef5d98a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:10.659772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adf161-c19c-4f22-8112-bbad6ef5d98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:10.659964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adf161-c19c-4f22-8112-bbad6ef5d98a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:10.661304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05adf161-c19c-4f22-8112-bbad6ef5d98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:10.663293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05adf161-c19c-4f22-8112-bbad6ef5d98a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:10.678855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1349/2675] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:33:10.684180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adf161-c19c-4f22-8112-bbad6ef5d98a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:10.701911 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adf161-c19c-4f22-8112-bbad6ef5d98a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:10.709947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa3b51-7002-4563-b1d5-81e862584ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:10.711625 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa3b51-7002-4563-b1d5-81e862584ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:10.712109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa3b51-7002-4563-b1d5-81e862584ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:10.712580 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa3b51-7002-4563-b1d5-81e862584ccb admin admin] PATH_INFO: `/v3/projects/60eb4f716b94422eab2834b5890d378f/users/8168b7ac377947b5b99a33ae0e0e362a/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:10.716731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa3b51-7002-4563-b1d5-81e862584ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=60eb4f716b94422eab2834b5890d378f, user_id=8168b7ac377947b5b99a33ae0e0e362a, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:10.722301 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa3b51-7002-4563-b1d5-81e862584ccb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:10.738740 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910f119-0347-46ff-b285-d62628be1a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:10.740371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1350/2676] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:10 2022] PUT /identity/v3/projects/60eb4f716b94422eab2834b5890d378f/users/8168b7ac377947b5b99a33ae0e0e362a/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:10.741765 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910f119-0347-46ff-b285-d62628be1a3d service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:10.751168 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d0513-3f4c-4427-9bce-8b1e45f0a19f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:10.751566 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d0513-3f4c-4427-9bce-8b1e45f0a19f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:10.751741 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d0513-3f4c-4427-9bce-8b1e45f0a19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:10.762692 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1327/2677] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:33:10.795987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ff1d0513-3f4c-4427-9bce-8b1e45f0a19f None None] MFA Rules not processed for user `8168b7ac377947b5b99a33ae0e0e362a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:10.797901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ff1d0513-3f4c-4427-9bce-8b1e45f0a19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:10.930649 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1351/2678] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:33:10.948074 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910f119-0347-46ff-b285-d62628be1a3d service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:10.950681 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5910f119-0347-46ff-b285-d62628be1a3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:11.104064 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910f119-0347-46ff-b285-d62628be1a3d service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:11.225010 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04787ff0-947e-4603-aace-11c97ccefef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:11.226642 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04787ff0-947e-4603-aace-11c97ccefef5 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:11.227631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04787ff0-947e-4603-aace-11c97ccefef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:11.228828 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04787ff0-947e-4603-aace-11c97ccefef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:11.231163 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-04787ff0-947e-4603-aace-11c97ccefef5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:11.322573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d0513-3f4c-4427-9bce-8b1e45f0a19f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:11.328621 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ff1d0513-3f4c-4427-9bce-8b1e45f0a19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:11.353343 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:11.406526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04787ff0-947e-4603-aace-11c97ccefef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:11.409703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04787ff0-947e-4603-aace-11c97ccefef5 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:11.429030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1328/2679] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:11.532334 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d0513-3f4c-4427-9bce-8b1e45f0a19f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:11.545047 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:11.546904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:11.547634 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:11.548157 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae admin admin] PATH_INFO: `/v3/projects/d0d046cc159d44a4a2e7b2e9d9f2024f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:11.552109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d046cc159d44a4a2e7b2e9d9f2024f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:11.556183 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:11.630906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:11.644850 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d046cc159d44a4a2e7b2e9d9f2024f', 'request_id': 'req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:11.657665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d046cc159d44a4a2e7b2e9d9f2024f', 'request_id': 'req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:11.670401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d046cc159d44a4a2e7b2e9d9f2024f', 'request_id': 'req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:11.696536 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae admin admin] The token cache is being invalidate because project d0d046cc159d44a4a2e7b2e9d9f2024f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:11.697375 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:11.698438 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:11.701061 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1352/2680] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:11 2022] DELETE /identity/v3/projects/d0d046cc159d44a4a2e7b2e9d9f2024f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:11.705747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04787ff0-947e-4603-aace-11c97ccefef5 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:11.730913 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04787ff0-947e-4603-aace-11c97ccefef5 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:11.859186 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783cca0-a55a-4bb8-aa8d-ab47c34aaa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:11.860984 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783cca0-a55a-4bb8-aa8d-ab47c34aaa3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:11.861481 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783cca0-a55a-4bb8-aa8d-ab47c34aaa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:11.862045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783cca0-a55a-4bb8-aa8d-ab47c34aaa3e admin admin] PATH_INFO: `/v3/users/2b13e244a4af45d29e8cac9f40775f68` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:11.864627 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783cca0-a55a-4bb8-aa8d-ab47c34aaa3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b13e244a4af45d29e8cac9f40775f68)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:11.869836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783cca0-a55a-4bb8-aa8d-ab47c34aaa3e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:11.963829 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a783cca0-a55a-4bb8-aa8d-ab47c34aaa3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b13e244a4af45d29e8cac9f40775f68'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:11.979140 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a783cca0-a55a-4bb8-aa8d-ab47c34aaa3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b13e244a4af45d29e8cac9f40775f68'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:11.994584 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a783cca0-a55a-4bb8-aa8d-ab47c34aaa3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b13e244a4af45d29e8cac9f40775f68'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:11.996019 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a783cca0-a55a-4bb8-aa8d-ab47c34aaa3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b13e244a4af45d29e8cac9f40775f68'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:12.016526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a783cca0-a55a-4bb8-aa8d-ab47c34aaa3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b13e244a4af45d29e8cac9f40775f68'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:12.026036 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1329/2681] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:11 2022] DELETE /identity/v3/users/2b13e244a4af45d29e8cac9f40775f68 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:12.489955 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:12.492846 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:12.540694 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342c2a2-6eb3-4bf0-a667-87cfae9418ae admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:12.660026 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628d738-aa05-4693-a2ad-4064f6bb163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:12.660934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628d738-aa05-4693-a2ad-4064f6bb163b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:12.661272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628d738-aa05-4693-a2ad-4064f6bb163b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:12.661500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628d738-aa05-4693-a2ad-4064f6bb163b admin admin] PATH_INFO: `/v3/projects/40a4447a878a4a079143315eb8d93016` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:12.662948 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628d738-aa05-4693-a2ad-4064f6bb163b admin admin] RBAC: Authorizing `identity:delete_project(project_id=40a4447a878a4a079143315eb8d93016)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:12.665302 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628d738-aa05-4693-a2ad-4064f6bb163b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:12.731290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c628d738-aa05-4693-a2ad-4064f6bb163b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40a4447a878a4a079143315eb8d93016', 'request_id': 'req-c628d738-aa05-4693-a2ad-4064f6bb163b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:12.741572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c628d738-aa05-4693-a2ad-4064f6bb163b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40a4447a878a4a079143315eb8d93016', 'request_id': 'req-c628d738-aa05-4693-a2ad-4064f6bb163b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:12.751451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c628d738-aa05-4693-a2ad-4064f6bb163b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40a4447a878a4a079143315eb8d93016', 'request_id': 'req-c628d738-aa05-4693-a2ad-4064f6bb163b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:12.779371 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c628d738-aa05-4693-a2ad-4064f6bb163b admin admin] The token cache is being invalidate because project 40a4447a878a4a079143315eb8d93016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:12.779985 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c628d738-aa05-4693-a2ad-4064f6bb163b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:12.781226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c628d738-aa05-4693-a2ad-4064f6bb163b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:12.783427 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1353/2682] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:12 2022] DELETE /identity/v3/projects/40a4447a878a4a079143315eb8d93016 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:12.790564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783cca0-a55a-4bb8-aa8d-ab47c34aaa3e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:12.793190 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a783cca0-a55a-4bb8-aa8d-ab47c34aaa3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:12.815271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783cca0-a55a-4bb8-aa8d-ab47c34aaa3e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:12.917798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:12.931615 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77e85d-b1ab-44a1-a921-634606367f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:12.933202 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77e85d-b1ab-44a1-a921-634606367f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:12.934184 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77e85d-b1ab-44a1-a921-634606367f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:12.935460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77e85d-b1ab-44a1-a921-634606367f9d admin admin] PATH_INFO: `/v3/users/7fce60cce3a84c499b2cf781855ad922` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:12.939626 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77e85d-b1ab-44a1-a921-634606367f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fce60cce3a84c499b2cf781855ad922)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:12.945268 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77e85d-b1ab-44a1-a921-634606367f9d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:13.049842 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ba77e85d-b1ab-44a1-a921-634606367f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fce60cce3a84c499b2cf781855ad922'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:13.068466 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ba77e85d-b1ab-44a1-a921-634606367f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fce60cce3a84c499b2cf781855ad922'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:13.083362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ba77e85d-b1ab-44a1-a921-634606367f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fce60cce3a84c499b2cf781855ad922'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:13.084672 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ba77e85d-b1ab-44a1-a921-634606367f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fce60cce3a84c499b2cf781855ad922'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:13.105179 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ba77e85d-b1ab-44a1-a921-634606367f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fce60cce3a84c499b2cf781855ad922'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:13.131670 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1330/2683] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:12 2022] DELETE /identity/v3/users/7fce60cce3a84c499b2cf781855ad922 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:13.600915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628d738-aa05-4693-a2ad-4064f6bb163b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:13.603149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c628d738-aa05-4693-a2ad-4064f6bb163b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:13.623195 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628d738-aa05-4693-a2ad-4064f6bb163b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:13.784357 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:13.802111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb1ae2-64c4-469d-9ef9-64a077ad1f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:13.803793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb1ae2-64c4-469d-9ef9-64a077ad1f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:13.805325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb1ae2-64c4-469d-9ef9-64a077ad1f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:13.806367 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb1ae2-64c4-469d-9ef9-64a077ad1f2f admin admin] PATH_INFO: `/v3/projects/31bd00eab34847318fc2d2348fa8f064` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:13.809314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb1ae2-64c4-469d-9ef9-64a077ad1f2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=31bd00eab34847318fc2d2348fa8f064)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:13.814078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb1ae2-64c4-469d-9ef9-64a077ad1f2f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:13.870101 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77e85d-b1ab-44a1-a921-634606367f9d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:13.873722 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ba77e85d-b1ab-44a1-a921-634606367f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:13.902712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77e85d-b1ab-44a1-a921-634606367f9d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:13.914013 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a9eb1ae2-64c4-469d-9ef9-64a077ad1f2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31bd00eab34847318fc2d2348fa8f064', 'request_id': 'req-a9eb1ae2-64c4-469d-9ef9-64a077ad1f2f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:13.923050 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a9eb1ae2-64c4-469d-9ef9-64a077ad1f2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31bd00eab34847318fc2d2348fa8f064', 'request_id': 'req-a9eb1ae2-64c4-469d-9ef9-64a077ad1f2f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:13.930723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a9eb1ae2-64c4-469d-9ef9-64a077ad1f2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31bd00eab34847318fc2d2348fa8f064', 'request_id': 'req-a9eb1ae2-64c4-469d-9ef9-64a077ad1f2f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:13.947284 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a9eb1ae2-64c4-469d-9ef9-64a077ad1f2f admin admin] The token cache is being invalidate because project 31bd00eab34847318fc2d2348fa8f064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:13.947574 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a9eb1ae2-64c4-469d-9ef9-64a077ad1f2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:13.948236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a9eb1ae2-64c4-469d-9ef9-64a077ad1f2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:13.949855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1354/2684] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:13 2022] DELETE /identity/v3/projects/31bd00eab34847318fc2d2348fa8f064 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:13.956794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca8424-2c42-4a5c-ba17-9abb9dcf475a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:13.957112 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca8424-2c42-4a5c-ba17-9abb9dcf475a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:13.957339 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca8424-2c42-4a5c-ba17-9abb9dcf475a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:13.979407 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-12ca8424-2c42-4a5c-ba17-9abb9dcf475a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:13.980595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-12ca8424-2c42-4a5c-ba17-9abb9dcf475a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:14.002880 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dce94-cfdc-4d1a-92a9-25f5d2f6818e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:14.004276 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dce94-cfdc-4d1a-92a9-25f5d2f6818e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:14.004674 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dce94-cfdc-4d1a-92a9-25f5d2f6818e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:14.005245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dce94-cfdc-4d1a-92a9-25f5d2f6818e admin admin] PATH_INFO: `/v3/users/202e415e386e4abe8c70a9889448eb02` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:14.008040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3dce94-cfdc-4d1a-92a9-25f5d2f6818e admin admin] RBAC: Authorizing `identity:delete_user(user_id=202e415e386e4abe8c70a9889448eb02)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:14.010633 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3dce94-cfdc-4d1a-92a9-25f5d2f6818e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:14.059314 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1355/2685] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:14.068650 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480ec58-70e1-4dd2-b1d1-69e43ede1221 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:14.068964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480ec58-70e1-4dd2-b1d1-69e43ede1221 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:14.069254 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480ec58-70e1-4dd2-b1d1-69e43ede1221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:14.077733 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd3dce94-cfdc-4d1a-92a9-25f5d2f6818e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '202e415e386e4abe8c70a9889448eb02'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:14.087346 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd3dce94-cfdc-4d1a-92a9-25f5d2f6818e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '202e415e386e4abe8c70a9889448eb02'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:14.099335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd3dce94-cfdc-4d1a-92a9-25f5d2f6818e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '202e415e386e4abe8c70a9889448eb02'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:14.100341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd3dce94-cfdc-4d1a-92a9-25f5d2f6818e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '202e415e386e4abe8c70a9889448eb02'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:14.103047 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0480ec58-70e1-4dd2-b1d1-69e43ede1221 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:14.104843 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0480ec58-70e1-4dd2-b1d1-69e43ede1221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:14.114800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:14.117517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd3dce94-cfdc-4d1a-92a9-25f5d2f6818e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '202e415e386e4abe8c70a9889448eb02'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:14.126261 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1356/2686] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:33:14.128046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480ec58-70e1-4dd2-b1d1-69e43ede1221 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:14.130878 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1331/2687] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:13 2022] DELETE /identity/v3/users/202e415e386e4abe8c70a9889448eb02 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:14.138510 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480ec58-70e1-4dd2-b1d1-69e43ede1221 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:14.247441 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811e6a3-ba4c-4dd2-86bf-7b824a27cb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:14.248421 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811e6a3-ba4c-4dd2-86bf-7b824a27cb10 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:14.248713 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811e6a3-ba4c-4dd2-86bf-7b824a27cb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:14.249000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811e6a3-ba4c-4dd2-86bf-7b824a27cb10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:14.250726 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811e6a3-ba4c-4dd2-86bf-7b824a27cb10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:33:14.251052 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811e6a3-ba4c-4dd2-86bf-7b824a27cb10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:14.252746 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811e6a3-ba4c-4dd2-86bf-7b824a27cb10 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:14.279918 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1357/2688] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:33:14.283191 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dce94-cfdc-4d1a-92a9-25f5d2f6818e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:14.300777 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dce94-cfdc-4d1a-92a9-25f5d2f6818e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:14.308841 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ef011-cb4a-4a26-b042-8867e02b8f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:14.309749 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ef011-cb4a-4a26-b042-8867e02b8f3f admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:14.309994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ef011-cb4a-4a26-b042-8867e02b8f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:14.310280 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ef011-cb4a-4a26-b042-8867e02b8f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:14.311098 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ef011-cb4a-4a26-b042-8867e02b8f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:14.313716 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ef011-cb4a-4a26-b042-8867e02b8f3f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:14.343854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1332/2689] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:14 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:14.348786 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811e6a3-ba4c-4dd2-86bf-7b824a27cb10 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:14.371679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811e6a3-ba4c-4dd2-86bf-7b824a27cb10 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:14.384968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ef011-cb4a-4a26-b042-8867e02b8f3f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:14.386511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:14.386903 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-352ef011-cb4a-4a26-b042-8867e02b8f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:14.460349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842bcb7-46ec-459d-85b1-2988e6ebd27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:14.461054 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842bcb7-46ec-459d-85b1-2988e6ebd27f admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:14.461349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842bcb7-46ec-459d-85b1-2988e6ebd27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:14.461634 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842bcb7-46ec-459d-85b1-2988e6ebd27f admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:14.462409 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842bcb7-46ec-459d-85b1-2988e6ebd27f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:14.464475 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842bcb7-46ec-459d-85b1-2988e6ebd27f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:14.485156 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ef011-cb4a-4a26-b042-8867e02b8f3f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:14.488607 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1358/2690] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:14 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:14.490380 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410b2fc-4e23-4a14-a41b-c1d5485a021e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:14.491294 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410b2fc-4e23-4a14-a41b-c1d5485a021e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:14.491611 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410b2fc-4e23-4a14-a41b-c1d5485a021e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:14.491850 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410b2fc-4e23-4a14-a41b-c1d5485a021e admin admin] PATH_INFO: `/v3/projects/8ed24158017d441e98bdf7e57e1cb153` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:14.492948 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842bcb7-46ec-459d-85b1-2988e6ebd27f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:14.493409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410b2fc-4e23-4a14-a41b-c1d5485a021e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed24158017d441e98bdf7e57e1cb153)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:14.495734 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410b2fc-4e23-4a14-a41b-c1d5485a021e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:14.504633 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842bcb7-46ec-459d-85b1-2988e6ebd27f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:14.509810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4e010-561c-430f-b271-bdc141e0f48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:14.510752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4e010-561c-430f-b271-bdc141e0f48d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:14.511522 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4e010-561c-430f-b271-bdc141e0f48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:14.511809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4e010-561c-430f-b271-bdc141e0f48d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:14.512608 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4e010-561c-430f-b271-bdc141e0f48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:14.514258 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4e010-561c-430f-b271-bdc141e0f48d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:14.528696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1359/2691] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:14.533842 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4e010-561c-430f-b271-bdc141e0f48d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:14.546648 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4e010-561c-430f-b271-bdc141e0f48d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:14.555800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9410b2fc-4e23-4a14-a41b-c1d5485a021e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed24158017d441e98bdf7e57e1cb153', 'request_id': 'req-9410b2fc-4e23-4a14-a41b-c1d5485a021e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:14.567118 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9410b2fc-4e23-4a14-a41b-c1d5485a021e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed24158017d441e98bdf7e57e1cb153', 'request_id': 'req-9410b2fc-4e23-4a14-a41b-c1d5485a021e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:14.576302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9410b2fc-4e23-4a14-a41b-c1d5485a021e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed24158017d441e98bdf7e57e1cb153', 'request_id': 'req-9410b2fc-4e23-4a14-a41b-c1d5485a021e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:14.591371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9410b2fc-4e23-4a14-a41b-c1d5485a021e admin admin] The token cache is being invalidate because project 8ed24158017d441e98bdf7e57e1cb153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:14.591670 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9410b2fc-4e23-4a14-a41b-c1d5485a021e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:14.592382 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9410b2fc-4e23-4a14-a41b-c1d5485a021e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:14.594383 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1333/2692] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:14 2022] DELETE /identity/v3/projects/8ed24158017d441e98bdf7e57e1cb153 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:33:14.600511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0f0cd-d508-4307-9785-203bfe128d56 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:14.600807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0f0cd-d508-4307-9785-203bfe128d56 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:14.601093 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0f0cd-d508-4307-9785-203bfe128d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:14.622792 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689162c-f295-4cac-acee-cc85710708f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:14.623428 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e0b0f0cd-d508-4307-9785-203bfe128d56 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:14.624343 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689162c-f295-4cac-acee-cc85710708f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:14.624629 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e0b0f0cd-d508-4307-9785-203bfe128d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:14.625282 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689162c-f295-4cac-acee-cc85710708f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:14.625282 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689162c-f295-4cac-acee-cc85710708f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:14.625663 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689162c-f295-4cac-acee-cc85710708f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:14.627376 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689162c-f295-4cac-acee-cc85710708f7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:14.633840 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1334/2693] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:14.639437 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1360/2694] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:14.642690 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56746399-546a-46a2-9c70-dde04f136a34 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:14.643139 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56746399-546a-46a2-9c70-dde04f136a34 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:14.643629 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56746399-546a-46a2-9c70-dde04f136a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:14.644644 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689162c-f295-4cac-acee-cc85710708f7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:14.646666 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e689162c-f295-4cac-acee-cc85710708f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:14.660561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689162c-f295-4cac-acee-cc85710708f7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:14.665931 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545890a-a1c0-47db-b2b6-96169d084269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:14.666918 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545890a-a1c0-47db-b2b6-96169d084269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:14.667203 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545890a-a1c0-47db-b2b6-96169d084269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:14.667483 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545890a-a1c0-47db-b2b6-96169d084269 admin admin] PATH_INFO: `/v3/projects/7b5ed4e805284237a085f5e0dbf99ba8/users/d3f0661842d74ad2bbfc4c90f9bb8fe2/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:14.668039 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-56746399-546a-46a2-9c70-dde04f136a34 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:14.669548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-56746399-546a-46a2-9c70-dde04f136a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:14.680104 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1335/2695] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:14.684786 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56746399-546a-46a2-9c70-dde04f136a34 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:14.687071 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545890a-a1c0-47db-b2b6-96169d084269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5ed4e805284237a085f5e0dbf99ba8, user_id=d3f0661842d74ad2bbfc4c90f9bb8fe2, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:14.690470 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545890a-a1c0-47db-b2b6-96169d084269 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:14.698094 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56746399-546a-46a2-9c70-dde04f136a34 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:14.705516 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e8abe-c104-4d8b-9d3c-62bd38ad54a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:14.706551 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e8abe-c104-4d8b-9d3c-62bd38ad54a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:14.707044 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e8abe-c104-4d8b-9d3c-62bd38ad54a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:14.707521 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e8abe-c104-4d8b-9d3c-62bd38ad54a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:14.708663 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e8abe-c104-4d8b-9d3c-62bd38ad54a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:33:14.709251 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e8abe-c104-4d8b-9d3c-62bd38ad54a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:14.711298 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e8abe-c104-4d8b-9d3c-62bd38ad54a0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:14.720954 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1361/2696] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:14 2022] PUT /identity/v3/projects/7b5ed4e805284237a085f5e0dbf99ba8/users/d3f0661842d74ad2bbfc4c90f9bb8fe2/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:33:14.727491 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51fce2-b0fb-4a54-aa81-2478c0660013 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:14.727960 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51fce2-b0fb-4a54-aa81-2478c0660013 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:14.728419 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51fce2-b0fb-4a54-aa81-2478c0660013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:14.749625 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1336/2697] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:33:14.751663 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e8abe-c104-4d8b-9d3c-62bd38ad54a0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:14.768744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e8abe-c104-4d8b-9d3c-62bd38ad54a0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:14.780717 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0f51fce2-b0fb-4a54-aa81-2478c0660013 None None] MFA Rules not processed for user `d3f0661842d74ad2bbfc4c90f9bb8fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:14.782987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0f51fce2-b0fb-4a54-aa81-2478c0660013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:14.833712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:14.867958 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:14.876311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19260f7-b19c-4b78-ac2c-e641359cf21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:14.877582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19260f7-b19c-4b78-ac2c-e641359cf21e admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:14.877989 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19260f7-b19c-4b78-ac2c-e641359cf21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:14.878436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19260f7-b19c-4b78-ac2c-e641359cf21e admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:14.881204 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19260f7-b19c-4b78-ac2c-e641359cf21e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:14.883424 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19260f7-b19c-4b78-ac2c-e641359cf21e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:14.904999 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1362/2698] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:33:14.920103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1337/2699] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:14 2022] POST /identity/v3/projects => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:33:14.920544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51fce2-b0fb-4a54-aa81-2478c0660013 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:14.923878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0f51fce2-b0fb-4a54-aa81-2478c0660013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:14.926370 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19260f7-b19c-4b78-ac2c-e641359cf21e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:15.016858 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51fce2-b0fb-4a54-aa81-2478c0660013 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:15.028761 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19260f7-b19c-4b78-ac2c-e641359cf21e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:15.038976 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485fb20-14fc-4cba-9c9c-f8941d6bee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:15.040428 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485fb20-14fc-4cba-9c9c-f8941d6bee56 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:15.040724 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485fb20-14fc-4cba-9c9c-f8941d6bee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:15.041200 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485fb20-14fc-4cba-9c9c-f8941d6bee56 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:15.042105 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485fb20-14fc-4cba-9c9c-f8941d6bee56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:15.044340 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485fb20-14fc-4cba-9c9c-f8941d6bee56 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:15.083124 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1338/2700] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:14 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:33:15.085511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485fb20-14fc-4cba-9c9c-f8941d6bee56 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:15.105612 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b5723-73f0-4fd7-84ca-b4775e6780d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:15.106431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b5723-73f0-4fd7-84ca-b4775e6780d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:15.106781 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b5723-73f0-4fd7-84ca-b4775e6780d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:15.107121 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b5723-73f0-4fd7-84ca-b4775e6780d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:15.107490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485fb20-14fc-4cba-9c9c-f8941d6bee56 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:15.119924 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee833af2-e41b-4ccd-9628-22a448ef01cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:15.126293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee833af2-e41b-4ccd-9628-22a448ef01cc admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:15.126293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee833af2-e41b-4ccd-9628-22a448ef01cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:15.126293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee833af2-e41b-4ccd-9628-22a448ef01cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:15.126293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee833af2-e41b-4ccd-9628-22a448ef01cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:15.128429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee833af2-e41b-4ccd-9628-22a448ef01cc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:15.150324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1339/2701] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:15.158125 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee833af2-e41b-4ccd-9628-22a448ef01cc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:15.177091 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee833af2-e41b-4ccd-9628-22a448ef01cc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:15.187327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d3440-f7d8-43fa-9746-594c23749e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:15.188960 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3440-f7d8-43fa-9746-594c23749e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:15.189419 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3440-f7d8-43fa-9746-594c23749e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:15.190158 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3440-f7d8-43fa-9746-594c23749e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:15.191745 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d3440-f7d8-43fa-9746-594c23749e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:15.195183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d3440-f7d8-43fa-9746-594c23749e64 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:15.248001 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1340/2702] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:15.250095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d3440-f7d8-43fa-9746-594c23749e64 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:15.275491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d3440-f7d8-43fa-9746-594c23749e64 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:15.284168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0b048-fa9c-4cfc-8089-fefe8571eeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:15.285731 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0b048-fa9c-4cfc-8089-fefe8571eeb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:15.286313 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0b048-fa9c-4cfc-8089-fefe8571eeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:15.287450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0b048-fa9c-4cfc-8089-fefe8571eeb0 admin admin] PATH_INFO: `/v3/projects/86b80b2e68c9463ab7f96fb0bfbc2cd2/users/d84f450e9484442e981b22b25a095356/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:15.291511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b5723-73f0-4fd7-84ca-b4775e6780d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:15.293438 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b5723-73f0-4fd7-84ca-b4775e6780d6 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:15.308000 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1363/2703] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:33:15.315647 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0b048-fa9c-4cfc-8089-fefe8571eeb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b80b2e68c9463ab7f96fb0bfbc2cd2, user_id=d84f450e9484442e981b22b25a095356, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:15.318997 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0b048-fa9c-4cfc-8089-fefe8571eeb0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:15.341476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1341/2704] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:15 2022] PUT /identity/v3/projects/86b80b2e68c9463ab7f96fb0bfbc2cd2/users/d84f450e9484442e981b22b25a095356/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:15.361519 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e83e9-595e-4fc9-9b87-454ab3d72a88 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:15.361810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e83e9-595e-4fc9-9b87-454ab3d72a88 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:15.362080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e83e9-595e-4fc9-9b87-454ab3d72a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:15.395994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e83e83e9-595e-4fc9-9b87-454ab3d72a88 None None] MFA Rules not processed for user `d84f450e9484442e981b22b25a095356`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:15.397231 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e83e83e9-595e-4fc9-9b87-454ab3d72a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:15.485891 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:15.520602 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1364/2705] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:15.538834 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0b048-fa9c-4cfc-8089-fefe8571eeb0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:15.541713 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bee0b048-fa9c-4cfc-8089-fefe8571eeb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:15.633201 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0b048-fa9c-4cfc-8089-fefe8571eeb0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:15.638441 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75c825-ba5f-4fdf-83e4-9ebbe89caf53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:15.639407 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75c825-ba5f-4fdf-83e4-9ebbe89caf53 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:15.639986 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75c825-ba5f-4fdf-83e4-9ebbe89caf53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:15.640320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75c825-ba5f-4fdf-83e4-9ebbe89caf53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:15.653845 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75c825-ba5f-4fdf-83e4-9ebbe89caf53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:15.656248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75c825-ba5f-4fdf-83e4-9ebbe89caf53 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:15.671269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1342/2706] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:16.396343 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e83e9-595e-4fc9-9b87-454ab3d72a88 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:16.413638 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e83e9-595e-4fc9-9b87-454ab3d72a88 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:16.420188 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227a678-b5c5-4d61-ae02-9fa48c992547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:16.421266 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227a678-b5c5-4d61-ae02-9fa48c992547 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:16.421747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227a678-b5c5-4d61-ae02-9fa48c992547 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:16.422243 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227a678-b5c5-4d61-ae02-9fa48c992547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:16.425240 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d227a678-b5c5-4d61-ae02-9fa48c992547 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:16.508361 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227a678-b5c5-4d61-ae02-9fa48c992547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:16.509980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227a678-b5c5-4d61-ae02-9fa48c992547 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:16.521836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1365/2707] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:18.746204 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75c825-ba5f-4fdf-83e4-9ebbe89caf53 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:18.765653 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:18.831978 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75c825-ba5f-4fdf-83e4-9ebbe89caf53 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:18.836904 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb69a7-d779-4183-8a26-20a2eb6accb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:18.837820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb69a7-d779-4183-8a26-20a2eb6accb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:18.838115 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb69a7-d779-4183-8a26-20a2eb6accb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:18.838431 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb69a7-d779-4183-8a26-20a2eb6accb6 admin admin] PATH_INFO: `/v3/users/d3f0661842d74ad2bbfc4c90f9bb8fe2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:18.840033 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb69a7-d779-4183-8a26-20a2eb6accb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f0661842d74ad2bbfc4c90f9bb8fe2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:18.842063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb69a7-d779-4183-8a26-20a2eb6accb6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:18.924939 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-99bb69a7-d779-4183-8a26-20a2eb6accb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f0661842d74ad2bbfc4c90f9bb8fe2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:18.939795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-99bb69a7-d779-4183-8a26-20a2eb6accb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f0661842d74ad2bbfc4c90f9bb8fe2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:18.953723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-99bb69a7-d779-4183-8a26-20a2eb6accb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f0661842d74ad2bbfc4c90f9bb8fe2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:18.954746 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-99bb69a7-d779-4183-8a26-20a2eb6accb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f0661842d74ad2bbfc4c90f9bb8fe2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:18.971067 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-99bb69a7-d779-4183-8a26-20a2eb6accb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f0661842d74ad2bbfc4c90f9bb8fe2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:18.983572 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1343/2708] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:18 2022] DELETE /identity/v3/users/d3f0661842d74ad2bbfc4c90f9bb8fe2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:18.991550 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec084fd6-d5aa-473d-a5d6-07a8f35070a7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:18.992031 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec084fd6-d5aa-473d-a5d6-07a8f35070a7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:18.992252 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec084fd6-d5aa-473d-a5d6-07a8f35070a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:19.017425 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ec084fd6-d5aa-473d-a5d6-07a8f35070a7 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:19.018772 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ec084fd6-d5aa-473d-a5d6-07a8f35070a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:19.122070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1366/2709] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:19.138659 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb69a7-d779-4183-8a26-20a2eb6accb6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:19.141121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-99bb69a7-d779-4183-8a26-20a2eb6accb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:19.246788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb69a7-d779-4183-8a26-20a2eb6accb6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:19.258006 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9257fb-eb90-498f-aa29-5de447377a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:19.258796 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9257fb-eb90-498f-aa29-5de447377a21 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:19.259145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9257fb-eb90-498f-aa29-5de447377a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:19.259546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9257fb-eb90-498f-aa29-5de447377a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:19.272355 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9257fb-eb90-498f-aa29-5de447377a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:19.273762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9257fb-eb90-498f-aa29-5de447377a21 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:19.286729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1344/2710] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:19.646646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec084fd6-d5aa-473d-a5d6-07a8f35070a7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:19.649080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ec084fd6-d5aa-473d-a5d6-07a8f35070a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:19.666249 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec084fd6-d5aa-473d-a5d6-07a8f35070a7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:19.671808 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb869ee8-5161-4a2f-996b-2cb54518a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:19.672718 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb869ee8-5161-4a2f-996b-2cb54518a8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:19.673007 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb869ee8-5161-4a2f-996b-2cb54518a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:19.673326 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb869ee8-5161-4a2f-996b-2cb54518a8a5 admin admin] PATH_INFO: `/v3/projects/7b5ed4e805284237a085f5e0dbf99ba8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:19.674953 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb869ee8-5161-4a2f-996b-2cb54518a8a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b5ed4e805284237a085f5e0dbf99ba8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:19.677011 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb869ee8-5161-4a2f-996b-2cb54518a8a5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:19.729388 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb869ee8-5161-4a2f-996b-2cb54518a8a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b5ed4e805284237a085f5e0dbf99ba8', 'request_id': 'req-bb869ee8-5161-4a2f-996b-2cb54518a8a5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:19.735787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb869ee8-5161-4a2f-996b-2cb54518a8a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b5ed4e805284237a085f5e0dbf99ba8', 'request_id': 'req-bb869ee8-5161-4a2f-996b-2cb54518a8a5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:19.742412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb869ee8-5161-4a2f-996b-2cb54518a8a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b5ed4e805284237a085f5e0dbf99ba8', 'request_id': 'req-bb869ee8-5161-4a2f-996b-2cb54518a8a5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:19.758829 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb869ee8-5161-4a2f-996b-2cb54518a8a5 admin admin] The token cache is being invalidate because project 7b5ed4e805284237a085f5e0dbf99ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:19.759114 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb869ee8-5161-4a2f-996b-2cb54518a8a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:19.759722 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb869ee8-5161-4a2f-996b-2cb54518a8a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:19.761307 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1367/2711] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:19 2022] DELETE /identity/v3/projects/7b5ed4e805284237a085f5e0dbf99ba8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:19.767329 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba1eb6-b8b3-4e40-a880-e1bb79ce8b18 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:19.767912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba1eb6-b8b3-4e40-a880-e1bb79ce8b18 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:19.767912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba1eb6-b8b3-4e40-a880-e1bb79ce8b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:19.792402 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-deba1eb6-b8b3-4e40-a880-e1bb79ce8b18 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:19.793729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-deba1eb6-b8b3-4e40-a880-e1bb79ce8b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:19.824806 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:19.873922 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1345/2712] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:19.882972 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0b39a-de47-4142-a519-9627984abb3f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:19.883412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0b39a-de47-4142-a519-9627984abb3f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:19.883795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0b39a-de47-4142-a519-9627984abb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:19.911597 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-47d0b39a-de47-4142-a519-9627984abb3f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:19.913940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-47d0b39a-de47-4142-a519-9627984abb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:19.927853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1368/2713] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:33:19.934592 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba1eb6-b8b3-4e40-a880-e1bb79ce8b18 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:19.950127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba1eb6-b8b3-4e40-a880-e1bb79ce8b18 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:19.957768 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb3e26-c9fe-4445-8141-3ff9a316a879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:19.958959 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb3e26-c9fe-4445-8141-3ff9a316a879 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:19.959457 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb3e26-c9fe-4445-8141-3ff9a316a879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:19.959979 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb3e26-c9fe-4445-8141-3ff9a316a879 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:19.961502 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb3e26-c9fe-4445-8141-3ff9a316a879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:33:19.962041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb3e26-c9fe-4445-8141-3ff9a316a879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:19.964703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb3e26-c9fe-4445-8141-3ff9a316a879 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:19.988577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1346/2714] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:33:19.993953 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0b39a-de47-4142-a519-9627984abb3f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:19.999416 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:20.007493 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0b39a-de47-4142-a519-9627984abb3f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:20.014319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bddb9-949c-40f2-abba-8d324bf3eb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:20.015151 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bddb9-949c-40f2-abba-8d324bf3eb9c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:20.015870 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bddb9-949c-40f2-abba-8d324bf3eb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:20.015870 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bddb9-949c-40f2-abba-8d324bf3eb9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:20.016386 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bddb9-949c-40f2-abba-8d324bf3eb9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:20.018629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bddb9-949c-40f2-abba-8d324bf3eb9c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:20.050724 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1369/2715] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:19 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:20.055268 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb3e26-c9fe-4445-8141-3ff9a316a879 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:20.070031 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb3e26-c9fe-4445-8141-3ff9a316a879 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:20.172159 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8ba7f-48ce-42c7-b9dd-ae5cc0b9da5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:20.173362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8ba7f-48ce-42c7-b9dd-ae5cc0b9da5a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:20.173874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8ba7f-48ce-42c7-b9dd-ae5cc0b9da5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:20.174479 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8ba7f-48ce-42c7-b9dd-ae5cc0b9da5a admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:20.175908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8ba7f-48ce-42c7-b9dd-ae5cc0b9da5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:20.179762 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8ba7f-48ce-42c7-b9dd-ae5cc0b9da5a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:20.212893 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1347/2716] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:20 2022] POST /identity/v3/users => generated 284 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:20.218526 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bddb9-949c-40f2-abba-8d324bf3eb9c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:20.231560 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bddb9-949c-40f2-abba-8d324bf3eb9c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:20.238149 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda5957-fd84-47e0-9572-f572c0b158a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:20.238923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda5957-fd84-47e0-9572-f572c0b158a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:20.239215 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda5957-fd84-47e0-9572-f572c0b158a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:20.239498 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda5957-fd84-47e0-9572-f572c0b158a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:20.240276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda5957-fd84-47e0-9572-f572c0b158a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:20.242322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda5957-fd84-47e0-9572-f572c0b158a3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:20.255365 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1370/2717] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:20.260178 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8ba7f-48ce-42c7-b9dd-ae5cc0b9da5a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:20.277185 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8ba7f-48ce-42c7-b9dd-ae5cc0b9da5a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:20.281436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741fa33-d12d-4bb6-97ab-85219c66274a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:20.282242 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741fa33-d12d-4bb6-97ab-85219c66274a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:20.282605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741fa33-d12d-4bb6-97ab-85219c66274a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:20.282952 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741fa33-d12d-4bb6-97ab-85219c66274a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:20.284042 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741fa33-d12d-4bb6-97ab-85219c66274a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:20.285747 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741fa33-d12d-4bb6-97ab-85219c66274a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:20.309718 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1348/2718] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:20.311369 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda5957-fd84-47e0-9572-f572c0b158a3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:20.323281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda5957-fd84-47e0-9572-f572c0b158a3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:20.328879 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfee14e-ab83-47fd-8467-da07482bb7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:20.330007 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfee14e-ab83-47fd-8467-da07482bb7d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:20.330331 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfee14e-ab83-47fd-8467-da07482bb7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:20.331289 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfee14e-ab83-47fd-8467-da07482bb7d2 admin admin] PATH_INFO: `/v3/projects/b6f5679dc1134e829925a871326a205e/users/e9e4566b68e74ee99c6f8668403cc388/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:20.350380 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfee14e-ab83-47fd-8467-da07482bb7d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f5679dc1134e829925a871326a205e, user_id=e9e4566b68e74ee99c6f8668403cc388, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:20.353333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfee14e-ab83-47fd-8467-da07482bb7d2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:20.369915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1371/2719] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:20 2022] PUT /identity/v3/projects/b6f5679dc1134e829925a871326a205e/users/e9e4566b68e74ee99c6f8668403cc388/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:33:20.382604 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274bdbd-b9e5-42ce-8bfb-aa5ec5d265f3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:20.382978 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274bdbd-b9e5-42ce-8bfb-aa5ec5d265f3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:20.383350 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274bdbd-b9e5-42ce-8bfb-aa5ec5d265f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:20.429135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7274bdbd-b9e5-42ce-8bfb-aa5ec5d265f3 None None] MFA Rules not processed for user `e9e4566b68e74ee99c6f8668403cc388`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:20.434639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7274bdbd-b9e5-42ce-8bfb-aa5ec5d265f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:20.537687 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1349/2720] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:33:20.560702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfee14e-ab83-47fd-8467-da07482bb7d2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:20.562789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4cfee14e-ab83-47fd-8467-da07482bb7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:20.662669 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfee14e-ab83-47fd-8467-da07482bb7d2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:20.667352 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb053e-1ca8-4ed6-8fb3-708a9f8ab479 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f18acfb35dfe41a1aeb50c702bd1942b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:20.668033 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb053e-1ca8-4ed6-8fb3-708a9f8ab479 service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:20.668615 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb053e-1ca8-4ed6-8fb3-708a9f8ab479 service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:20.668904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb053e-1ca8-4ed6-8fb3-708a9f8ab479 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:20.679654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb053e-1ca8-4ed6-8fb3-708a9f8ab479 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:20.683114 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb053e-1ca8-4ed6-8fb3-708a9f8ab479 service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:20.695655 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1372/2721] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:21.713390 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274bdbd-b9e5-42ce-8bfb-aa5ec5d265f3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:21.717337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7274bdbd-b9e5-42ce-8bfb-aa5ec5d265f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:21.775788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:21.818287 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274bdbd-b9e5-42ce-8bfb-aa5ec5d265f3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:21.823301 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515759c-4918-4fe8-b711-8884df5fe531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:21.824256 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515759c-4918-4fe8-b711-8884df5fe531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:21.824550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515759c-4918-4fe8-b711-8884df5fe531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:21.824836 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515759c-4918-4fe8-b711-8884df5fe531 admin admin] PATH_INFO: `/v3/users/2cc7f2da58e34dc9bf4964b91e6087fd` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:21.826121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515759c-4918-4fe8-b711-8884df5fe531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cc7f2da58e34dc9bf4964b91e6087fd)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:21.828357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515759c-4918-4fe8-b711-8884df5fe531 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:21.885012 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1515759c-4918-4fe8-b711-8884df5fe531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cc7f2da58e34dc9bf4964b91e6087fd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:21.897834 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1515759c-4918-4fe8-b711-8884df5fe531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cc7f2da58e34dc9bf4964b91e6087fd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:21.911309 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1515759c-4918-4fe8-b711-8884df5fe531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cc7f2da58e34dc9bf4964b91e6087fd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:21.912318 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1515759c-4918-4fe8-b711-8884df5fe531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cc7f2da58e34dc9bf4964b91e6087fd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:21.932208 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1515759c-4918-4fe8-b711-8884df5fe531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cc7f2da58e34dc9bf4964b91e6087fd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:21.940075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1350/2722] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:21 2022] DELETE /identity/v3/users/2cc7f2da58e34dc9bf4964b91e6087fd => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:21.945162 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fdae8-355a-4192-8ea6-a0c5126198cf None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:21.945751 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fdae8-355a-4192-8ea6-a0c5126198cf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:21.945751 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fdae8-355a-4192-8ea6-a0c5126198cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:21.967941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b24fdae8-355a-4192-8ea6-a0c5126198cf None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:21.969216 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b24fdae8-355a-4192-8ea6-a0c5126198cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:22.053545 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1373/2723] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:33:22.071090 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515759c-4918-4fe8-b711-8884df5fe531 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:22.074141 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1515759c-4918-4fe8-b711-8884df5fe531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:22.170995 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515759c-4918-4fe8-b711-8884df5fe531 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:22.176955 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e32079-6739-4238-a679-93fd46209fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:22.177961 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e32079-6739-4238-a679-93fd46209fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:22.178711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e32079-6739-4238-a679-93fd46209fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:22.179166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e32079-6739-4238-a679-93fd46209fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:22.195255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e32079-6739-4238-a679-93fd46209fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:22.198041 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e32079-6739-4238-a679-93fd46209fa8 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:22.214922 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1351/2724] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:22.578798 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fdae8-355a-4192-8ea6-a0c5126198cf None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:22.580411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b24fdae8-355a-4192-8ea6-a0c5126198cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:22.597370 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fdae8-355a-4192-8ea6-a0c5126198cf None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:22.603124 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f743f-278e-43af-800c-ed6658fc062d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:22.604199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f743f-278e-43af-800c-ed6658fc062d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:22.604654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f743f-278e-43af-800c-ed6658fc062d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:22.604932 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f743f-278e-43af-800c-ed6658fc062d admin admin] PATH_INFO: `/v3/projects/ad2d25d0027a40938de5220a7bfd0951` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:22.606301 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f743f-278e-43af-800c-ed6658fc062d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2d25d0027a40938de5220a7bfd0951)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:22.608396 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f743f-278e-43af-800c-ed6658fc062d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:22.682789 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:22.688275 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ce6f743f-278e-43af-800c-ed6658fc062d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2d25d0027a40938de5220a7bfd0951', 'request_id': 'req-ce6f743f-278e-43af-800c-ed6658fc062d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:22.696005 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ce6f743f-278e-43af-800c-ed6658fc062d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2d25d0027a40938de5220a7bfd0951', 'request_id': 'req-ce6f743f-278e-43af-800c-ed6658fc062d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:22.705131 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ce6f743f-278e-43af-800c-ed6658fc062d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2d25d0027a40938de5220a7bfd0951', 'request_id': 'req-ce6f743f-278e-43af-800c-ed6658fc062d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:22.720604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ce6f743f-278e-43af-800c-ed6658fc062d admin admin] The token cache is being invalidate because project ad2d25d0027a40938de5220a7bfd0951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:22.720904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ce6f743f-278e-43af-800c-ed6658fc062d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:22.721584 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ce6f743f-278e-43af-800c-ed6658fc062d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:22.723279 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1374/2725] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:22 2022] DELETE /identity/v3/projects/ad2d25d0027a40938de5220a7bfd0951 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:33:22.728057 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e32079-6739-4238-a679-93fd46209fa8 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:22.739096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e32079-6739-4238-a679-93fd46209fa8 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:22.801839 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:22.820321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815865c-aa7b-4978-87a5-9979ec66afa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:22.822085 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815865c-aa7b-4978-87a5-9979ec66afa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:22.822769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815865c-aa7b-4978-87a5-9979ec66afa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:22.823109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815865c-aa7b-4978-87a5-9979ec66afa1 admin admin] PATH_INFO: `/v3/users/8168b7ac377947b5b99a33ae0e0e362a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:22.825059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815865c-aa7b-4978-87a5-9979ec66afa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8168b7ac377947b5b99a33ae0e0e362a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:22.828210 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815865c-aa7b-4978-87a5-9979ec66afa1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:22.885480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a815865c-aa7b-4978-87a5-9979ec66afa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8168b7ac377947b5b99a33ae0e0e362a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:22.896966 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a815865c-aa7b-4978-87a5-9979ec66afa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8168b7ac377947b5b99a33ae0e0e362a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:22.907449 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a815865c-aa7b-4978-87a5-9979ec66afa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8168b7ac377947b5b99a33ae0e0e362a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:22.908160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a815865c-aa7b-4978-87a5-9979ec66afa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8168b7ac377947b5b99a33ae0e0e362a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:22.924491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a815865c-aa7b-4978-87a5-9979ec66afa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8168b7ac377947b5b99a33ae0e0e362a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:22.931945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1352/2726] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:22 2022] DELETE /identity/v3/users/8168b7ac377947b5b99a33ae0e0e362a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:23.304318 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f743f-278e-43af-800c-ed6658fc062d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:23.306104 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ce6f743f-278e-43af-800c-ed6658fc062d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:23.321092 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f743f-278e-43af-800c-ed6658fc062d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:23.404793 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad31995-dd29-45ff-b825-1effe97d1b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:23.406045 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad31995-dd29-45ff-b825-1effe97d1b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:23.406443 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad31995-dd29-45ff-b825-1effe97d1b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:23.406765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad31995-dd29-45ff-b825-1effe97d1b83 admin admin] PATH_INFO: `/v3/projects/60eb4f716b94422eab2834b5890d378f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:23.408336 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad31995-dd29-45ff-b825-1effe97d1b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60eb4f716b94422eab2834b5890d378f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:23.410450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad31995-dd29-45ff-b825-1effe97d1b83 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:23.493242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2ad31995-dd29-45ff-b825-1effe97d1b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60eb4f716b94422eab2834b5890d378f', 'request_id': 'req-2ad31995-dd29-45ff-b825-1effe97d1b83'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:23.499900 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2ad31995-dd29-45ff-b825-1effe97d1b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60eb4f716b94422eab2834b5890d378f', 'request_id': 'req-2ad31995-dd29-45ff-b825-1effe97d1b83'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:23.506979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2ad31995-dd29-45ff-b825-1effe97d1b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60eb4f716b94422eab2834b5890d378f', 'request_id': 'req-2ad31995-dd29-45ff-b825-1effe97d1b83'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:23.522546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2ad31995-dd29-45ff-b825-1effe97d1b83 admin admin] The token cache is being invalidate because project 60eb4f716b94422eab2834b5890d378f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:23.522936 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2ad31995-dd29-45ff-b825-1effe97d1b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:23.523999 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2ad31995-dd29-45ff-b825-1effe97d1b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:23.526673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1375/2727] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:23 2022] DELETE /identity/v3/projects/60eb4f716b94422eab2834b5890d378f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:23.536658 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2476a-f6bd-419a-a7f2-487ec455cd83 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:23.537089 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2476a-f6bd-419a-a7f2-487ec455cd83 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:23.537559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2476a-f6bd-419a-a7f2-487ec455cd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:23.558194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9ab2476a-f6bd-419a-a7f2-487ec455cd83 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:23.559605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9ab2476a-f6bd-419a-a7f2-487ec455cd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:23.641253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1353/2728] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:23.650169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3908a87-881a-4426-99d0-3920ff544675 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:23.650481 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3908a87-881a-4426-99d0-3920ff544675 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:23.650777 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3908a87-881a-4426-99d0-3920ff544675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:23.672567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b3908a87-881a-4426-99d0-3920ff544675 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:23.673804 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b3908a87-881a-4426-99d0-3920ff544675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:23.682281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1376/2729] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:23.686843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2476a-f6bd-419a-a7f2-487ec455cd83 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:23.697869 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2476a-f6bd-419a-a7f2-487ec455cd83 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:23.708516 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f2c5b-1a8f-4485-9597-509f8b2e8f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:23.708516 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f2c5b-1a8f-4485-9597-509f8b2e8f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:23.708516 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f2c5b-1a8f-4485-9597-509f8b2e8f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:23.708516 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f2c5b-1a8f-4485-9597-509f8b2e8f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:23.709053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f2c5b-1a8f-4485-9597-509f8b2e8f39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:33:23.709053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f2c5b-1a8f-4485-9597-509f8b2e8f39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:23.710010 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f2c5b-1a8f-4485-9597-509f8b2e8f39 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:23.724550 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1354/2730] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:33:23.729758 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3908a87-881a-4426-99d0-3920ff544675 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:23.740989 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3908a87-881a-4426-99d0-3920ff544675 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:23.746340 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877d15a-567d-4dc5-a07a-b8aa78d8e701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:23.747028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877d15a-567d-4dc5-a07a-b8aa78d8e701 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:23.747341 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877d15a-567d-4dc5-a07a-b8aa78d8e701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:23.747629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877d15a-567d-4dc5-a07a-b8aa78d8e701 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:23.748484 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877d15a-567d-4dc5-a07a-b8aa78d8e701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:23.750877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877d15a-567d-4dc5-a07a-b8aa78d8e701 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:23.802456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1377/2731] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:23 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:23.808047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f2c5b-1a8f-4485-9597-509f8b2e8f39 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:23.822272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f2c5b-1a8f-4485-9597-509f8b2e8f39 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:23.890362 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:23.899307 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e78bbc-b162-4378-be42-68685692d7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:23.900252 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e78bbc-b162-4378-be42-68685692d7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:23.901043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e78bbc-b162-4378-be42-68685692d7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:23.901518 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e78bbc-b162-4378-be42-68685692d7a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:23.902304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e78bbc-b162-4378-be42-68685692d7a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:23.904291 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e78bbc-b162-4378-be42-68685692d7a5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:23.931389 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1355/2732] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:23 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:33:23.932747 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877d15a-567d-4dc5-a07a-b8aa78d8e701 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:23.944474 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877d15a-567d-4dc5-a07a-b8aa78d8e701 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:23.949708 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa83da-3779-41c9-a1f1-76be510d9a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:23.950363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa83da-3779-41c9-a1f1-76be510d9a41 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:23.950656 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa83da-3779-41c9-a1f1-76be510d9a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:23.950934 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa83da-3779-41c9-a1f1-76be510d9a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:23.951680 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa83da-3779-41c9-a1f1-76be510d9a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:23.953355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa83da-3779-41c9-a1f1-76be510d9a41 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:23.965374 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1378/2733] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:23.971057 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e78bbc-b162-4378-be42-68685692d7a5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:23.984561 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e78bbc-b162-4378-be42-68685692d7a5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:23.992637 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126deb4-c0df-49a5-ab1f-284b102146aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:23.993810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126deb4-c0df-49a5-ab1f-284b102146aa admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:23.994354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126deb4-c0df-49a5-ab1f-284b102146aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:23.994831 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126deb4-c0df-49a5-ab1f-284b102146aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:23.996228 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126deb4-c0df-49a5-ab1f-284b102146aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:23.998755 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126deb4-c0df-49a5-ab1f-284b102146aa admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:24.010259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1356/2734] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:24.015876 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa83da-3779-41c9-a1f1-76be510d9a41 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:24.028342 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa83da-3779-41c9-a1f1-76be510d9a41 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:24.035861 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5b548-094d-4ce9-ac35-a892b831db79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:24.037244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5b548-094d-4ce9-ac35-a892b831db79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:24.037601 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5b548-094d-4ce9-ac35-a892b831db79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:24.037950 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5b548-094d-4ce9-ac35-a892b831db79 admin admin] PATH_INFO: `/v3/projects/293c77fce4704ccebb62e70722cae7e7/users/d9576b1b7e654e2ba294e4404e9218ef/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:24.056390 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5b548-094d-4ce9-ac35-a892b831db79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=293c77fce4704ccebb62e70722cae7e7, user_id=d9576b1b7e654e2ba294e4404e9218ef, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:24.059120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5b548-094d-4ce9-ac35-a892b831db79 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:24.069542 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:24.078245 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1379/2735] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:24 2022] PUT /identity/v3/projects/293c77fce4704ccebb62e70722cae7e7/users/d9576b1b7e654e2ba294e4404e9218ef/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:24.092200 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33802fa8-9a16-4fb9-9bff-7f897c2dcdbf None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:24.092491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33802fa8-9a16-4fb9-9bff-7f897c2dcdbf None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:24.092769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33802fa8-9a16-4fb9-9bff-7f897c2dcdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:24.124495 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-33802fa8-9a16-4fb9-9bff-7f897c2dcdbf None None] MFA Rules not processed for user `d9576b1b7e654e2ba294e4404e9218ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:24.126829 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-33802fa8-9a16-4fb9-9bff-7f897c2dcdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:24.210439 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1357/2736] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:24.229507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5b548-094d-4ce9-ac35-a892b831db79 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:24.231717 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-89f5b548-094d-4ce9-ac35-a892b831db79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:24.301749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5b548-094d-4ce9-ac35-a892b831db79 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:24.305811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd0368-a3bc-4ceb-8b69-f6c6d5f5257d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:24.306695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0368-a3bc-4ceb-8b69-f6c6d5f5257d service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:24.306800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0368-a3bc-4ceb-8b69-f6c6d5f5257d service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:24.307084 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0368-a3bc-4ceb-8b69-f6c6d5f5257d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:24.317740 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd0368-a3bc-4ceb-8b69-f6c6d5f5257d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:24.319524 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd0368-a3bc-4ceb-8b69-f6c6d5f5257d service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:24.331652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1380/2737] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:24.359869 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33802fa8-9a16-4fb9-9bff-7f897c2dcdbf None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:24.432597 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33802fa8-9a16-4fb9-9bff-7f897c2dcdbf None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:24.438537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2357fb9-bb26-4105-8068-c391edb65fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:24.439486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2357fb9-bb26-4105-8068-c391edb65fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:24.439774 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2357fb9-bb26-4105-8068-c391edb65fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:24.440056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2357fb9-bb26-4105-8068-c391edb65fdf admin admin] PATH_INFO: `/v3/users/d9576b1b7e654e2ba294e4404e9218ef` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:24.441489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2357fb9-bb26-4105-8068-c391edb65fdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9576b1b7e654e2ba294e4404e9218ef)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:24.443529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2357fb9-bb26-4105-8068-c391edb65fdf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:24.513549 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a2357fb9-bb26-4105-8068-c391edb65fdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9576b1b7e654e2ba294e4404e9218ef'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:24.531285 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a2357fb9-bb26-4105-8068-c391edb65fdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9576b1b7e654e2ba294e4404e9218ef'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:24.544049 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a2357fb9-bb26-4105-8068-c391edb65fdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9576b1b7e654e2ba294e4404e9218ef'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:24.544818 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a2357fb9-bb26-4105-8068-c391edb65fdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9576b1b7e654e2ba294e4404e9218ef'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:24.557062 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:24.572365 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a2357fb9-bb26-4105-8068-c391edb65fdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9576b1b7e654e2ba294e4404e9218ef'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:24.579434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1358/2738] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:24 2022] DELETE /identity/v3/users/d9576b1b7e654e2ba294e4404e9218ef => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:24.585446 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa0117-4488-4d29-ab00-6867666795c4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:24.585962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa0117-4488-4d29-ab00-6867666795c4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:24.586977 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa0117-4488-4d29-ab00-6867666795c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:24.608331 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-61fa0117-4488-4d29-ab00-6867666795c4 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:24.609740 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-61fa0117-4488-4d29-ab00-6867666795c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:24.683487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1381/2739] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:24.695645 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2357fb9-bb26-4105-8068-c391edb65fdf admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:24.697341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a2357fb9-bb26-4105-8068-c391edb65fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:24.770787 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2357fb9-bb26-4105-8068-c391edb65fdf admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:24.775827 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5131893-d6ca-4e4b-838c-02ad5077b519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:24.776994 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5131893-d6ca-4e4b-838c-02ad5077b519 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:24.777474 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5131893-d6ca-4e4b-838c-02ad5077b519 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:24.777972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5131893-d6ca-4e4b-838c-02ad5077b519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:24.795424 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5131893-d6ca-4e4b-838c-02ad5077b519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:24.797590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5131893-d6ca-4e4b-838c-02ad5077b519 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:24.809384 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1359/2740] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:24.901448 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa0117-4488-4d29-ab00-6867666795c4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:24.903273 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-61fa0117-4488-4d29-ab00-6867666795c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:24.932942 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa0117-4488-4d29-ab00-6867666795c4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:24.942251 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21137ef-89e2-4703-b23c-8a297f023f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:24.943629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21137ef-89e2-4703-b23c-8a297f023f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:24.944123 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21137ef-89e2-4703-b23c-8a297f023f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:24.944609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21137ef-89e2-4703-b23c-8a297f023f87 admin admin] PATH_INFO: `/v3/users/d84f450e9484442e981b22b25a095356` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:24.947047 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21137ef-89e2-4703-b23c-8a297f023f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84f450e9484442e981b22b25a095356)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:24.950913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21137ef-89e2-4703-b23c-8a297f023f87 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:25.052617 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c21137ef-89e2-4703-b23c-8a297f023f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84f450e9484442e981b22b25a095356'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:25.062495 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c21137ef-89e2-4703-b23c-8a297f023f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84f450e9484442e981b22b25a095356'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:25.063363 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c21137ef-89e2-4703-b23c-8a297f023f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84f450e9484442e981b22b25a095356'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:25.063987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c21137ef-89e2-4703-b23c-8a297f023f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84f450e9484442e981b22b25a095356'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:25.081217 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c21137ef-89e2-4703-b23c-8a297f023f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84f450e9484442e981b22b25a095356'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:25.103518 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1382/2741] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:24 2022] DELETE /identity/v3/users/d84f450e9484442e981b22b25a095356 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:25.109113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b669ef-854a-4ca0-a1d0-2995c5957bc3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:25.109472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b669ef-854a-4ca0-a1d0-2995c5957bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:25.110051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b669ef-854a-4ca0-a1d0-2995c5957bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:25.151327 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c2b669ef-854a-4ca0-a1d0-2995c5957bc3 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:25.152713 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c2b669ef-854a-4ca0-a1d0-2995c5957bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:25.243998 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21137ef-89e2-4703-b23c-8a297f023f87 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:25.246083 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c21137ef-89e2-4703-b23c-8a297f023f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:25.281841 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1360/2742] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:25.283825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:25.300674 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b669ef-854a-4ca0-a1d0-2995c5957bc3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:25.303035 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c2b669ef-854a-4ca0-a1d0-2995c5957bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:25.375109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21137ef-89e2-4703-b23c-8a297f023f87 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:25.382210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6420b9-4b56-448e-9241-f4e2130e89a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:25.383471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6420b9-4b56-448e-9241-f4e2130e89a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:25.383912 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6420b9-4b56-448e-9241-f4e2130e89a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:25.384283 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6420b9-4b56-448e-9241-f4e2130e89a6 admin admin] PATH_INFO: `/v3/projects/293c77fce4704ccebb62e70722cae7e7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:25.386091 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6420b9-4b56-448e-9241-f4e2130e89a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=293c77fce4704ccebb62e70722cae7e7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:25.389515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6420b9-4b56-448e-9241-f4e2130e89a6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:25.399399 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b669ef-854a-4ca0-a1d0-2995c5957bc3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:25.404137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b8791-e876-4998-b3ea-75e54de60d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:25.404822 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b8791-e876-4998-b3ea-75e54de60d5d service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:25.405105 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b8791-e876-4998-b3ea-75e54de60d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:25.405464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b8791-e876-4998-b3ea-75e54de60d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:25.416914 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b8791-e876-4998-b3ea-75e54de60d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:25.418484 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b8791-e876-4998-b3ea-75e54de60d5d service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:25.430045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1361/2743] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:25.479209 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ef6420b9-4b56-448e-9241-f4e2130e89a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '293c77fce4704ccebb62e70722cae7e7', 'request_id': 'req-ef6420b9-4b56-448e-9241-f4e2130e89a6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:25.493014 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ef6420b9-4b56-448e-9241-f4e2130e89a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '293c77fce4704ccebb62e70722cae7e7', 'request_id': 'req-ef6420b9-4b56-448e-9241-f4e2130e89a6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:25.510498 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ef6420b9-4b56-448e-9241-f4e2130e89a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '293c77fce4704ccebb62e70722cae7e7', 'request_id': 'req-ef6420b9-4b56-448e-9241-f4e2130e89a6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:25.536300 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ef6420b9-4b56-448e-9241-f4e2130e89a6 admin admin] The token cache is being invalidate because project 293c77fce4704ccebb62e70722cae7e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:25.536721 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ef6420b9-4b56-448e-9241-f4e2130e89a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:25.537622 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ef6420b9-4b56-448e-9241-f4e2130e89a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:25.539875 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1383/2744] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:25 2022] DELETE /identity/v3/projects/293c77fce4704ccebb62e70722cae7e7 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:33:25.546181 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e7712-c0d5-4b72-91d6-80c097430b52 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:25.547195 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e7712-c0d5-4b72-91d6-80c097430b52 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:25.547195 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e7712-c0d5-4b72-91d6-80c097430b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:25.586654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b68e7712-c0d5-4b72-91d6-80c097430b52 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:25.586654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b68e7712-c0d5-4b72-91d6-80c097430b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:25.622907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:25.687993 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1362/2745] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:25.692913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac68c64-355c-404b-a567-24fe109a4a28 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:25.693537 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac68c64-355c-404b-a567-24fe109a4a28 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:25.694841 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac68c64-355c-404b-a567-24fe109a4a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:25.729989 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2ac68c64-355c-404b-a567-24fe109a4a28 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:25.732489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2ac68c64-355c-404b-a567-24fe109a4a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:25.743315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1384/2746] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:25.748624 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e7712-c0d5-4b72-91d6-80c097430b52 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:25.769668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e7712-c0d5-4b72-91d6-80c097430b52 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:25.776831 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281a8de-adb4-4ea9-87ab-a08afa876849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:25.777966 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281a8de-adb4-4ea9-87ab-a08afa876849 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:25.778450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281a8de-adb4-4ea9-87ab-a08afa876849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:25.779005 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281a8de-adb4-4ea9-87ab-a08afa876849 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:25.780247 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281a8de-adb4-4ea9-87ab-a08afa876849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:33:25.781387 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281a8de-adb4-4ea9-87ab-a08afa876849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:25.783408 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281a8de-adb4-4ea9-87ab-a08afa876849 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:25.807198 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1363/2747] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:33:25.812460 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac68c64-355c-404b-a567-24fe109a4a28 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:25.825616 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac68c64-355c-404b-a567-24fe109a4a28 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:25.832408 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc142d38-49cc-43f2-a46b-697a51fbd929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:25.833814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc142d38-49cc-43f2-a46b-697a51fbd929 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:25.834388 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc142d38-49cc-43f2-a46b-697a51fbd929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:25.834673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc142d38-49cc-43f2-a46b-697a51fbd929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:25.835453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc142d38-49cc-43f2-a46b-697a51fbd929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:25.837528 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc142d38-49cc-43f2-a46b-697a51fbd929 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:25.873852 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1385/2748] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:25 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:33:25.887548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281a8de-adb4-4ea9-87ab-a08afa876849 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:25.904009 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281a8de-adb4-4ea9-87ab-a08afa876849 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:25.920294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc142d38-49cc-43f2-a46b-697a51fbd929 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:25.927828 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fc142d38-49cc-43f2-a46b-697a51fbd929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:26.006579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb9521-52b0-4d4f-9e3d-52f59b558fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:26.007735 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb9521-52b0-4d4f-9e3d-52f59b558fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:26.008114 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb9521-52b0-4d4f-9e3d-52f59b558fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:26.008487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb9521-52b0-4d4f-9e3d-52f59b558fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:26.009486 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb9521-52b0-4d4f-9e3d-52f59b558fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:26.012047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb9521-52b0-4d4f-9e3d-52f59b558fc0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:26.051852 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1364/2749] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:25 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:26.056630 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc142d38-49cc-43f2-a46b-697a51fbd929 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:26.056969 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb9521-52b0-4d4f-9e3d-52f59b558fc0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:26.062987 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d233a82-8cb7-4bd5-aa82-f62d2a173dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:26.063994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d233a82-8cb7-4bd5-aa82-f62d2a173dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:26.064286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d233a82-8cb7-4bd5-aa82-f62d2a173dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:26.064619 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d233a82-8cb7-4bd5-aa82-f62d2a173dd4 admin admin] PATH_INFO: `/v3/projects/86b80b2e68c9463ab7f96fb0bfbc2cd2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:26.066169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d233a82-8cb7-4bd5-aa82-f62d2a173dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b80b2e68c9463ab7f96fb0bfbc2cd2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:26.068207 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d233a82-8cb7-4bd5-aa82-f62d2a173dd4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:26.070175 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb9521-52b0-4d4f-9e3d-52f59b558fc0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:26.076145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb872847-7392-4a1b-a65b-8e154d72c628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:26.076968 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb872847-7392-4a1b-a65b-8e154d72c628 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:26.077393 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb872847-7392-4a1b-a65b-8e154d72c628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:26.078760 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb872847-7392-4a1b-a65b-8e154d72c628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:26.080076 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb872847-7392-4a1b-a65b-8e154d72c628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:26.083168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb872847-7392-4a1b-a65b-8e154d72c628 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:26.089260 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:26.100795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1365/2750] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:33:26.107594 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb872847-7392-4a1b-a65b-8e154d72c628 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:26.125690 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb872847-7392-4a1b-a65b-8e154d72c628 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:26.134855 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620eb13-6dfe-401e-9d83-d9145c508ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:26.136407 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620eb13-6dfe-401e-9d83-d9145c508ccf admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:26.137296 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620eb13-6dfe-401e-9d83-d9145c508ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:26.137926 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620eb13-6dfe-401e-9d83-d9145c508ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:26.138835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620eb13-6dfe-401e-9d83-d9145c508ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:26.141005 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620eb13-6dfe-401e-9d83-d9145c508ccf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:26.157185 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1366/2751] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:26.160431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0d233a82-8cb7-4bd5-aa82-f62d2a173dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b80b2e68c9463ab7f96fb0bfbc2cd2', 'request_id': 'req-0d233a82-8cb7-4bd5-aa82-f62d2a173dd4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:26.164112 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620eb13-6dfe-401e-9d83-d9145c508ccf admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:26.173236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0d233a82-8cb7-4bd5-aa82-f62d2a173dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b80b2e68c9463ab7f96fb0bfbc2cd2', 'request_id': 'req-0d233a82-8cb7-4bd5-aa82-f62d2a173dd4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:26.181675 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620eb13-6dfe-401e-9d83-d9145c508ccf admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:26.185347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0d233a82-8cb7-4bd5-aa82-f62d2a173dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b80b2e68c9463ab7f96fb0bfbc2cd2', 'request_id': 'req-0d233a82-8cb7-4bd5-aa82-f62d2a173dd4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:26.206712 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0d233a82-8cb7-4bd5-aa82-f62d2a173dd4 admin admin] The token cache is being invalidate because project 86b80b2e68c9463ab7f96fb0bfbc2cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:26.207209 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0d233a82-8cb7-4bd5-aa82-f62d2a173dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:26.208291 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0d233a82-8cb7-4bd5-aa82-f62d2a173dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:26.215154 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1386/2752] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:25 2022] DELETE /identity/v3/projects/86b80b2e68c9463ab7f96fb0bfbc2cd2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:26.217743 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7eedee-b337-4e75-9c37-4c6baaf421ca None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:26.218042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7eedee-b337-4e75-9c37-4c6baaf421ca None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:26.218980 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7eedee-b337-4e75-9c37-4c6baaf421ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:26.240561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3e7eedee-b337-4e75-9c37-4c6baaf421ca None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:26.241812 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3e7eedee-b337-4e75-9c37-4c6baaf421ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:26.280014 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4943f34-53f3-4b0e-a1bf-faa7d309b2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:26.281272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4943f34-53f3-4b0e-a1bf-faa7d309b2dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:26.281561 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4943f34-53f3-4b0e-a1bf-faa7d309b2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:26.281845 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4943f34-53f3-4b0e-a1bf-faa7d309b2dc admin admin] PATH_INFO: `/v3/projects/17b4cb68e8ec418f9c62aafe62f1c0f8/users/f0f953ba47bd4d26a376cc93f188a53b/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:26.304600 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4943f34-53f3-4b0e-a1bf-faa7d309b2dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b4cb68e8ec418f9c62aafe62f1c0f8, user_id=f0f953ba47bd4d26a376cc93f188a53b, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:26.310101 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4943f34-53f3-4b0e-a1bf-faa7d309b2dc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:26.318951 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1387/2753] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:26.327888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617423a-ce8f-46bc-bd5f-4576f70d6925 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:26.328193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617423a-ce8f-46bc-bd5f-4576f70d6925 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:26.328441 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617423a-ce8f-46bc-bd5f-4576f70d6925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:26.333999 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1367/2754] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:26 2022] PUT /identity/v3/projects/17b4cb68e8ec418f9c62aafe62f1c0f8/users/f0f953ba47bd4d26a376cc93f188a53b/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:33:26.347822 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f141e8-bc39-4bbe-8d35-8e396ae6136b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:26.348214 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f141e8-bc39-4bbe-8d35-8e396ae6136b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:26.348497 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f141e8-bc39-4bbe-8d35-8e396ae6136b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:26.354381 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b617423a-ce8f-46bc-bd5f-4576f70d6925 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:26.357838 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b617423a-ce8f-46bc-bd5f-4576f70d6925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:26.368151 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:26.390949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-82f141e8-bc39-4bbe-8d35-8e396ae6136b None None] MFA Rules not processed for user `f0f953ba47bd4d26a376cc93f188a53b`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:26.392226 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-82f141e8-bc39-4bbe-8d35-8e396ae6136b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:26.446697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1388/2755] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:33:26.451511 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617423a-ce8f-46bc-bd5f-4576f70d6925 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:26.461433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617423a-ce8f-46bc-bd5f-4576f70d6925 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:26.468463 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12e040-7018-4243-ba56-7a8f1a70e6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:26.470097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e040-7018-4243-ba56-7a8f1a70e6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:26.470637 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e040-7018-4243-ba56-7a8f1a70e6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:26.471120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e040-7018-4243-ba56-7a8f1a70e6a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:26.472581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12e040-7018-4243-ba56-7a8f1a70e6a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:33:26.473117 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12e040-7018-4243-ba56-7a8f1a70e6a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:26.476822 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12e040-7018-4243-ba56-7a8f1a70e6a6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:26.484404 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1368/2756] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:33:26.494932 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f141e8-bc39-4bbe-8d35-8e396ae6136b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:26.497690 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-82f141e8-bc39-4bbe-8d35-8e396ae6136b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:26.502650 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1389/2757] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:33:26.507936 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12e040-7018-4243-ba56-7a8f1a70e6a6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:26.530289 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12e040-7018-4243-ba56-7a8f1a70e6a6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:26.537593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891ccbb-757f-450a-a1cd-98748031d664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:26.538654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891ccbb-757f-450a-a1cd-98748031d664 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:26.539102 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891ccbb-757f-450a-a1cd-98748031d664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:26.539961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891ccbb-757f-450a-a1cd-98748031d664 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:26.541281 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891ccbb-757f-450a-a1cd-98748031d664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:26.544905 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891ccbb-757f-450a-a1cd-98748031d664 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:26.576681 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f141e8-bc39-4bbe-8d35-8e396ae6136b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:26.581574 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73916dd3-ebe2-45b6-8de6-6a0832049927 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:26.582605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73916dd3-ebe2-45b6-8de6-6a0832049927 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:26.582836 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1390/2758] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:26 2022] POST /identity/v3/projects => generated 355 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:33:26.583084 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73916dd3-ebe2-45b6-8de6-6a0832049927 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:26.583465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73916dd3-ebe2-45b6-8de6-6a0832049927 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:26.594274 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891ccbb-757f-450a-a1cd-98748031d664 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:26.604981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73916dd3-ebe2-45b6-8de6-6a0832049927 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:26.606926 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73916dd3-ebe2-45b6-8de6-6a0832049927 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:26.613204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:26.620647 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1369/2759] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:26.703164 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891ccbb-757f-450a-a1cd-98748031d664 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:26.712762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b83c3-ead4-46dc-adb4-0add27591f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:26.714025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b83c3-ead4-46dc-adb4-0add27591f5a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:26.714604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b83c3-ead4-46dc-adb4-0add27591f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:26.715135 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b83c3-ead4-46dc-adb4-0add27591f5a admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:26.716947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b83c3-ead4-46dc-adb4-0add27591f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:26.726300 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b83c3-ead4-46dc-adb4-0add27591f5a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:26.769997 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1391/2760] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:26 2022] POST /identity/v3/users => generated 278 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:33:26.779505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73916dd3-ebe2-45b6-8de6-6a0832049927 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:26.801646 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73916dd3-ebe2-45b6-8de6-6a0832049927 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:26.808760 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c1899-447c-40b4-a508-999f1ebf04e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:26.809487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c1899-447c-40b4-a508-999f1ebf04e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:26.809772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c1899-447c-40b4-a508-999f1ebf04e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:26.810059 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c1899-447c-40b4-a508-999f1ebf04e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:26.810854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c1899-447c-40b4-a508-999f1ebf04e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:26.812641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c1899-447c-40b4-a508-999f1ebf04e2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:26.825299 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1370/2761] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:26.832696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b83c3-ead4-46dc-adb4-0add27591f5a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:26.845776 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b83c3-ead4-46dc-adb4-0add27591f5a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:26.851338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca958e16-3094-4b49-b820-cee5032fa9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:26.852096 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca958e16-3094-4b49-b820-cee5032fa9ef admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:26.852480 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca958e16-3094-4b49-b820-cee5032fa9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:26.852787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca958e16-3094-4b49-b820-cee5032fa9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:26.853618 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca958e16-3094-4b49-b820-cee5032fa9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:26.855765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca958e16-3094-4b49-b820-cee5032fa9ef admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:26.870628 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1392/2762] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:33:26.875476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c1899-447c-40b4-a508-999f1ebf04e2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:26.888721 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c1899-447c-40b4-a508-999f1ebf04e2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:26.896336 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d7c78-c05d-4144-99f6-2414fac33d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:26.897288 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d7c78-c05d-4144-99f6-2414fac33d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:26.897593 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d7c78-c05d-4144-99f6-2414fac33d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:26.897846 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d7c78-c05d-4144-99f6-2414fac33d22 admin admin] PATH_INFO: `/v3/projects/581a482dc5de44f9b61abe13950c3488/users/f0d14c37b90d4ad8854268fdd6340235/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:26.923365 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d7c78-c05d-4144-99f6-2414fac33d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581a482dc5de44f9b61abe13950c3488, user_id=f0d14c37b90d4ad8854268fdd6340235, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:26.932490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d7c78-c05d-4144-99f6-2414fac33d22 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:26.951002 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1371/2763] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:26 2022] PUT /identity/v3/projects/581a482dc5de44f9b61abe13950c3488/users/f0d14c37b90d4ad8854268fdd6340235/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:33:26.971313 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d3279-cb80-4a03-ba23-63980626c545 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:26.971637 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d3279-cb80-4a03-ba23-63980626c545 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:26.971866 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d3279-cb80-4a03-ba23-63980626c545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:27.029476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3e4d3279-cb80-4a03-ba23-63980626c545 None None] MFA Rules not processed for user `f0d14c37b90d4ad8854268fdd6340235`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:27.033213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3e4d3279-cb80-4a03-ba23-63980626c545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:27.192906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1393/2764] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:26 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:33:27.199631 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d7c78-c05d-4144-99f6-2414fac33d22 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:27.299455 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d7c78-c05d-4144-99f6-2414fac33d22 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:27.307875 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb114e-0e66-4b89-a83b-c7ddf1b7ef10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:27.308977 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb114e-0e66-4b89-a83b-c7ddf1b7ef10 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:27.309458 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb114e-0e66-4b89-a83b-c7ddf1b7ef10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:27.309918 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb114e-0e66-4b89-a83b-c7ddf1b7ef10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:27.311233 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb114e-0e66-4b89-a83b-c7ddf1b7ef10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:27.315169 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb114e-0e66-4b89-a83b-c7ddf1b7ef10 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:27.330525 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:27.356622 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1372/2765] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:27 2022] POST /identity/v3/projects => generated 357 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:27.361235 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d3279-cb80-4a03-ba23-63980626c545 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:27.375576 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d3279-cb80-4a03-ba23-63980626c545 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:27.455223 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b6930-f7eb-4c66-b4a8-0f39195f8355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:27.456028 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b6930-f7eb-4c66-b4a8-0f39195f8355 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:27.456397 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b6930-f7eb-4c66-b4a8-0f39195f8355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:27.456705 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b6930-f7eb-4c66-b4a8-0f39195f8355 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:27.457450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b6930-f7eb-4c66-b4a8-0f39195f8355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:27.459591 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b6930-f7eb-4c66-b4a8-0f39195f8355 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:27.490090 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1394/2766] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:27 2022] POST /identity/v3/users => generated 285 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:33:27.494643 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb114e-0e66-4b89-a83b-c7ddf1b7ef10 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:27.508941 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb114e-0e66-4b89-a83b-c7ddf1b7ef10 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:27.514040 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d0083-45bb-425f-854f-9fb6e5806773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:27.515358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d0083-45bb-425f-854f-9fb6e5806773 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:27.515358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d0083-45bb-425f-854f-9fb6e5806773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:27.515769 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d0083-45bb-425f-854f-9fb6e5806773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:27.516371 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d0083-45bb-425f-854f-9fb6e5806773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:27.518073 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d0083-45bb-425f-854f-9fb6e5806773 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:27.538177 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1373/2767] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:27.544790 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b6930-f7eb-4c66-b4a8-0f39195f8355 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:27.560489 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b6930-f7eb-4c66-b4a8-0f39195f8355 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:27.566971 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e1c25-199a-4177-bef9-6e8eb1672208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:27.568093 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e1c25-199a-4177-bef9-6e8eb1672208 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:27.568561 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e1c25-199a-4177-bef9-6e8eb1672208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:27.569068 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e1c25-199a-4177-bef9-6e8eb1672208 admin admin] PATH_INFO: `/v3/projects/3bf8e1e526474ad2a89e91b40d04385b/users/7dae344c26544d2689208531cfeda306/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:27.573430 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:27.589703 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e1c25-199a-4177-bef9-6e8eb1672208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf8e1e526474ad2a89e91b40d04385b, user_id=7dae344c26544d2689208531cfeda306, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:27.592727 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e1c25-199a-4177-bef9-6e8eb1672208 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:27.610014 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1395/2768] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:27 2022] PUT /identity/v3/projects/3bf8e1e526474ad2a89e91b40d04385b/users/7dae344c26544d2689208531cfeda306/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:27.615045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d0083-45bb-425f-854f-9fb6e5806773 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:27.626889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d0083-45bb-425f-854f-9fb6e5806773 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:27.702847 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01511cf5-8871-4622-b8d1-e67e0572ea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:27.704274 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01511cf5-8871-4622-b8d1-e67e0572ea5c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:27.705016 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01511cf5-8871-4622-b8d1-e67e0572ea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:27.705283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01511cf5-8871-4622-b8d1-e67e0572ea5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:27.706640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01511cf5-8871-4622-b8d1-e67e0572ea5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:27.710087 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01511cf5-8871-4622-b8d1-e67e0572ea5c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:27.728194 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1374/2769] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:27.733014 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e1c25-199a-4177-bef9-6e8eb1672208 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:27.745566 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e1c25-199a-4177-bef9-6e8eb1672208 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:27.751918 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046f1af-8d19-4c4b-a55c-da4c266bed17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:27.752908 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046f1af-8d19-4c4b-a55c-da4c266bed17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:27.753180 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046f1af-8d19-4c4b-a55c-da4c266bed17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:27.753476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046f1af-8d19-4c4b-a55c-da4c266bed17 admin admin] PATH_INFO: `/v3/projects/3bf8e1e526474ad2a89e91b40d04385b/users/7dae344c26544d2689208531cfeda306/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:27.755879 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046f1af-8d19-4c4b-a55c-da4c266bed17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf8e1e526474ad2a89e91b40d04385b, user_id=7dae344c26544d2689208531cfeda306, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:27.758611 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046f1af-8d19-4c4b-a55c-da4c266bed17 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:27.771421 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1396/2770] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:27 2022] PUT /identity/v3/projects/3bf8e1e526474ad2a89e91b40d04385b/users/7dae344c26544d2689208531cfeda306/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:27.782926 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b3b58-9d2a-458a-9425-cab1350aa8fd None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:27.783480 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b3b58-9d2a-458a-9425-cab1350aa8fd None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:27.783889 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b3b58-9d2a-458a-9425-cab1350aa8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:27.830239 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c59b3b58-9d2a-458a-9425-cab1350aa8fd None None] MFA Rules not processed for user `7dae344c26544d2689208531cfeda306`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:27.832246 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c59b3b58-9d2a-458a-9425-cab1350aa8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:27.942613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1375/2771] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:27 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:27.957631 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046f1af-8d19-4c4b-a55c-da4c266bed17 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:27.959569 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1046f1af-8d19-4c4b-a55c-da4c266bed17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:28.036108 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046f1af-8d19-4c4b-a55c-da4c266bed17 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:28.040711 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfd64c-5e0b-447c-b810-94b28c9e1607 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:28.041395 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfd64c-5e0b-447c-b810-94b28c9e1607 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:28.041683 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfd64c-5e0b-447c-b810-94b28c9e1607 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:28.041964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfd64c-5e0b-447c-b810-94b28c9e1607 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:28.056450 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfd64c-5e0b-447c-b810-94b28c9e1607 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:28.058558 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfd64c-5e0b-447c-b810-94b28c9e1607 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:28.070286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1397/2772] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:27 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:33:28.170271 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b3b58-9d2a-458a-9425-cab1350aa8fd None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:28.187774 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b3b58-9d2a-458a-9425-cab1350aa8fd None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:28.192792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa33f06-bc1c-4086-82aa-f9e66f76aca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:28.194294 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa33f06-bc1c-4086-82aa-f9e66f76aca4 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:28.194766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa33f06-bc1c-4086-82aa-f9e66f76aca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:28.195198 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa33f06-bc1c-4086-82aa-f9e66f76aca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:28.301224 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa33f06-bc1c-4086-82aa-f9e66f76aca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:28.304949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa33f06-bc1c-4086-82aa-f9e66f76aca4 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:28.312751 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:28.323693 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1376/2773] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:28 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:29.473750 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfd64c-5e0b-447c-b810-94b28c9e1607 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:29.475481 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-43bfd64c-5e0b-447c-b810-94b28c9e1607 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:29.552662 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfd64c-5e0b-447c-b810-94b28c9e1607 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:29.557654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f092a0-eb26-43c1-8908-877c7c2acae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:29.558606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f092a0-eb26-43c1-8908-877c7c2acae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:29.558887 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f092a0-eb26-43c1-8908-877c7c2acae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:29.559159 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f092a0-eb26-43c1-8908-877c7c2acae3 admin admin] PATH_INFO: `/v3/users/f0f953ba47bd4d26a376cc93f188a53b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:29.560456 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f092a0-eb26-43c1-8908-877c7c2acae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0f953ba47bd4d26a376cc93f188a53b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:29.563110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f092a0-eb26-43c1-8908-877c7c2acae3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:29.626646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-93f092a0-eb26-43c1-8908-877c7c2acae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0f953ba47bd4d26a376cc93f188a53b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:29.634847 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-93f092a0-eb26-43c1-8908-877c7c2acae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0f953ba47bd4d26a376cc93f188a53b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:29.635736 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-93f092a0-eb26-43c1-8908-877c7c2acae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0f953ba47bd4d26a376cc93f188a53b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:29.636462 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-93f092a0-eb26-43c1-8908-877c7c2acae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0f953ba47bd4d26a376cc93f188a53b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:29.666346 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-93f092a0-eb26-43c1-8908-877c7c2acae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0f953ba47bd4d26a376cc93f188a53b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:29.670913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:29.687197 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1398/2774] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:29 2022] DELETE /identity/v3/users/f0f953ba47bd4d26a376cc93f188a53b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:29.692892 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67b594-d9b7-4e8a-9195-53f0d3f6e9e5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:29.693464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67b594-d9b7-4e8a-9195-53f0d3f6e9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:29.693464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67b594-d9b7-4e8a-9195-53f0d3f6e9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:29.733986 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cc67b594-d9b7-4e8a-9195-53f0d3f6e9e5 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:29.736092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cc67b594-d9b7-4e8a-9195-53f0d3f6e9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:29.827079 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1377/2775] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:29.838453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f092a0-eb26-43c1-8908-877c7c2acae3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:29.839978 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-93f092a0-eb26-43c1-8908-877c7c2acae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:29.910243 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f092a0-eb26-43c1-8908-877c7c2acae3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:29.913840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16842bd8-ec2d-4a5d-b5b4-55780d306c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:29.914891 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16842bd8-ec2d-4a5d-b5b4-55780d306c86 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:29.915171 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16842bd8-ec2d-4a5d-b5b4-55780d306c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:29.915448 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16842bd8-ec2d-4a5d-b5b4-55780d306c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:29.926517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16842bd8-ec2d-4a5d-b5b4-55780d306c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:29.928009 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16842bd8-ec2d-4a5d-b5b4-55780d306c86 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:29.941749 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1399/2776] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:30.269727 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67b594-d9b7-4e8a-9195-53f0d3f6e9e5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:30.271602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cc67b594-d9b7-4e8a-9195-53f0d3f6e9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:30.291092 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67b594-d9b7-4e8a-9195-53f0d3f6e9e5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:30.297626 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea086c01-22a1-4190-ae04-b86123cd87ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:30.298707 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea086c01-22a1-4190-ae04-b86123cd87ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:30.299046 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea086c01-22a1-4190-ae04-b86123cd87ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:30.299405 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea086c01-22a1-4190-ae04-b86123cd87ed admin admin] PATH_INFO: `/v3/projects/17b4cb68e8ec418f9c62aafe62f1c0f8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:30.300830 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea086c01-22a1-4190-ae04-b86123cd87ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b4cb68e8ec418f9c62aafe62f1c0f8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:30.302861 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea086c01-22a1-4190-ae04-b86123cd87ed admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:30.366353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea086c01-22a1-4190-ae04-b86123cd87ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b4cb68e8ec418f9c62aafe62f1c0f8', 'request_id': 'req-ea086c01-22a1-4190-ae04-b86123cd87ed'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:30.375183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea086c01-22a1-4190-ae04-b86123cd87ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b4cb68e8ec418f9c62aafe62f1c0f8', 'request_id': 'req-ea086c01-22a1-4190-ae04-b86123cd87ed'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:30.386117 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea086c01-22a1-4190-ae04-b86123cd87ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b4cb68e8ec418f9c62aafe62f1c0f8', 'request_id': 'req-ea086c01-22a1-4190-ae04-b86123cd87ed'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:30.397597 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea086c01-22a1-4190-ae04-b86123cd87ed admin admin] The token cache is being invalidate because project 17b4cb68e8ec418f9c62aafe62f1c0f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:30.397895 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea086c01-22a1-4190-ae04-b86123cd87ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:30.398568 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea086c01-22a1-4190-ae04-b86123cd87ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:30.400461 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1378/2777] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:30 2022] DELETE /identity/v3/projects/17b4cb68e8ec418f9c62aafe62f1c0f8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:30.406089 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed33a1-508c-4549-be7c-42abcae437c6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:30.406420 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed33a1-508c-4549-be7c-42abcae437c6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:30.406703 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed33a1-508c-4549-be7c-42abcae437c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:30.430765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e9ed33a1-508c-4549-be7c-42abcae437c6 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:30.432021 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e9ed33a1-508c-4549-be7c-42abcae437c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:30.538655 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1400/2778] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:30.547360 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd68782-fdbf-4105-b317-1db43ec06ecb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:30.547635 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd68782-fdbf-4105-b317-1db43ec06ecb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:30.547907 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd68782-fdbf-4105-b317-1db43ec06ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:30.569192 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2dd68782-fdbf-4105-b317-1db43ec06ecb None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:30.570472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2dd68782-fdbf-4105-b317-1db43ec06ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:30.588227 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1379/2779] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:30.594645 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed33a1-508c-4549-be7c-42abcae437c6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:30.605906 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed33a1-508c-4549-be7c-42abcae437c6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:30.611894 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0efa0-ecd9-42be-9829-2dbd37b2ac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:30.612964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0efa0-ecd9-42be-9829-2dbd37b2ac75 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:30.613278 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0efa0-ecd9-42be-9829-2dbd37b2ac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:30.613553 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0efa0-ecd9-42be-9829-2dbd37b2ac75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:30.614448 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0efa0-ecd9-42be-9829-2dbd37b2ac75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:33:30.614762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0efa0-ecd9-42be-9829-2dbd37b2ac75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:30.617079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0efa0-ecd9-42be-9829-2dbd37b2ac75 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:30.631433 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1401/2780] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:33:30.637723 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd68782-fdbf-4105-b317-1db43ec06ecb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:30.650014 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd68782-fdbf-4105-b317-1db43ec06ecb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:30.655450 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e979f6d-b1b4-4b2a-a0f5-449808407181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:30.656237 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e979f6d-b1b4-4b2a-a0f5-449808407181 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:30.656523 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e979f6d-b1b4-4b2a-a0f5-449808407181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:30.656813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e979f6d-b1b4-4b2a-a0f5-449808407181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:30.657522 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e979f6d-b1b4-4b2a-a0f5-449808407181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:30.659517 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e979f6d-b1b4-4b2a-a0f5-449808407181 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:30.692644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1380/2781] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:30 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:30.693997 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0efa0-ecd9-42be-9829-2dbd37b2ac75 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:30.709516 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0efa0-ecd9-42be-9829-2dbd37b2ac75 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:30.786009 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfeda2-7c23-4180-a725-66e8ad17e7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:30.786765 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfeda2-7c23-4180-a725-66e8ad17e7bb admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:30.787055 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfeda2-7c23-4180-a725-66e8ad17e7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:30.787333 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfeda2-7c23-4180-a725-66e8ad17e7bb admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:30.788054 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfeda2-7c23-4180-a725-66e8ad17e7bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:30.790468 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfeda2-7c23-4180-a725-66e8ad17e7bb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:30.825877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1402/2782] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:30 2022] POST /identity/v3/users => generated 285 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:30.830772 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e979f6d-b1b4-4b2a-a0f5-449808407181 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:30.851157 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e979f6d-b1b4-4b2a-a0f5-449808407181 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:30.856375 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86088a-bb08-4bda-b754-21a0a2602826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:30.857061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86088a-bb08-4bda-b754-21a0a2602826 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:30.857342 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86088a-bb08-4bda-b754-21a0a2602826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:30.857616 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86088a-bb08-4bda-b754-21a0a2602826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:30.858595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86088a-bb08-4bda-b754-21a0a2602826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:30.860604 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86088a-bb08-4bda-b754-21a0a2602826 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:30.873100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1381/2783] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:30.878566 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfeda2-7c23-4180-a725-66e8ad17e7bb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:30.904947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfeda2-7c23-4180-a725-66e8ad17e7bb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:30.911383 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752c6b1-fe1e-4a66-818d-a414911bb596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:30.912376 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c6b1-fe1e-4a66-818d-a414911bb596 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:30.912701 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c6b1-fe1e-4a66-818d-a414911bb596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:30.912985 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c6b1-fe1e-4a66-818d-a414911bb596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:30.913849 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752c6b1-fe1e-4a66-818d-a414911bb596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:30.916378 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752c6b1-fe1e-4a66-818d-a414911bb596 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:30.937568 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1403/2784] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:30.938928 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86088a-bb08-4bda-b754-21a0a2602826 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:30.949880 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86088a-bb08-4bda-b754-21a0a2602826 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:30.956340 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb673df7-a3eb-4a8f-b319-1c1282aa29fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:30.957273 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb673df7-a3eb-4a8f-b319-1c1282aa29fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:30.957619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb673df7-a3eb-4a8f-b319-1c1282aa29fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:30.957896 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb673df7-a3eb-4a8f-b319-1c1282aa29fc admin admin] PATH_INFO: `/v3/projects/0dde43bebbac4281acc4c87846e7c4be/users/aecfa7e3ded94ad891ac1c946df6014f/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:30.978805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb673df7-a3eb-4a8f-b319-1c1282aa29fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dde43bebbac4281acc4c87846e7c4be, user_id=aecfa7e3ded94ad891ac1c946df6014f, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:30.982628 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb673df7-a3eb-4a8f-b319-1c1282aa29fc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:31.010279 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1382/2785] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:30 2022] PUT /identity/v3/projects/0dde43bebbac4281acc4c87846e7c4be/users/aecfa7e3ded94ad891ac1c946df6014f/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:31.022605 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91260-e66c-4796-8d1b-ff37e99dd625 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:31.022944 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91260-e66c-4796-8d1b-ff37e99dd625 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:31.023236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91260-e66c-4796-8d1b-ff37e99dd625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:31.030312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:31.068354 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5db91260-e66c-4796-8d1b-ff37e99dd625 None None] MFA Rules not processed for user `aecfa7e3ded94ad891ac1c946df6014f`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:31.069862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5db91260-e66c-4796-8d1b-ff37e99dd625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:31.180161 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1404/2786] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:31.193339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb673df7-a3eb-4a8f-b319-1c1282aa29fc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:31.195981 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fb673df7-a3eb-4a8f-b319-1c1282aa29fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:31.230341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:31.285581 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb673df7-a3eb-4a8f-b319-1c1282aa29fc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:31.287845 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551586e-3dac-4967-b7ea-de8d555a927e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f18acfb35dfe41a1aeb50c702bd1942b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:31.288511 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551586e-3dac-4967-b7ea-de8d555a927e service glance] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:31.288798 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551586e-3dac-4967-b7ea-de8d555a927e service glance] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:31.289790 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551586e-3dac-4967-b7ea-de8d555a927e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:31.301725 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551586e-3dac-4967-b7ea-de8d555a927e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:31.303536 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551586e-3dac-4967-b7ea-de8d555a927e service glance] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:31.314744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1383/2787] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:41.176235 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=31 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:41.309275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=18 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:44.073636 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db91260-e66c-4796-8d1b-ff37e99dd625 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:44.076106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5db91260-e66c-4796-8d1b-ff37e99dd625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:44.162751 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db91260-e66c-4796-8d1b-ff37e99dd625 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:44.168158 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574ee7e-7744-4e8f-8fc4-103dac2281f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:44.169101 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574ee7e-7744-4e8f-8fc4-103dac2281f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:44.169609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574ee7e-7744-4e8f-8fc4-103dac2281f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:44.169884 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574ee7e-7744-4e8f-8fc4-103dac2281f4 admin admin] PATH_INFO: `/v3/users/f0d14c37b90d4ad8854268fdd6340235` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:44.171544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574ee7e-7744-4e8f-8fc4-103dac2281f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d14c37b90d4ad8854268fdd6340235)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:44.173963 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574ee7e-7744-4e8f-8fc4-103dac2281f4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:44.230377 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8574ee7e-7744-4e8f-8fc4-103dac2281f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d14c37b90d4ad8854268fdd6340235'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:44.237672 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8574ee7e-7744-4e8f-8fc4-103dac2281f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d14c37b90d4ad8854268fdd6340235'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:44.238481 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8574ee7e-7744-4e8f-8fc4-103dac2281f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d14c37b90d4ad8854268fdd6340235'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:44.239102 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8574ee7e-7744-4e8f-8fc4-103dac2281f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d14c37b90d4ad8854268fdd6340235'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:44.252156 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8574ee7e-7744-4e8f-8fc4-103dac2281f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d14c37b90d4ad8854268fdd6340235'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:44.266042 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1405/2788] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:44 2022] DELETE /identity/v3/users/f0d14c37b90d4ad8854268fdd6340235 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:44.271145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3037d-aecf-4b8d-a0c1-8dd70d1fe54b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:44.271614 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3037d-aecf-4b8d-a0c1-8dd70d1fe54b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:44.271784 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3037d-aecf-4b8d-a0c1-8dd70d1fe54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:44.290934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b3b3037d-aecf-4b8d-a0c1-8dd70d1fe54b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:44.292326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b3b3037d-aecf-4b8d-a0c1-8dd70d1fe54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:44.364270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1384/2789] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:44.375219 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574ee7e-7744-4e8f-8fc4-103dac2281f4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:44.377082 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8574ee7e-7744-4e8f-8fc4-103dac2281f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:44.447842 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574ee7e-7744-4e8f-8fc4-103dac2281f4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:44.451902 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fcd75-508b-404c-acac-35b195118e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:44.452580 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fcd75-508b-404c-acac-35b195118e91 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:44.452916 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fcd75-508b-404c-acac-35b195118e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:44.453246 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fcd75-508b-404c-acac-35b195118e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:44.463025 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fcd75-508b-404c-acac-35b195118e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:44.464476 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fcd75-508b-404c-acac-35b195118e91 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:44.466999 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3037d-aecf-4b8d-a0c1-8dd70d1fe54b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:44.468671 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b3b3037d-aecf-4b8d-a0c1-8dd70d1fe54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:44.474682 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1406/2790] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:44.480937 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3037d-aecf-4b8d-a0c1-8dd70d1fe54b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:44.485744 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ddc41-9508-4b17-9ff2-4f08d86c4592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:44.486676 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ddc41-9508-4b17-9ff2-4f08d86c4592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:44.486962 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ddc41-9508-4b17-9ff2-4f08d86c4592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:44.487245 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ddc41-9508-4b17-9ff2-4f08d86c4592 admin admin] PATH_INFO: `/v3/users/e9e4566b68e74ee99c6f8668403cc388` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:44.488456 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ddc41-9508-4b17-9ff2-4f08d86c4592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e4566b68e74ee99c6f8668403cc388)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:44.490423 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ddc41-9508-4b17-9ff2-4f08d86c4592 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:44.547713 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0b3ddc41-9508-4b17-9ff2-4f08d86c4592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e4566b68e74ee99c6f8668403cc388'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:44.557548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0b3ddc41-9508-4b17-9ff2-4f08d86c4592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e4566b68e74ee99c6f8668403cc388'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:44.567248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0b3ddc41-9508-4b17-9ff2-4f08d86c4592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e4566b68e74ee99c6f8668403cc388'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:44.568058 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0b3ddc41-9508-4b17-9ff2-4f08d86c4592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e4566b68e74ee99c6f8668403cc388'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:44.586004 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0b3ddc41-9508-4b17-9ff2-4f08d86c4592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e4566b68e74ee99c6f8668403cc388'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:44.593242 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1385/2791] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:44 2022] DELETE /identity/v3/users/e9e4566b68e74ee99c6f8668403cc388 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:33:44.598196 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab669ac-4dae-4e23-bab9-3466edb3d3dc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:44.598515 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab669ac-4dae-4e23-bab9-3466edb3d3dc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:44.598795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab669ac-4dae-4e23-bab9-3466edb3d3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:44.616774 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-dab669ac-4dae-4e23-bab9-3466edb3d3dc None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:44.618021 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dab669ac-4dae-4e23-bab9-3466edb3d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:44.644731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:44.691688 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1407/2792] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:44.701720 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ddc41-9508-4b17-9ff2-4f08d86c4592 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:44.703982 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0b3ddc41-9508-4b17-9ff2-4f08d86c4592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:44.782355 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab669ac-4dae-4e23-bab9-3466edb3d3dc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:44.784523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dab669ac-4dae-4e23-bab9-3466edb3d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:44.786613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ddc41-9508-4b17-9ff2-4f08d86c4592 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:44.791056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69214d5e-4d86-4f50-8bc5-db4e8d5e353b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:44.791741 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69214d5e-4d86-4f50-8bc5-db4e8d5e353b service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:44.792022 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69214d5e-4d86-4f50-8bc5-db4e8d5e353b service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:44.792375 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69214d5e-4d86-4f50-8bc5-db4e8d5e353b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:44.805527 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab669ac-4dae-4e23-bab9-3466edb3d3dc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:44.806870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69214d5e-4d86-4f50-8bc5-db4e8d5e353b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:44.808499 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69214d5e-4d86-4f50-8bc5-db4e8d5e353b service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:44.811684 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c5a4c-abf1-42d2-ae54-f65107281d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:44.812598 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c5a4c-abf1-42d2-ae54-f65107281d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:44.812870 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c5a4c-abf1-42d2-ae54-f65107281d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:44.813153 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c5a4c-abf1-42d2-ae54-f65107281d3d admin admin] PATH_INFO: `/v3/projects/581a482dc5de44f9b61abe13950c3488` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:44.814758 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c5a4c-abf1-42d2-ae54-f65107281d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=581a482dc5de44f9b61abe13950c3488)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:44.818124 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c5a4c-abf1-42d2-ae54-f65107281d3d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:44.822145 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1386/2793] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:44.886523 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-376c5a4c-abf1-42d2-ae54-f65107281d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581a482dc5de44f9b61abe13950c3488', 'request_id': 'req-376c5a4c-abf1-42d2-ae54-f65107281d3d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:44.893734 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-376c5a4c-abf1-42d2-ae54-f65107281d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581a482dc5de44f9b61abe13950c3488', 'request_id': 'req-376c5a4c-abf1-42d2-ae54-f65107281d3d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:44.900723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-376c5a4c-abf1-42d2-ae54-f65107281d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581a482dc5de44f9b61abe13950c3488', 'request_id': 'req-376c5a4c-abf1-42d2-ae54-f65107281d3d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:44.915462 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-376c5a4c-abf1-42d2-ae54-f65107281d3d admin admin] The token cache is being invalidate because project 581a482dc5de44f9b61abe13950c3488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:44.916460 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-376c5a4c-abf1-42d2-ae54-f65107281d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:44.916460 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-376c5a4c-abf1-42d2-ae54-f65107281d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:44.918078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1408/2794] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:44 2022] DELETE /identity/v3/projects/581a482dc5de44f9b61abe13950c3488 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:44.924113 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69214d5e-4d86-4f50-8bc5-db4e8d5e353b service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:44.934583 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69214d5e-4d86-4f50-8bc5-db4e8d5e353b service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:44.947513 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:45.001602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b866b5-d25d-4f5e-8dba-d5fccf7563eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:45.002811 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b866b5-d25d-4f5e-8dba-d5fccf7563eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:45.003122 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b866b5-d25d-4f5e-8dba-d5fccf7563eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:45.003296 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b866b5-d25d-4f5e-8dba-d5fccf7563eb admin admin] PATH_INFO: `/v3/users/7dae344c26544d2689208531cfeda306` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:45.004705 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b866b5-d25d-4f5e-8dba-d5fccf7563eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dae344c26544d2689208531cfeda306)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:45.006945 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b866b5-d25d-4f5e-8dba-d5fccf7563eb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:45.062467 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28b866b5-d25d-4f5e-8dba-d5fccf7563eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dae344c26544d2689208531cfeda306'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:45.069636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28b866b5-d25d-4f5e-8dba-d5fccf7563eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dae344c26544d2689208531cfeda306'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:45.079347 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28b866b5-d25d-4f5e-8dba-d5fccf7563eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dae344c26544d2689208531cfeda306'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:45.080460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28b866b5-d25d-4f5e-8dba-d5fccf7563eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dae344c26544d2689208531cfeda306'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:45.093613 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28b866b5-d25d-4f5e-8dba-d5fccf7563eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dae344c26544d2689208531cfeda306'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:45.099876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1387/2795] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:44 2022] DELETE /identity/v3/users/7dae344c26544d2689208531cfeda306 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:45.129889 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c5a4c-abf1-42d2-ae54-f65107281d3d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:45.132236 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-376c5a4c-abf1-42d2-ae54-f65107281d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:45.147289 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c5a4c-abf1-42d2-ae54-f65107281d3d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:45.219890 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6130bc2-cb91-4783-beda-f41472725f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:45.221124 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6130bc2-cb91-4783-beda-f41472725f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:45.221411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6130bc2-cb91-4783-beda-f41472725f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:45.221729 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6130bc2-cb91-4783-beda-f41472725f99 admin admin] PATH_INFO: `/v3/projects/b6f5679dc1134e829925a871326a205e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:45.222975 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6130bc2-cb91-4783-beda-f41472725f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f5679dc1134e829925a871326a205e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:45.224935 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6130bc2-cb91-4783-beda-f41472725f99 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:45.276446 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:45.277945 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c6130bc2-cb91-4783-beda-f41472725f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f5679dc1134e829925a871326a205e', 'request_id': 'req-c6130bc2-cb91-4783-beda-f41472725f99'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:45.284830 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c6130bc2-cb91-4783-beda-f41472725f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f5679dc1134e829925a871326a205e', 'request_id': 'req-c6130bc2-cb91-4783-beda-f41472725f99'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:45.293165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c6130bc2-cb91-4783-beda-f41472725f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f5679dc1134e829925a871326a205e', 'request_id': 'req-c6130bc2-cb91-4783-beda-f41472725f99'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:45.309691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c6130bc2-cb91-4783-beda-f41472725f99 admin admin] The token cache is being invalidate because project b6f5679dc1134e829925a871326a205e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:45.309898 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c6130bc2-cb91-4783-beda-f41472725f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:45.310536 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c6130bc2-cb91-4783-beda-f41472725f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:45.312568 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1409/2796] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:45 2022] DELETE /identity/v3/projects/b6f5679dc1134e829925a871326a205e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:45.413033 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b866b5-d25d-4f5e-8dba-d5fccf7563eb admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:45.415207 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-28b866b5-d25d-4f5e-8dba-d5fccf7563eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:45.429810 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b866b5-d25d-4f5e-8dba-d5fccf7563eb admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:45.500674 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9b996-b11b-4de5-8ad6-f59b9be1fa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:45.502061 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9b996-b11b-4de5-8ad6-f59b9be1fa7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:45.502449 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9b996-b11b-4de5-8ad6-f59b9be1fa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:45.502776 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9b996-b11b-4de5-8ad6-f59b9be1fa7a admin admin] PATH_INFO: `/v3/projects/3bf8e1e526474ad2a89e91b40d04385b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:45.504260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9b996-b11b-4de5-8ad6-f59b9be1fa7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf8e1e526474ad2a89e91b40d04385b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:45.506268 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9b996-b11b-4de5-8ad6-f59b9be1fa7a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:45.553487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:45.567038 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e0b9b996-b11b-4de5-8ad6-f59b9be1fa7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf8e1e526474ad2a89e91b40d04385b', 'request_id': 'req-e0b9b996-b11b-4de5-8ad6-f59b9be1fa7a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:45.576563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e0b9b996-b11b-4de5-8ad6-f59b9be1fa7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf8e1e526474ad2a89e91b40d04385b', 'request_id': 'req-e0b9b996-b11b-4de5-8ad6-f59b9be1fa7a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:45.583750 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e0b9b996-b11b-4de5-8ad6-f59b9be1fa7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf8e1e526474ad2a89e91b40d04385b', 'request_id': 'req-e0b9b996-b11b-4de5-8ad6-f59b9be1fa7a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:45.599312 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e0b9b996-b11b-4de5-8ad6-f59b9be1fa7a admin admin] The token cache is being invalidate because project 3bf8e1e526474ad2a89e91b40d04385b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:45.599605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e0b9b996-b11b-4de5-8ad6-f59b9be1fa7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:45.600311 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e0b9b996-b11b-4de5-8ad6-f59b9be1fa7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:45.602341 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1388/2797] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:45 2022] DELETE /identity/v3/projects/3bf8e1e526474ad2a89e91b40d04385b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:45.607731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586a080-7be3-4925-acea-901ced8a76cc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:45.608056 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586a080-7be3-4925-acea-901ced8a76cc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:45.608364 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586a080-7be3-4925-acea-901ced8a76cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:45.628322 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5586a080-7be3-4925-acea-901ced8a76cc None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:45.629568 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5586a080-7be3-4925-acea-901ced8a76cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:45.693660 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1410/2798] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:33:45.702233 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1fad0-654b-4471-9d5e-d6092140bdab None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:45.702552 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1fad0-654b-4471-9d5e-d6092140bdab None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:45.702843 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1fad0-654b-4471-9d5e-d6092140bdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:45.722414 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6fc1fad0-654b-4471-9d5e-d6092140bdab None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:45.723644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6fc1fad0-654b-4471-9d5e-d6092140bdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:45.732332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1389/2799] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:45.737082 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586a080-7be3-4925-acea-901ced8a76cc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:45.747373 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586a080-7be3-4925-acea-901ced8a76cc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:45.753334 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927cf30c-b773-4ad5-802e-56d9bc3a4e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:45.754015 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cf30c-b773-4ad5-802e-56d9bc3a4e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:45.754331 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cf30c-b773-4ad5-802e-56d9bc3a4e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:45.754621 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cf30c-b773-4ad5-802e-56d9bc3a4e10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:45.755352 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927cf30c-b773-4ad5-802e-56d9bc3a4e10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:33:45.755673 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927cf30c-b773-4ad5-802e-56d9bc3a4e10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:45.757287 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927cf30c-b773-4ad5-802e-56d9bc3a4e10 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:45.770447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1411/2800] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:33:45.775265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1fad0-654b-4471-9d5e-d6092140bdab None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:45.786748 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1fad0-654b-4471-9d5e-d6092140bdab None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:45.793703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5de35-c0b5-487b-8ebe-9441cd985d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:45.794409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5de35-c0b5-487b-8ebe-9441cd985d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:45.794686 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5de35-c0b5-487b-8ebe-9441cd985d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:45.794996 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5de35-c0b5-487b-8ebe-9441cd985d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:45.795791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5de35-c0b5-487b-8ebe-9441cd985d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:45.798014 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5de35-c0b5-487b-8ebe-9441cd985d38 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:45.838094 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1390/2801] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:45 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:45.839239 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927cf30c-b773-4ad5-802e-56d9bc3a4e10 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:45.849580 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927cf30c-b773-4ad5-802e-56d9bc3a4e10 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:45.910451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cad81-24dc-4d9d-8f6d-9272734cfa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:45.911123 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cad81-24dc-4d9d-8f6d-9272734cfa2c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:45.911402 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cad81-24dc-4d9d-8f6d-9272734cfa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:45.911679 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cad81-24dc-4d9d-8f6d-9272734cfa2c admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:45.912376 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268cad81-24dc-4d9d-8f6d-9272734cfa2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:45.914745 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268cad81-24dc-4d9d-8f6d-9272734cfa2c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:45.936680 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1412/2802] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:45 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:45.941347 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5de35-c0b5-487b-8ebe-9441cd985d38 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:45.953557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5de35-c0b5-487b-8ebe-9441cd985d38 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:45.959494 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad7d6a-a035-4a12-a3b8-eca4559d7fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:45.960185 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad7d6a-a035-4a12-a3b8-eca4559d7fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:45.960494 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad7d6a-a035-4a12-a3b8-eca4559d7fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:45.960742 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad7d6a-a035-4a12-a3b8-eca4559d7fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:45.961484 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad7d6a-a035-4a12-a3b8-eca4559d7fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:45.963160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad7d6a-a035-4a12-a3b8-eca4559d7fd2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:45.975763 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1391/2803] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:45.980164 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cad81-24dc-4d9d-8f6d-9272734cfa2c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:45.991712 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cad81-24dc-4d9d-8f6d-9272734cfa2c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:45.997653 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a642cf-39c4-4427-831c-e965870d853f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:45.998417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a642cf-39c4-4427-831c-e965870d853f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:45.998702 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a642cf-39c4-4427-831c-e965870d853f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:45.999144 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a642cf-39c4-4427-831c-e965870d853f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:45.999904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a642cf-39c4-4427-831c-e965870d853f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:46.002049 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a642cf-39c4-4427-831c-e965870d853f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:46.015124 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1413/2804] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:46.019711 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad7d6a-a035-4a12-a3b8-eca4559d7fd2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:46.030757 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad7d6a-a035-4a12-a3b8-eca4559d7fd2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:46.036091 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e9990-04ce-461f-a422-90e6b45c1d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:46.037008 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e9990-04ce-461f-a422-90e6b45c1d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:46.037322 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e9990-04ce-461f-a422-90e6b45c1d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:46.037578 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e9990-04ce-461f-a422-90e6b45c1d79 admin admin] PATH_INFO: `/v3/projects/8373c3af992a4a5fa731e21eea84fd84/users/489f5e055c574f469432becdfd882e8c/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:46.055916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e9990-04ce-461f-a422-90e6b45c1d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8373c3af992a4a5fa731e21eea84fd84, user_id=489f5e055c574f469432becdfd882e8c, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:46.058687 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e9990-04ce-461f-a422-90e6b45c1d79 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:46.075088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1392/2805] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:46 2022] PUT /identity/v3/projects/8373c3af992a4a5fa731e21eea84fd84/users/489f5e055c574f469432becdfd882e8c/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:46.087213 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d388bb-6962-4886-bdc2-3cbccba5c9e1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:46.087478 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d388bb-6962-4886-bdc2-3cbccba5c9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:46.087803 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d388bb-6962-4886-bdc2-3cbccba5c9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:46.118568 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e6d388bb-6962-4886-bdc2-3cbccba5c9e1 None None] MFA Rules not processed for user `489f5e055c574f469432becdfd882e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:46.119719 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e6d388bb-6962-4886-bdc2-3cbccba5c9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:46.155257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:46.200102 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1414/2806] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:46.205103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e9990-04ce-461f-a422-90e6b45c1d79 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:46.275495 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e9990-04ce-461f-a422-90e6b45c1d79 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:46.282491 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ed7c3-0813-4fab-ad98-36d62c784ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:46.283132 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ed7c3-0813-4fab-ad98-36d62c784ccb admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:46.283413 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ed7c3-0813-4fab-ad98-36d62c784ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:46.283689 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ed7c3-0813-4fab-ad98-36d62c784ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:46.284391 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ed7c3-0813-4fab-ad98-36d62c784ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:46.286332 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ed7c3-0813-4fab-ad98-36d62c784ccb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:46.319356 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1393/2807] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:46 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:46.320869 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d388bb-6962-4886-bdc2-3cbccba5c9e1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:46.337388 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d388bb-6962-4886-bdc2-3cbccba5c9e1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:46.397775 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b249449-87f0-4d37-a93b-9286ac9b4598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:46.398410 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b249449-87f0-4d37-a93b-9286ac9b4598 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:46.398699 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b249449-87f0-4d37-a93b-9286ac9b4598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:46.398979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b249449-87f0-4d37-a93b-9286ac9b4598 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:46.399682 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b249449-87f0-4d37-a93b-9286ac9b4598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:46.401653 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b249449-87f0-4d37-a93b-9286ac9b4598 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:46.424150 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1415/2808] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:46 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:33:46.429359 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ed7c3-0813-4fab-ad98-36d62c784ccb admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:46.441947 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ed7c3-0813-4fab-ad98-36d62c784ccb admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:46.446974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2776f-f9e8-4eac-999c-b3e4d352779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:46.447652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2776f-f9e8-4eac-999c-b3e4d352779f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:46.447937 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2776f-f9e8-4eac-999c-b3e4d352779f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:46.448216 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2776f-f9e8-4eac-999c-b3e4d352779f admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:46.448958 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2776f-f9e8-4eac-999c-b3e4d352779f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:46.450616 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2776f-f9e8-4eac-999c-b3e4d352779f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:46.461635 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1394/2809] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:46.465922 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b249449-87f0-4d37-a93b-9286ac9b4598 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:46.476975 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b249449-87f0-4d37-a93b-9286ac9b4598 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:46.482620 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fa35c-7f0d-43d4-93d8-d4a0ba1d8711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:46.483525 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fa35c-7f0d-43d4-93d8-d4a0ba1d8711 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:46.483811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fa35c-7f0d-43d4-93d8-d4a0ba1d8711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:46.484094 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fa35c-7f0d-43d4-93d8-d4a0ba1d8711 admin admin] PATH_INFO: `/v3/projects/b55feb2853b54624968bbfd85b1fd17a/users/f9d98ed658af48469d635796b8771862/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:46.501639 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fa35c-7f0d-43d4-93d8-d4a0ba1d8711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55feb2853b54624968bbfd85b1fd17a, user_id=f9d98ed658af48469d635796b8771862, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:46.505564 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fa35c-7f0d-43d4-93d8-d4a0ba1d8711 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:46.525581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1416/2810] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:46 2022] PUT /identity/v3/projects/b55feb2853b54624968bbfd85b1fd17a/users/f9d98ed658af48469d635796b8771862/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:46.530616 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2776f-f9e8-4eac-999c-b3e4d352779f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:46.542337 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2776f-f9e8-4eac-999c-b3e4d352779f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:46.582417 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:46.609834 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32795ff2-4e64-4fe8-8e90-4faabd65a9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:46.610553 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32795ff2-4e64-4fe8-8e90-4faabd65a9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:46.610838 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32795ff2-4e64-4fe8-8e90-4faabd65a9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:46.611110 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32795ff2-4e64-4fe8-8e90-4faabd65a9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:46.611841 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32795ff2-4e64-4fe8-8e90-4faabd65a9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:46.613440 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32795ff2-4e64-4fe8-8e90-4faabd65a9e5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:46.623666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1395/2811] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:33:46.630343 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fa35c-7f0d-43d4-93d8-d4a0ba1d8711 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:46.641269 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fa35c-7f0d-43d4-93d8-d4a0ba1d8711 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:46.646997 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48d41f-a732-4715-a3b3-8cca0b362902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:46.647965 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48d41f-a732-4715-a3b3-8cca0b362902 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:46.648588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48d41f-a732-4715-a3b3-8cca0b362902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:46.648588 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48d41f-a732-4715-a3b3-8cca0b362902 admin admin] PATH_INFO: `/v3/projects/b55feb2853b54624968bbfd85b1fd17a/users/f9d98ed658af48469d635796b8771862/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:46.650471 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48d41f-a732-4715-a3b3-8cca0b362902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55feb2853b54624968bbfd85b1fd17a, user_id=f9d98ed658af48469d635796b8771862, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:46.653107 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48d41f-a732-4715-a3b3-8cca0b362902 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:46.664813 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1417/2812] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:46 2022] PUT /identity/v3/projects/b55feb2853b54624968bbfd85b1fd17a/users/f9d98ed658af48469d635796b8771862/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:46.676018 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305bfa5-8e6b-484e-a67b-312021a98c7b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:46.676298 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305bfa5-8e6b-484e-a67b-312021a98c7b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:46.676555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305bfa5-8e6b-484e-a67b-312021a98c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:46.713127 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2305bfa5-8e6b-484e-a67b-312021a98c7b None None] MFA Rules not processed for user `f9d98ed658af48469d635796b8771862`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:46.714536 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2305bfa5-8e6b-484e-a67b-312021a98c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:46.791308 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1396/2813] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:46.803220 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48d41f-a732-4715-a3b3-8cca0b362902 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:46.805023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cd48d41f-a732-4715-a3b3-8cca0b362902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:46.874662 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48d41f-a732-4715-a3b3-8cca0b362902 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:46.878401 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420aaa0-1b8b-4b33-94f4-44d195b6a10b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:46.879063 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420aaa0-1b8b-4b33-94f4-44d195b6a10b service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:46.879348 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420aaa0-1b8b-4b33-94f4-44d195b6a10b service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:46.879624 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420aaa0-1b8b-4b33-94f4-44d195b6a10b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:46.923003 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:46.943770 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420aaa0-1b8b-4b33-94f4-44d195b6a10b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:46.945233 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420aaa0-1b8b-4b33-94f4-44d195b6a10b service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:46.954609 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1418/2814] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:48.348464 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305bfa5-8e6b-484e-a67b-312021a98c7b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:48.350505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2305bfa5-8e6b-484e-a67b-312021a98c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:48.364430 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305bfa5-8e6b-484e-a67b-312021a98c7b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:48.368289 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bb018-d468-4a0f-abef-b3295e111484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:48.368974 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bb018-d468-4a0f-abef-b3295e111484 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:48.369278 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bb018-d468-4a0f-abef-b3295e111484 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:48.369602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bb018-d468-4a0f-abef-b3295e111484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:48.384701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bb018-d468-4a0f-abef-b3295e111484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:48.386694 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bb018-d468-4a0f-abef-b3295e111484 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:48.402034 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1397/2815] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:52.295408 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420aaa0-1b8b-4b33-94f4-44d195b6a10b service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:52.386786 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420aaa0-1b8b-4b33-94f4-44d195b6a10b service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:52.392494 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f4c9e-9590-4cf6-a62a-69abcf92395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:52.393498 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f4c9e-9590-4cf6-a62a-69abcf92395d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:52.393840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f4c9e-9590-4cf6-a62a-69abcf92395d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:52.394164 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f4c9e-9590-4cf6-a62a-69abcf92395d admin admin] PATH_INFO: `/v3/users/489f5e055c574f469432becdfd882e8c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:52.395427 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f4c9e-9590-4cf6-a62a-69abcf92395d admin admin] RBAC: Authorizing `identity:delete_user(user_id=489f5e055c574f469432becdfd882e8c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:52.397364 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f4c9e-9590-4cf6-a62a-69abcf92395d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:52.450161 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-179f4c9e-9590-4cf6-a62a-69abcf92395d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '489f5e055c574f469432becdfd882e8c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:52.457348 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-179f4c9e-9590-4cf6-a62a-69abcf92395d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '489f5e055c574f469432becdfd882e8c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:52.458046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-179f4c9e-9590-4cf6-a62a-69abcf92395d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '489f5e055c574f469432becdfd882e8c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:52.458665 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-179f4c9e-9590-4cf6-a62a-69abcf92395d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '489f5e055c574f469432becdfd882e8c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:52.471064 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-179f4c9e-9590-4cf6-a62a-69abcf92395d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '489f5e055c574f469432becdfd882e8c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:52.489294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1419/2816] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:52 2022] DELETE /identity/v3/users/489f5e055c574f469432becdfd882e8c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:52.493940 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a2fdc-a80c-4297-9ec5-b9fe8c31cc51 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:52.494638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a2fdc-a80c-4297-9ec5-b9fe8c31cc51 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:52.494638 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a2fdc-a80c-4297-9ec5-b9fe8c31cc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:52.513453 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fe8a2fdc-a80c-4297-9ec5-b9fe8c31cc51 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:52.514858 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fe8a2fdc-a80c-4297-9ec5-b9fe8c31cc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:52.578335 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1398/2817] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:52.588828 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f4c9e-9590-4cf6-a62a-69abcf92395d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:52.590293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-179f4c9e-9590-4cf6-a62a-69abcf92395d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:52.662892 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f4c9e-9590-4cf6-a62a-69abcf92395d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:52.667033 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b17919-5134-4e45-9a00-814ec5979cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:52.667744 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b17919-5134-4e45-9a00-814ec5979cfd service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:52.668030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b17919-5134-4e45-9a00-814ec5979cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:52.668308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b17919-5134-4e45-9a00-814ec5979cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:52.678349 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b17919-5134-4e45-9a00-814ec5979cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:52.679807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b17919-5134-4e45-9a00-814ec5979cfd service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:52.685030 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:52.690297 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1420/2818] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:52.991254 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a2fdc-a80c-4297-9ec5-b9fe8c31cc51 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:52.993524 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fe8a2fdc-a80c-4297-9ec5-b9fe8c31cc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:53.011634 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a2fdc-a80c-4297-9ec5-b9fe8c31cc51 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:53.017570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:53.018906 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:53.019386 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:53.019569 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed admin admin] PATH_INFO: `/v3/projects/8373c3af992a4a5fa731e21eea84fd84` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:53.021100 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8373c3af992a4a5fa731e21eea84fd84)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:53.023234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:53.091498 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:53.102492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8373c3af992a4a5fa731e21eea84fd84', 'request_id': 'req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:53.115436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8373c3af992a4a5fa731e21eea84fd84', 'request_id': 'req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:53.123002 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8373c3af992a4a5fa731e21eea84fd84', 'request_id': 'req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:53.137454 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed admin admin] The token cache is being invalidate because project 8373c3af992a4a5fa731e21eea84fd84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:53.137775 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:53.138595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:53.140751 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1399/2819] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:52 2022] DELETE /identity/v3/projects/8373c3af992a4a5fa731e21eea84fd84 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:33:53.144794 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b17919-5134-4e45-9a00-814ec5979cfd service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:53.156757 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b17919-5134-4e45-9a00-814ec5979cfd service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:53.221487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d4018-3a0e-453e-86af-c74e86170b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:53.222414 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d4018-3a0e-453e-86af-c74e86170b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:53.222697 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d4018-3a0e-453e-86af-c74e86170b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:53.222968 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d4018-3a0e-453e-86af-c74e86170b30 admin admin] PATH_INFO: `/v3/users/f9d98ed658af48469d635796b8771862` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:53.224190 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d4018-3a0e-453e-86af-c74e86170b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9d98ed658af48469d635796b8771862)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:53.226120 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d4018-3a0e-453e-86af-c74e86170b30 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:53.290408 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3b9d4018-3a0e-453e-86af-c74e86170b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9d98ed658af48469d635796b8771862'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:53.299503 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3b9d4018-3a0e-453e-86af-c74e86170b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9d98ed658af48469d635796b8771862'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:53.300500 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3b9d4018-3a0e-453e-86af-c74e86170b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9d98ed658af48469d635796b8771862'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:53.301345 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3b9d4018-3a0e-453e-86af-c74e86170b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9d98ed658af48469d635796b8771862'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:53.317110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3b9d4018-3a0e-453e-86af-c74e86170b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9d98ed658af48469d635796b8771862'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:53.332800 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1421/2820] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:53 2022] DELETE /identity/v3/users/f9d98ed658af48469d635796b8771862 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:53.657198 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:53.658900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:53.672765 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5433a4-4656-4fc5-a18d-2f4e574e0aed admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:53.735064 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c00d8-9710-411f-bda2-a3cdd9e4a28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:53.735953 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c00d8-9710-411f-bda2-a3cdd9e4a28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:53.736237 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c00d8-9710-411f-bda2-a3cdd9e4a28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:53.736602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c00d8-9710-411f-bda2-a3cdd9e4a28b admin admin] PATH_INFO: `/v3/projects/b55feb2853b54624968bbfd85b1fd17a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:53.737964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c00d8-9710-411f-bda2-a3cdd9e4a28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55feb2853b54624968bbfd85b1fd17a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:53.740857 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c00d8-9710-411f-bda2-a3cdd9e4a28b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:53.800557 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-771c00d8-9710-411f-bda2-a3cdd9e4a28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55feb2853b54624968bbfd85b1fd17a', 'request_id': 'req-771c00d8-9710-411f-bda2-a3cdd9e4a28b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:53.809124 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-771c00d8-9710-411f-bda2-a3cdd9e4a28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55feb2853b54624968bbfd85b1fd17a', 'request_id': 'req-771c00d8-9710-411f-bda2-a3cdd9e4a28b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:53.816000 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-771c00d8-9710-411f-bda2-a3cdd9e4a28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55feb2853b54624968bbfd85b1fd17a', 'request_id': 'req-771c00d8-9710-411f-bda2-a3cdd9e4a28b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:53.831528 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-771c00d8-9710-411f-bda2-a3cdd9e4a28b admin admin] The token cache is being invalidate because project b55feb2853b54624968bbfd85b1fd17a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:53.831859 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-771c00d8-9710-411f-bda2-a3cdd9e4a28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:53.832502 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-771c00d8-9710-411f-bda2-a3cdd9e4a28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:53.834129 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1400/2821] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:53 2022] DELETE /identity/v3/projects/b55feb2853b54624968bbfd85b1fd17a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:53.840869 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fe499-ef60-49d9-bb8d-95ab5acbc66e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:53.841435 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fe499-ef60-49d9-bb8d-95ab5acbc66e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:53.841910 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fe499-ef60-49d9-bb8d-95ab5acbc66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:53.879288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2c0fe499-ef60-49d9-bb8d-95ab5acbc66e None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:53.880551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2c0fe499-ef60-49d9-bb8d-95ab5acbc66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:53.959574 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1422/2822] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:53.969619 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e73a9b-0254-4fb0-a1df-dfc8edbbdd3b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:53.969902 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e73a9b-0254-4fb0-a1df-dfc8edbbdd3b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:53.970189 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e73a9b-0254-4fb0-a1df-dfc8edbbdd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:53.990288 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d1e73a9b-0254-4fb0-a1df-dfc8edbbdd3b None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:53.991531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d1e73a9b-0254-4fb0-a1df-dfc8edbbdd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:54.001797 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1401/2823] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:33:54.007865 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fe499-ef60-49d9-bb8d-95ab5acbc66e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:54.020204 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fe499-ef60-49d9-bb8d-95ab5acbc66e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:54.025277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbea23-a348-43c7-b4f9-bce9f13291c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:54.025961 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbea23-a348-43c7-b4f9-bce9f13291c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:54.026255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbea23-a348-43c7-b4f9-bce9f13291c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:54.026554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbea23-a348-43c7-b4f9-bce9f13291c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:54.027296 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbea23-a348-43c7-b4f9-bce9f13291c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:33:54.027606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbea23-a348-43c7-b4f9-bce9f13291c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:54.029492 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbea23-a348-43c7-b4f9-bce9f13291c0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:54.042783 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1423/2824] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:33:54.047510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e73a9b-0254-4fb0-a1df-dfc8edbbdd3b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:54.057083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e73a9b-0254-4fb0-a1df-dfc8edbbdd3b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:54.062105 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5c74f-c2f9-4381-8edd-30bddee69359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:54.062800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5c74f-c2f9-4381-8edd-30bddee69359 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:54.063085 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5c74f-c2f9-4381-8edd-30bddee69359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:54.063345 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5c74f-c2f9-4381-8edd-30bddee69359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:54.064045 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5c74f-c2f9-4381-8edd-30bddee69359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:54.065962 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5c74f-c2f9-4381-8edd-30bddee69359 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:54.097129 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1402/2825] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:33:54 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:33:54.102947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbea23-a348-43c7-b4f9-bce9f13291c0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:54.114341 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbea23-a348-43c7-b4f9-bce9f13291c0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:54.118643 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:54.190986 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38b352-b8d6-41a1-ba7b-cc8a19f41da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:54.191691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38b352-b8d6-41a1-ba7b-cc8a19f41da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:54.191965 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38b352-b8d6-41a1-ba7b-cc8a19f41da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:54.192250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38b352-b8d6-41a1-ba7b-cc8a19f41da4 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:54.192977 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38b352-b8d6-41a1-ba7b-cc8a19f41da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:54.195108 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38b352-b8d6-41a1-ba7b-cc8a19f41da4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:54.225805 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1424/2826] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:33:54 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:33:54.230465 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5c74f-c2f9-4381-8edd-30bddee69359 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:54.242577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5c74f-c2f9-4381-8edd-30bddee69359 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:54.248639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fad52e-64ae-48f9-879b-88bad599b621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:54.249436 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fad52e-64ae-48f9-879b-88bad599b621 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:54.249729 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fad52e-64ae-48f9-879b-88bad599b621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:54.250171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fad52e-64ae-48f9-879b-88bad599b621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:54.250959 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fad52e-64ae-48f9-879b-88bad599b621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:54.252813 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fad52e-64ae-48f9-879b-88bad599b621 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:54.266376 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1403/2827] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:33:54.270835 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38b352-b8d6-41a1-ba7b-cc8a19f41da4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:54.282146 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38b352-b8d6-41a1-ba7b-cc8a19f41da4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:54.287992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2fd61-577b-43fc-8b03-b4716294dde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:54.288667 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2fd61-577b-43fc-8b03-b4716294dde6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:54.289305 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2fd61-577b-43fc-8b03-b4716294dde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:54.289629 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2fd61-577b-43fc-8b03-b4716294dde6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:54.290400 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2fd61-577b-43fc-8b03-b4716294dde6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:54.292122 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2fd61-577b-43fc-8b03-b4716294dde6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:54.304724 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1425/2828] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:33:54.309292 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fad52e-64ae-48f9-879b-88bad599b621 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:54.320191 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fad52e-64ae-48f9-879b-88bad599b621 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:54.328666 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230ab8d-6b62-4987-9dd0-e856445f7948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:54.329589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230ab8d-6b62-4987-9dd0-e856445f7948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:54.329875 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230ab8d-6b62-4987-9dd0-e856445f7948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:54.330159 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230ab8d-6b62-4987-9dd0-e856445f7948 admin admin] PATH_INFO: `/v3/projects/64a6c5b868cb42788e9618e6f48ad69b/users/d96b66078fc743cbafbbb9eedad1bb6b/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:54.348210 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230ab8d-6b62-4987-9dd0-e856445f7948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a6c5b868cb42788e9618e6f48ad69b, user_id=d96b66078fc743cbafbbb9eedad1bb6b, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:54.351534 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230ab8d-6b62-4987-9dd0-e856445f7948 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:54.354104 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:54.367827 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1404/2829] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:33:54 2022] PUT /identity/v3/projects/64a6c5b868cb42788e9618e6f48ad69b/users/d96b66078fc743cbafbbb9eedad1bb6b/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:54.378329 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f57fe-4376-4941-ae45-a45d36932322 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:54.378619 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f57fe-4376-4941-ae45-a45d36932322 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:54.378902 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f57fe-4376-4941-ae45-a45d36932322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:54.416581 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c09f57fe-4376-4941-ae45-a45d36932322 None None] MFA Rules not processed for user `d96b66078fc743cbafbbb9eedad1bb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:54.417994 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c09f57fe-4376-4941-ae45-a45d36932322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:54.488736 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1426/2830] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:54.500116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230ab8d-6b62-4987-9dd0-e856445f7948 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:54.502063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8230ab8d-6b62-4987-9dd0-e856445f7948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:54.568509 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230ab8d-6b62-4987-9dd0-e856445f7948 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:54.572397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ed18e-79c4-46dd-bb88-01a226ace0d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f18acfb35dfe41a1aeb50c702bd1942b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:54.573052 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ed18e-79c4-46dd-bb88-01a226ace0d3 service glance] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:54.573338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ed18e-79c4-46dd-bb88-01a226ace0d3 service glance] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:54.573616 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ed18e-79c4-46dd-bb88-01a226ace0d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:54.582942 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ed18e-79c4-46dd-bb88-01a226ace0d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:54.584387 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ed18e-79c4-46dd-bb88-01a226ace0d3 service glance] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:54.594014 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1405/2831] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:55.298319 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f57fe-4376-4941-ae45-a45d36932322 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:55.301479 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c09f57fe-4376-4941-ae45-a45d36932322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:55.384850 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f57fe-4376-4941-ae45-a45d36932322 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:55.389923 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d193b4-eae2-406e-85ae-0a536db61db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:55.391175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d193b4-eae2-406e-85ae-0a536db61db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:55.391444 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d193b4-eae2-406e-85ae-0a536db61db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:55.391890 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d193b4-eae2-406e-85ae-0a536db61db3 admin admin] PATH_INFO: `/v3/users/aecfa7e3ded94ad891ac1c946df6014f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:55.395455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d193b4-eae2-406e-85ae-0a536db61db3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aecfa7e3ded94ad891ac1c946df6014f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:55.395455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d193b4-eae2-406e-85ae-0a536db61db3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:55.418853 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:55.458387 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-37d193b4-eae2-406e-85ae-0a536db61db3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aecfa7e3ded94ad891ac1c946df6014f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:55.468059 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-37d193b4-eae2-406e-85ae-0a536db61db3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aecfa7e3ded94ad891ac1c946df6014f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:55.469539 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-37d193b4-eae2-406e-85ae-0a536db61db3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aecfa7e3ded94ad891ac1c946df6014f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:55.470209 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-37d193b4-eae2-406e-85ae-0a536db61db3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aecfa7e3ded94ad891ac1c946df6014f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:55.483480 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-37d193b4-eae2-406e-85ae-0a536db61db3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aecfa7e3ded94ad891ac1c946df6014f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:55.501108 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1427/2832] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:33:55 2022] DELETE /identity/v3/users/aecfa7e3ded94ad891ac1c946df6014f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:33:55.506888 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859952ae-0c5d-40a8-bce2-dab3a72f214a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:55.507408 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859952ae-0c5d-40a8-bce2-dab3a72f214a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:55.507512 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859952ae-0c5d-40a8-bce2-dab3a72f214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:55.525300 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-859952ae-0c5d-40a8-bce2-dab3a72f214a None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:33:55.526640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-859952ae-0c5d-40a8-bce2-dab3a72f214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:55.593916 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1406/2833] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:33:55.604225 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d193b4-eae2-406e-85ae-0a536db61db3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:55.605809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-37d193b4-eae2-406e-85ae-0a536db61db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:55.674780 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d193b4-eae2-406e-85ae-0a536db61db3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:55.678748 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee121b-7475-4915-bb25-971318ec7622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:55.679412 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee121b-7475-4915-bb25-971318ec7622 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:55.679707 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee121b-7475-4915-bb25-971318ec7622 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:55.679979 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee121b-7475-4915-bb25-971318ec7622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:55.689299 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee121b-7475-4915-bb25-971318ec7622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:55.690801 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee121b-7475-4915-bb25-971318ec7622 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:55.700294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1428/2834] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:33:56.022803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859952ae-0c5d-40a8-bce2-dab3a72f214a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:33:56.024377 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-859952ae-0c5d-40a8-bce2-dab3a72f214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:33:56.038153 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859952ae-0c5d-40a8-bce2-dab3a72f214a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:33:56.044152 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7c1aa-061c-4184-8b15-95f4ae3e4929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:33:56.045359 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7c1aa-061c-4184-8b15-95f4ae3e4929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:33:56.045577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7c1aa-061c-4184-8b15-95f4ae3e4929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:33:56.046121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7c1aa-061c-4184-8b15-95f4ae3e4929 admin admin] PATH_INFO: `/v3/projects/0dde43bebbac4281acc4c87846e7c4be` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:33:56.047206 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7c1aa-061c-4184-8b15-95f4ae3e4929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dde43bebbac4281acc4c87846e7c4be)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:33:56.049160 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7c1aa-061c-4184-8b15-95f4ae3e4929 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:33:56.102999 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cef7c1aa-061c-4184-8b15-95f4ae3e4929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dde43bebbac4281acc4c87846e7c4be', 'request_id': 'req-cef7c1aa-061c-4184-8b15-95f4ae3e4929'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:56.118507 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cef7c1aa-061c-4184-8b15-95f4ae3e4929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dde43bebbac4281acc4c87846e7c4be', 'request_id': 'req-cef7c1aa-061c-4184-8b15-95f4ae3e4929'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:56.125166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cef7c1aa-061c-4184-8b15-95f4ae3e4929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dde43bebbac4281acc4c87846e7c4be', 'request_id': 'req-cef7c1aa-061c-4184-8b15-95f4ae3e4929'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:56.143490 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cef7c1aa-061c-4184-8b15-95f4ae3e4929 admin admin] The token cache is being invalidate because project 0dde43bebbac4281acc4c87846e7c4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:33:56.143788 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cef7c1aa-061c-4184-8b15-95f4ae3e4929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:56.144651 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cef7c1aa-061c-4184-8b15-95f4ae3e4929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:33:56.146560 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1407/2835] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:33:56 2022] DELETE /identity/v3/projects/0dde43bebbac4281acc4c87846e7c4be => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:34:01.370753 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee121b-7475-4915-bb25-971318ec7622 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:01.372461 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b9ee121b-7475-4915-bb25-971318ec7622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:01.453436 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee121b-7475-4915-bb25-971318ec7622 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:01.499499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:01.523698 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b683c-252b-4e5d-9c8d-2b052750dd0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b471b5b4ede845c7a9dfbf2a90544591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:01.524373 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b683c-252b-4e5d-9c8d-2b052750dd0a service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:01.524696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b683c-252b-4e5d-9c8d-2b052750dd0a service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:01.524983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b683c-252b-4e5d-9c8d-2b052750dd0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:01.526964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a45b683c-252b-4e5d-9c8d-2b052750dd0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:01.539733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b683c-252b-4e5d-9c8d-2b052750dd0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:01.541347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b683c-252b-4e5d-9c8d-2b052750dd0a service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:01.552859 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1429/2836] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:34:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:34:06.137357 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:INSERT=2,keystone:SELECT=82,keystone:DELETE=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:08.103580 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7c1aa-061c-4184-8b15-95f4ae3e4929 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:08.105934 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cef7c1aa-061c-4184-8b15-95f4ae3e4929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:08.200878 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7c1aa-061c-4184-8b15-95f4ae3e4929 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:08.206452 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7e8ed-b73f-494c-9186-530183e4f218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:08.207577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7e8ed-b73f-494c-9186-530183e4f218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:08.208026 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7e8ed-b73f-494c-9186-530183e4f218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:08.208468 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7e8ed-b73f-494c-9186-530183e4f218 admin admin] PATH_INFO: `/v3/users/d96b66078fc743cbafbbb9eedad1bb6b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:08.209835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7e8ed-b73f-494c-9186-530183e4f218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d96b66078fc743cbafbbb9eedad1bb6b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:08.212102 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7e8ed-b73f-494c-9186-530183e4f218 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:08.262397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f1c7e8ed-b73f-494c-9186-530183e4f218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd96b66078fc743cbafbbb9eedad1bb6b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:08.269972 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f1c7e8ed-b73f-494c-9186-530183e4f218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd96b66078fc743cbafbbb9eedad1bb6b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:08.286854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f1c7e8ed-b73f-494c-9186-530183e4f218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd96b66078fc743cbafbbb9eedad1bb6b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:08.288042 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f1c7e8ed-b73f-494c-9186-530183e4f218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd96b66078fc743cbafbbb9eedad1bb6b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:08.302644 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f1c7e8ed-b73f-494c-9186-530183e4f218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd96b66078fc743cbafbbb9eedad1bb6b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:08.309070 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1408/2837] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:34:08 2022] DELETE /identity/v3/users/d96b66078fc743cbafbbb9eedad1bb6b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:34:08.314288 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d6b90-a0d9-4353-aa7d-eec522c1bb2d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:08.314801 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d6b90-a0d9-4353-aa7d-eec522c1bb2d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:08.314801 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d6b90-a0d9-4353-aa7d-eec522c1bb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:08.334255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b88d6b90-a0d9-4353-aa7d-eec522c1bb2d None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:34:08.335415 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b88d6b90-a0d9-4353-aa7d-eec522c1bb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:08.398106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1430/2838] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:34:08.408605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7e8ed-b73f-494c-9186-530183e4f218 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:08.410158 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f1c7e8ed-b73f-494c-9186-530183e4f218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:08.476272 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7e8ed-b73f-494c-9186-530183e4f218 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:08.480409 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46e6b7-98ed-4a9c-90c0-34aa41907e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:08.481082 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46e6b7-98ed-4a9c-90c0-34aa41907e99 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:08.481397 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46e6b7-98ed-4a9c-90c0-34aa41907e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:08.481668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46e6b7-98ed-4a9c-90c0-34aa41907e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:08.492563 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46e6b7-98ed-4a9c-90c0-34aa41907e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:08.499690 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46e6b7-98ed-4a9c-90c0-34aa41907e99 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:08.514008 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1409/2839] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:34:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:34:08.841362 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d6b90-a0d9-4353-aa7d-eec522c1bb2d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:08.843327 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b88d6b90-a0d9-4353-aa7d-eec522c1bb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:08.860708 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d6b90-a0d9-4353-aa7d-eec522c1bb2d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:08.868277 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402b079-afd5-470a-8d2e-4a85c6ee9afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:08.869498 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402b079-afd5-470a-8d2e-4a85c6ee9afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:08.870111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402b079-afd5-470a-8d2e-4a85c6ee9afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:08.870553 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402b079-afd5-470a-8d2e-4a85c6ee9afa admin admin] PATH_INFO: `/v3/projects/64a6c5b868cb42788e9618e6f48ad69b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:08.872175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402b079-afd5-470a-8d2e-4a85c6ee9afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a6c5b868cb42788e9618e6f48ad69b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:08.874145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402b079-afd5-470a-8d2e-4a85c6ee9afa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:08.928962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5402b079-afd5-470a-8d2e-4a85c6ee9afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a6c5b868cb42788e9618e6f48ad69b', 'request_id': 'req-5402b079-afd5-470a-8d2e-4a85c6ee9afa'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:08.934799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5402b079-afd5-470a-8d2e-4a85c6ee9afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a6c5b868cb42788e9618e6f48ad69b', 'request_id': 'req-5402b079-afd5-470a-8d2e-4a85c6ee9afa'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:08.941382 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5402b079-afd5-470a-8d2e-4a85c6ee9afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a6c5b868cb42788e9618e6f48ad69b', 'request_id': 'req-5402b079-afd5-470a-8d2e-4a85c6ee9afa'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:08.957358 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5402b079-afd5-470a-8d2e-4a85c6ee9afa admin admin] The token cache is being invalidate because project 64a6c5b868cb42788e9618e6f48ad69b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:34:08.957650 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5402b079-afd5-470a-8d2e-4a85c6ee9afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:08.958298 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5402b079-afd5-470a-8d2e-4a85c6ee9afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:08.959855 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1431/2840] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:34:08 2022] DELETE /identity/v3/projects/64a6c5b868cb42788e9618e6f48ad69b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:34:08.965302 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f43d5-7397-485f-989c-a93b19a01442 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:08.965679 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f43d5-7397-485f-989c-a93b19a01442 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:08.966088 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f43d5-7397-485f-989c-a93b19a01442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:08.986589 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-015f43d5-7397-485f-989c-a93b19a01442 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:34:08.987876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-015f43d5-7397-485f-989c-a93b19a01442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:09.007570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:09.058434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1410/2841] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:34:09.067637 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027a2df-c860-4ab9-bcdf-03009e476652 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:09.067929 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027a2df-c860-4ab9-bcdf-03009e476652 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:09.068210 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027a2df-c860-4ab9-bcdf-03009e476652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:09.088439 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f027a2df-c860-4ab9-bcdf-03009e476652 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:34:09.089677 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f027a2df-c860-4ab9-bcdf-03009e476652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:09.098626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1432/2842] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:34:09.103315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f43d5-7397-485f-989c-a93b19a01442 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:09.113547 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f43d5-7397-485f-989c-a93b19a01442 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:09.118582 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad36e4-f607-468c-ac89-495f92103efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:09.119264 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad36e4-f607-468c-ac89-495f92103efd admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:09.119554 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad36e4-f607-468c-ac89-495f92103efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:09.119837 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad36e4-f607-468c-ac89-495f92103efd admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:09.120590 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad36e4-f607-468c-ac89-495f92103efd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:34:09.120949 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad36e4-f607-468c-ac89-495f92103efd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:09.122591 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad36e4-f607-468c-ac89-495f92103efd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:09.135138 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1411/2843] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:34:09.139755 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027a2df-c860-4ab9-bcdf-03009e476652 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:09.149559 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027a2df-c860-4ab9-bcdf-03009e476652 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:09.154758 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499301b-3c2f-4350-9716-774d66ec9571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:09.155543 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499301b-3c2f-4350-9716-774d66ec9571 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:09.156134 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499301b-3c2f-4350-9716-774d66ec9571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:09.156385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499301b-3c2f-4350-9716-774d66ec9571 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:09.157086 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499301b-3c2f-4350-9716-774d66ec9571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:09.159034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499301b-3c2f-4350-9716-774d66ec9571 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:09.192562 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1433/2844] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:34:09 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:34:09.197072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad36e4-f607-468c-ac89-495f92103efd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:09.208265 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad36e4-f607-468c-ac89-495f92103efd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:09.270460 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc32fc-7ca9-4ebe-b225-6f6a7cadb1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:09.271164 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc32fc-7ca9-4ebe-b225-6f6a7cadb1ac admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:09.271435 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc32fc-7ca9-4ebe-b225-6f6a7cadb1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:09.271718 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc32fc-7ca9-4ebe-b225-6f6a7cadb1ac admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:09.272402 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc32fc-7ca9-4ebe-b225-6f6a7cadb1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:09.274388 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc32fc-7ca9-4ebe-b225-6f6a7cadb1ac admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:09.295293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1412/2845] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:34:09 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:34:09.299589 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499301b-3c2f-4350-9716-774d66ec9571 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:09.311641 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499301b-3c2f-4350-9716-774d66ec9571 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:09.318062 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40814d-8b7e-4407-9078-bfb9ba029ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:09.318791 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40814d-8b7e-4407-9078-bfb9ba029ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:09.319080 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40814d-8b7e-4407-9078-bfb9ba029ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:09.319364 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40814d-8b7e-4407-9078-bfb9ba029ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:09.320109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40814d-8b7e-4407-9078-bfb9ba029ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:09.321738 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40814d-8b7e-4407-9078-bfb9ba029ca0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:09.333479 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1434/2846] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:34:09.337978 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc32fc-7ca9-4ebe-b225-6f6a7cadb1ac admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:09.349488 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc32fc-7ca9-4ebe-b225-6f6a7cadb1ac admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:09.355326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3baee0-0356-40b7-9d18-b361289e144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:09.356001 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3baee0-0356-40b7-9d18-b361289e144c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:09.356282 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3baee0-0356-40b7-9d18-b361289e144c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:09.356546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3baee0-0356-40b7-9d18-b361289e144c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:09.357289 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3baee0-0356-40b7-9d18-b361289e144c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:09.359152 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3baee0-0356-40b7-9d18-b361289e144c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:09.374559 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1413/2847] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:34:09.380166 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40814d-8b7e-4407-9078-bfb9ba029ca0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:09.395799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40814d-8b7e-4407-9078-bfb9ba029ca0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:09.402147 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df1099-6711-4a2a-a20f-3b0d7cab37fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:09.403590 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df1099-6711-4a2a-a20f-3b0d7cab37fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:09.404040 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df1099-6711-4a2a-a20f-3b0d7cab37fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:09.404482 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df1099-6711-4a2a-a20f-3b0d7cab37fc admin admin] PATH_INFO: `/v3/projects/5c013f136cc94d43b7f1d1d71b936195/users/2e74e2088f0f410e95d8997060106010/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:09.423229 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:09.428913 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df1099-6711-4a2a-a20f-3b0d7cab37fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c013f136cc94d43b7f1d1d71b936195, user_id=2e74e2088f0f410e95d8997060106010, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:09.432472 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df1099-6711-4a2a-a20f-3b0d7cab37fc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:09.448293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1435/2848] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:34:09 2022] PUT /identity/v3/projects/5c013f136cc94d43b7f1d1d71b936195/users/2e74e2088f0f410e95d8997060106010/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:34:09.459840 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00620e7-76ca-4700-a82b-f38bcbffc28a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:09.460166 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00620e7-76ca-4700-a82b-f38bcbffc28a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:09.460434 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00620e7-76ca-4700-a82b-f38bcbffc28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:09.494849 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d00620e7-76ca-4700-a82b-f38bcbffc28a None None] MFA Rules not processed for user `2e74e2088f0f410e95d8997060106010`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:34:09.496109 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d00620e7-76ca-4700-a82b-f38bcbffc28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:09.573219 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1414/2849] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:34:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:34:09.578995 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df1099-6711-4a2a-a20f-3b0d7cab37fc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:09.646937 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df1099-6711-4a2a-a20f-3b0d7cab37fc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:09.651571 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8680113-c906-4f0d-a0c6-e075d93e41d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:09.652250 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8680113-c906-4f0d-a0c6-e075d93e41d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:09.652533 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8680113-c906-4f0d-a0c6-e075d93e41d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:09.652810 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8680113-c906-4f0d-a0c6-e075d93e41d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:09.653507 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8680113-c906-4f0d-a0c6-e075d93e41d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:09.655691 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8680113-c906-4f0d-a0c6-e075d93e41d4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:09.685828 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1436/2850] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:34:09 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:34:09.690373 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00620e7-76ca-4700-a82b-f38bcbffc28a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:09.701908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00620e7-76ca-4700-a82b-f38bcbffc28a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:09.715266 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:09.772633 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06502cc7-7f55-4e04-9e0e-014ed1e8e7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:09.773353 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06502cc7-7f55-4e04-9e0e-014ed1e8e7ab admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:09.773626 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06502cc7-7f55-4e04-9e0e-014ed1e8e7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:09.773908 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06502cc7-7f55-4e04-9e0e-014ed1e8e7ab admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:09.774651 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06502cc7-7f55-4e04-9e0e-014ed1e8e7ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:09.776604 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06502cc7-7f55-4e04-9e0e-014ed1e8e7ab admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:09.806268 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1415/2851] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:34:09 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:34:09.807723 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8680113-c906-4f0d-a0c6-e075d93e41d4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:09.823634 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8680113-c906-4f0d-a0c6-e075d93e41d4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:09.829047 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d517b9f-052c-46a1-9c30-a10f6f9b7984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:09.829733 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d517b9f-052c-46a1-9c30-a10f6f9b7984 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:09.830019 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d517b9f-052c-46a1-9c30-a10f6f9b7984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:09.830332 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d517b9f-052c-46a1-9c30-a10f6f9b7984 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:09.831076 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d517b9f-052c-46a1-9c30-a10f6f9b7984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:09.832727 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d517b9f-052c-46a1-9c30-a10f6f9b7984 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:09.844326 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1437/2852] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:34:09.849646 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06502cc7-7f55-4e04-9e0e-014ed1e8e7ab admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:09.860678 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06502cc7-7f55-4e04-9e0e-014ed1e8e7ab admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:09.866531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5811b7-11fb-43d5-adee-610179fa506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:09.867208 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5811b7-11fb-43d5-adee-610179fa506d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:09.867489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5811b7-11fb-43d5-adee-610179fa506d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:09.867768 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5811b7-11fb-43d5-adee-610179fa506d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:09.868502 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5811b7-11fb-43d5-adee-610179fa506d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:09.870270 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5811b7-11fb-43d5-adee-610179fa506d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:09.886069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1416/2853] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:34:09.891714 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d517b9f-052c-46a1-9c30-a10f6f9b7984 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:09.907675 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d517b9f-052c-46a1-9c30-a10f6f9b7984 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:09.913109 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b411f2-27b3-49dc-aac2-6edeb3a9f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:09.914411 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b411f2-27b3-49dc-aac2-6edeb3a9f106 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:09.914690 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b411f2-27b3-49dc-aac2-6edeb3a9f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:09.914962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b411f2-27b3-49dc-aac2-6edeb3a9f106 admin admin] PATH_INFO: `/v3/projects/8e99859b05ca4cfa8f59799bda38857c/users/06f2665f85b94973acef5cb2b4ee6222/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:09.933293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b411f2-27b3-49dc-aac2-6edeb3a9f106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e99859b05ca4cfa8f59799bda38857c, user_id=06f2665f85b94973acef5cb2b4ee6222, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:09.936181 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b411f2-27b3-49dc-aac2-6edeb3a9f106 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:09.953308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1438/2854] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:34:09 2022] PUT /identity/v3/projects/8e99859b05ca4cfa8f59799bda38857c/users/06f2665f85b94973acef5cb2b4ee6222/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:34:09.964217 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc053920-05dd-4f93-9e19-a70ee4ca9394 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:09.964525 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc053920-05dd-4f93-9e19-a70ee4ca9394 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:09.964870 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc053920-05dd-4f93-9e19-a70ee4ca9394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:09.995531 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cc053920-05dd-4f93-9e19-a70ee4ca9394 None None] MFA Rules not processed for user `06f2665f85b94973acef5cb2b4ee6222`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:34:09.996800 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cc053920-05dd-4f93-9e19-a70ee4ca9394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:10.071512 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1417/2855] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:34:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:34:10.078293 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b411f2-27b3-49dc-aac2-6edeb3a9f106 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:10.149940 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b411f2-27b3-49dc-aac2-6edeb3a9f106 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:10.154770 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62faf0-a87d-410b-829e-0c2f0bdf9294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:10.155551 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62faf0-a87d-410b-829e-0c2f0bdf9294 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:10.155840 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62faf0-a87d-410b-829e-0c2f0bdf9294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:10.156113 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62faf0-a87d-410b-829e-0c2f0bdf9294 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:10.156807 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62faf0-a87d-410b-829e-0c2f0bdf9294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:10.158815 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62faf0-a87d-410b-829e-0c2f0bdf9294 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:10.191851 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1439/2856] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:34:10 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:34:10.196135 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc053920-05dd-4f93-9e19-a70ee4ca9394 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:10.212144 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc053920-05dd-4f93-9e19-a70ee4ca9394 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:10.283487 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d6e4d-fd89-4a87-a6b7-522e7ef52089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:10.283854 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d6e4d-fd89-4a87-a6b7-522e7ef52089 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:10.284143 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d6e4d-fd89-4a87-a6b7-522e7ef52089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:10.284444 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d6e4d-fd89-4a87-a6b7-522e7ef52089 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:10.285138 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d6e4d-fd89-4a87-a6b7-522e7ef52089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:10.287123 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d6e4d-fd89-4a87-a6b7-522e7ef52089 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:10.310268 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1418/2857] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:34:10 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:34:10.315308 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62faf0-a87d-410b-829e-0c2f0bdf9294 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:10.326669 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62faf0-a87d-410b-829e-0c2f0bdf9294 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:10.332678 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e5ec7-9c1f-4da1-bb41-43e5dbff27d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:10.333662 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e5ec7-9c1f-4da1-bb41-43e5dbff27d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:10.334070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e5ec7-9c1f-4da1-bb41-43e5dbff27d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:10.334305 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e5ec7-9c1f-4da1-bb41-43e5dbff27d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:10.335199 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e5ec7-9c1f-4da1-bb41-43e5dbff27d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:10.336921 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e5ec7-9c1f-4da1-bb41-43e5dbff27d6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:10.348758 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1440/2858] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:34:10.353379 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d6e4d-fd89-4a87-a6b7-522e7ef52089 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:10.364492 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d6e4d-fd89-4a87-a6b7-522e7ef52089 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:10.369734 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246708c2-7e25-4f40-bc04-37c1cfe019cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:10.370703 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246708c2-7e25-4f40-bc04-37c1cfe019cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:10.370983 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246708c2-7e25-4f40-bc04-37c1cfe019cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:10.371259 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246708c2-7e25-4f40-bc04-37c1cfe019cb admin admin] PATH_INFO: `/v3/projects/837c2741502e467b803b602960ba7a0b/users/1bed042067a4454086dc8fb52e8dd6c9/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:10.384103 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:10.388069 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246708c2-7e25-4f40-bc04-37c1cfe019cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=837c2741502e467b803b602960ba7a0b, user_id=1bed042067a4454086dc8fb52e8dd6c9, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:10.391754 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246708c2-7e25-4f40-bc04-37c1cfe019cb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:10.408074 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1419/2859] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:34:10 2022] PUT /identity/v3/projects/837c2741502e467b803b602960ba7a0b/users/1bed042067a4454086dc8fb52e8dd6c9/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:34:10.414821 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e5ec7-9c1f-4da1-bb41-43e5dbff27d6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:10.427881 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e5ec7-9c1f-4da1-bb41-43e5dbff27d6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:10.437546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:10.492983 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712a047-8c4e-407f-bf2f-a8880a53c8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:10.493674 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712a047-8c4e-407f-bf2f-a8880a53c8fc admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:10.493962 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712a047-8c4e-407f-bf2f-a8880a53c8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:10.494242 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712a047-8c4e-407f-bf2f-a8880a53c8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:10.495097 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712a047-8c4e-407f-bf2f-a8880a53c8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:10.496706 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712a047-8c4e-407f-bf2f-a8880a53c8fc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:10.508385 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1441/2860] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:34:10.514529 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246708c2-7e25-4f40-bc04-37c1cfe019cb admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:10.526075 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246708c2-7e25-4f40-bc04-37c1cfe019cb admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:10.532283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71102e4b-c81b-44e9-8ab8-a1e971f48dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:10.533420 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71102e4b-c81b-44e9-8ab8-a1e971f48dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:10.533701 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71102e4b-c81b-44e9-8ab8-a1e971f48dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:10.533957 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71102e4b-c81b-44e9-8ab8-a1e971f48dbd admin admin] PATH_INFO: `/v3/projects/837c2741502e467b803b602960ba7a0b/users/1bed042067a4454086dc8fb52e8dd6c9/roles/22010253114c4a80a72a1500d1dcc6a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:10.536083 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71102e4b-c81b-44e9-8ab8-a1e971f48dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=837c2741502e467b803b602960ba7a0b, user_id=1bed042067a4454086dc8fb52e8dd6c9, role_id=22010253114c4a80a72a1500d1dcc6a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:10.541072 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71102e4b-c81b-44e9-8ab8-a1e971f48dbd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:10.556999 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1420/2861] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:34:10 2022] PUT /identity/v3/projects/837c2741502e467b803b602960ba7a0b/users/1bed042067a4454086dc8fb52e8dd6c9/roles/22010253114c4a80a72a1500d1dcc6a8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:34:10.569360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1977fa-c36f-4574-a912-25985a44a7a5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:10.569653 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1977fa-c36f-4574-a912-25985a44a7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:10.569930 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1977fa-c36f-4574-a912-25985a44a7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:10.601419 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4d1977fa-c36f-4574-a912-25985a44a7a5 None None] MFA Rules not processed for user `1bed042067a4454086dc8fb52e8dd6c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:34:10.602753 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4d1977fa-c36f-4574-a912-25985a44a7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:10.684709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1442/2862] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:34:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:34:10.698091 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71102e4b-c81b-44e9-8ab8-a1e971f48dbd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:10.700982 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-71102e4b-c81b-44e9-8ab8-a1e971f48dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:10.771183 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71102e4b-c81b-44e9-8ab8-a1e971f48dbd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:10.775569 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2475d-42a3-47e7-9ca6-b0073e6fceef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:10.776223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2475d-42a3-47e7-9ca6-b0073e6fceef service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:10.776510 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2475d-42a3-47e7-9ca6-b0073e6fceef service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:10.776787 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2475d-42a3-47e7-9ca6-b0073e6fceef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:10.838771 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2475d-42a3-47e7-9ca6-b0073e6fceef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:10.840269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2475d-42a3-47e7-9ca6-b0073e6fceef service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:10.852728 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1421/2863] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:34:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:34:12.406690 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1977fa-c36f-4574-a912-25985a44a7a5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:12.408910 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4d1977fa-c36f-4574-a912-25985a44a7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:12.426444 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1977fa-c36f-4574-a912-25985a44a7a5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:12.430360 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bdc8e-69c6-4c48-bf91-7355a03a5db8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:12.431007 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bdc8e-69c6-4c48-bf91-7355a03a5db8 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:12.431295 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bdc8e-69c6-4c48-bf91-7355a03a5db8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:12.431572 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bdc8e-69c6-4c48-bf91-7355a03a5db8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:12.493286 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bdc8e-69c6-4c48-bf91-7355a03a5db8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:12.494759 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bdc8e-69c6-4c48-bf91-7355a03a5db8 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:12.504779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1443/2864] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:34:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:34:13.057641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2475d-42a3-47e7-9ca6-b0073e6fceef service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:13.067937 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2475d-42a3-47e7-9ca6-b0073e6fceef service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:13.072121 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2d96a-9d27-4e12-a79a-f7baa0596016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:13.072878 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2d96a-9d27-4e12-a79a-f7baa0596016 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:13.073043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2d96a-9d27-4e12-a79a-f7baa0596016 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:13.073339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2d96a-9d27-4e12-a79a-f7baa0596016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:13.083874 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2d96a-9d27-4e12-a79a-f7baa0596016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:13.085333 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2d96a-9d27-4e12-a79a-f7baa0596016 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:13.096015 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1422/2865] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:34:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:34:17.066941 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bdc8e-69c6-4c48-bf91-7355a03a5db8 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:17.102594 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:17.132901 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bdc8e-69c6-4c48-bf91-7355a03a5db8 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:17.138359 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9ab92-653e-4b38-9273-dd9e3f690b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:17.139255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9ab92-653e-4b38-9273-dd9e3f690b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:17.139543 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9ab92-653e-4b38-9273-dd9e3f690b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:17.139820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9ab92-653e-4b38-9273-dd9e3f690b67 admin admin] PATH_INFO: `/v3/users/2e74e2088f0f410e95d8997060106010` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:17.141060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9ab92-653e-4b38-9273-dd9e3f690b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e74e2088f0f410e95d8997060106010)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:17.143164 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9ab92-653e-4b38-9273-dd9e3f690b67 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:17.193965 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5dd9ab92-653e-4b38-9273-dd9e3f690b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e74e2088f0f410e95d8997060106010'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:17.200614 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5dd9ab92-653e-4b38-9273-dd9e3f690b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e74e2088f0f410e95d8997060106010'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:17.201272 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5dd9ab92-653e-4b38-9273-dd9e3f690b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e74e2088f0f410e95d8997060106010'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:17.201862 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5dd9ab92-653e-4b38-9273-dd9e3f690b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e74e2088f0f410e95d8997060106010'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:17.215018 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5dd9ab92-653e-4b38-9273-dd9e3f690b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e74e2088f0f410e95d8997060106010'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:17.230426 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1444/2866] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:34:17 2022] DELETE /identity/v3/users/2e74e2088f0f410e95d8997060106010 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:34:17.237828 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ebee8-2b3e-406e-9341-78511b7618ff None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:17.238538 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ebee8-2b3e-406e-9341-78511b7618ff None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:17.238538 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ebee8-2b3e-406e-9341-78511b7618ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:17.261478 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-644ebee8-2b3e-406e-9341-78511b7618ff None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:34:17.262636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-644ebee8-2b3e-406e-9341-78511b7618ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:17.328380 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1423/2867] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:34:17.338548 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9ab92-653e-4b38-9273-dd9e3f690b67 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:17.340110 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5dd9ab92-653e-4b38-9273-dd9e3f690b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:17.404531 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9ab92-653e-4b38-9273-dd9e3f690b67 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:17.408678 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab89640-6a44-4ec1-8ee1-f7746171b7b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:17.409306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab89640-6a44-4ec1-8ee1-f7746171b7b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:17.409593 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab89640-6a44-4ec1-8ee1-f7746171b7b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:17.409875 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab89640-6a44-4ec1-8ee1-f7746171b7b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:17.423304 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab89640-6a44-4ec1-8ee1-f7746171b7b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:17.425193 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab89640-6a44-4ec1-8ee1-f7746171b7b7 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:17.436417 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1445/2868] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:34:17.726429 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ebee8-2b3e-406e-9341-78511b7618ff None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:17.727873 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-644ebee8-2b3e-406e-9341-78511b7618ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:17.741784 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ebee8-2b3e-406e-9341-78511b7618ff None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:17.747260 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a603c0-dcb6-477e-a318-0e22a3dd40a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:17.748255 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a603c0-dcb6-477e-a318-0e22a3dd40a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:17.748608 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a603c0-dcb6-477e-a318-0e22a3dd40a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:17.748953 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a603c0-dcb6-477e-a318-0e22a3dd40a1 admin admin] PATH_INFO: `/v3/projects/5c013f136cc94d43b7f1d1d71b936195` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:17.757358 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a603c0-dcb6-477e-a318-0e22a3dd40a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c013f136cc94d43b7f1d1d71b936195)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:17.759367 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a603c0-dcb6-477e-a318-0e22a3dd40a1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:17.777626 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:17.814046 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-72a603c0-dcb6-477e-a318-0e22a3dd40a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c013f136cc94d43b7f1d1d71b936195', 'request_id': 'req-72a603c0-dcb6-477e-a318-0e22a3dd40a1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:17.822168 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-72a603c0-dcb6-477e-a318-0e22a3dd40a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c013f136cc94d43b7f1d1d71b936195', 'request_id': 'req-72a603c0-dcb6-477e-a318-0e22a3dd40a1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:17.828293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-72a603c0-dcb6-477e-a318-0e22a3dd40a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c013f136cc94d43b7f1d1d71b936195', 'request_id': 'req-72a603c0-dcb6-477e-a318-0e22a3dd40a1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:17.840499 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-72a603c0-dcb6-477e-a318-0e22a3dd40a1 admin admin] The token cache is being invalidate because project 5c013f136cc94d43b7f1d1d71b936195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:34:17.840792 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-72a603c0-dcb6-477e-a318-0e22a3dd40a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:17.841496 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-72a603c0-dcb6-477e-a318-0e22a3dd40a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:17.843147 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1424/2869] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:34:17 2022] DELETE /identity/v3/projects/5c013f136cc94d43b7f1d1d71b936195 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:34:17.848004 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab89640-6a44-4ec1-8ee1-f7746171b7b7 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:17.859082 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab89640-6a44-4ec1-8ee1-f7746171b7b7 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:17.915206 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:17.924244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c31fa-cb6f-481c-af36-38aaaac4b831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:17.925418 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c31fa-cb6f-481c-af36-38aaaac4b831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:17.925783 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c31fa-cb6f-481c-af36-38aaaac4b831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:17.926335 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c31fa-cb6f-481c-af36-38aaaac4b831 admin admin] PATH_INFO: `/v3/users/06f2665f85b94973acef5cb2b4ee6222` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:17.927860 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c31fa-cb6f-481c-af36-38aaaac4b831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f2665f85b94973acef5cb2b4ee6222)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:17.929825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c31fa-cb6f-481c-af36-38aaaac4b831 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:17.987993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-932c31fa-cb6f-481c-af36-38aaaac4b831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f2665f85b94973acef5cb2b4ee6222'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:17.997567 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-932c31fa-cb6f-481c-af36-38aaaac4b831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f2665f85b94973acef5cb2b4ee6222'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:17.998431 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-932c31fa-cb6f-481c-af36-38aaaac4b831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f2665f85b94973acef5cb2b4ee6222'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:17.999247 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-932c31fa-cb6f-481c-af36-38aaaac4b831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f2665f85b94973acef5cb2b4ee6222'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:18.014947 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-932c31fa-cb6f-481c-af36-38aaaac4b831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f2665f85b94973acef5cb2b4ee6222'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:18.031115 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1446/2870] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:34:17 2022] DELETE /identity/v3/users/06f2665f85b94973acef5cb2b4ee6222 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:34:18.342029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a603c0-dcb6-477e-a318-0e22a3dd40a1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:18.343548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-72a603c0-dcb6-477e-a318-0e22a3dd40a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:18.357047 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a603c0-dcb6-477e-a318-0e22a3dd40a1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:18.422991 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0930426-4dc0-423b-b851-fd259d4117d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:18.424063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0930426-4dc0-423b-b851-fd259d4117d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:18.424489 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0930426-4dc0-423b-b851-fd259d4117d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:18.424771 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0930426-4dc0-423b-b851-fd259d4117d1 admin admin] PATH_INFO: `/v3/projects/8e99859b05ca4cfa8f59799bda38857c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:18.426116 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0930426-4dc0-423b-b851-fd259d4117d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e99859b05ca4cfa8f59799bda38857c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:18.427995 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0930426-4dc0-423b-b851-fd259d4117d1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:18.479029 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d0930426-4dc0-423b-b851-fd259d4117d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e99859b05ca4cfa8f59799bda38857c', 'request_id': 'req-d0930426-4dc0-423b-b851-fd259d4117d1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:18.490893 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d0930426-4dc0-423b-b851-fd259d4117d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e99859b05ca4cfa8f59799bda38857c', 'request_id': 'req-d0930426-4dc0-423b-b851-fd259d4117d1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:18.497835 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d0930426-4dc0-423b-b851-fd259d4117d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e99859b05ca4cfa8f59799bda38857c', 'request_id': 'req-d0930426-4dc0-423b-b851-fd259d4117d1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:18.510990 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d0930426-4dc0-423b-b851-fd259d4117d1 admin admin] The token cache is being invalidate because project 8e99859b05ca4cfa8f59799bda38857c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:34:18.511290 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d0930426-4dc0-423b-b851-fd259d4117d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:18.512015 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d0930426-4dc0-423b-b851-fd259d4117d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:18.513698 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1425/2871] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:34:18 2022] DELETE /identity/v3/projects/8e99859b05ca4cfa8f59799bda38857c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:34:18.517964 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c31fa-cb6f-481c-af36-38aaaac4b831 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:18.519589 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-932c31fa-cb6f-481c-af36-38aaaac4b831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:18.533387 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c31fa-cb6f-481c-af36-38aaaac4b831 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:18.592619 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63e2e-13e1-4f71-b5a3-20ac2da5de01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:18.593514 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63e2e-13e1-4f71-b5a3-20ac2da5de01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:18.593802 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63e2e-13e1-4f71-b5a3-20ac2da5de01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:18.594077 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63e2e-13e1-4f71-b5a3-20ac2da5de01 admin admin] PATH_INFO: `/v3/users/1bed042067a4454086dc8fb52e8dd6c9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:18.595557 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d63e2e-13e1-4f71-b5a3-20ac2da5de01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bed042067a4454086dc8fb52e8dd6c9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:18.597625 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d63e2e-13e1-4f71-b5a3-20ac2da5de01 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:18.655654 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-09d63e2e-13e1-4f71-b5a3-20ac2da5de01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bed042067a4454086dc8fb52e8dd6c9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:18.664598 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-09d63e2e-13e1-4f71-b5a3-20ac2da5de01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bed042067a4454086dc8fb52e8dd6c9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:18.665338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-09d63e2e-13e1-4f71-b5a3-20ac2da5de01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bed042067a4454086dc8fb52e8dd6c9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:18.665956 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-09d63e2e-13e1-4f71-b5a3-20ac2da5de01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bed042067a4454086dc8fb52e8dd6c9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:18.679169 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-09d63e2e-13e1-4f71-b5a3-20ac2da5de01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bed042067a4454086dc8fb52e8dd6c9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:18.681719 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:18.696335 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1447/2872] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:34:18 2022] DELETE /identity/v3/users/1bed042067a4454086dc8fb52e8dd6c9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:34:19.012505 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0930426-4dc0-423b-b851-fd259d4117d1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:19.014086 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d0930426-4dc0-423b-b851-fd259d4117d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:19.027726 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0930426-4dc0-423b-b851-fd259d4117d1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:19.064098 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:19.094571 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237fcb6-9d3d-4758-8377-15c3dd22a450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:19.095570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237fcb6-9d3d-4758-8377-15c3dd22a450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:19.096020 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237fcb6-9d3d-4758-8377-15c3dd22a450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:19.096306 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237fcb6-9d3d-4758-8377-15c3dd22a450 admin admin] PATH_INFO: `/v3/projects/837c2741502e467b803b602960ba7a0b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:19.097636 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237fcb6-9d3d-4758-8377-15c3dd22a450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=837c2741502e467b803b602960ba7a0b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:19.099805 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237fcb6-9d3d-4758-8377-15c3dd22a450 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:19.153184 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e237fcb6-9d3d-4758-8377-15c3dd22a450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '837c2741502e467b803b602960ba7a0b', 'request_id': 'req-e237fcb6-9d3d-4758-8377-15c3dd22a450'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:19.161680 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e237fcb6-9d3d-4758-8377-15c3dd22a450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '837c2741502e467b803b602960ba7a0b', 'request_id': 'req-e237fcb6-9d3d-4758-8377-15c3dd22a450'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:19.167860 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e237fcb6-9d3d-4758-8377-15c3dd22a450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '837c2741502e467b803b602960ba7a0b', 'request_id': 'req-e237fcb6-9d3d-4758-8377-15c3dd22a450'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:19.188546 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e237fcb6-9d3d-4758-8377-15c3dd22a450 admin admin] The token cache is being invalidate because project 837c2741502e467b803b602960ba7a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:34:19.189209 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e237fcb6-9d3d-4758-8377-15c3dd22a450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:19.190034 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e237fcb6-9d3d-4758-8377-15c3dd22a450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:34:19.192476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1426/2873] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:34:19 2022] DELETE /identity/v3/projects/837c2741502e467b803b602960ba7a0b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:34:19.200105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000e25f-0f84-4c88-af23-be2af1acfdbc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:19.200453 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000e25f-0f84-4c88-af23-be2af1acfdbc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:19.200904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000e25f-0f84-4c88-af23-be2af1acfdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:19.222046 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2000e25f-0f84-4c88-af23-be2af1acfdbc None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:34:19.223325 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2000e25f-0f84-4c88-af23-be2af1acfdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:19.295294 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1448/2874] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:34:19.303992 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea611ad-ca8c-4b5e-b34d-8d82bec6450d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:19.304324 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea611ad-ca8c-4b5e-b34d-8d82bec6450d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:19.304649 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea611ad-ca8c-4b5e-b34d-8d82bec6450d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:19.323821 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5ea611ad-ca8c-4b5e-b34d-8d82bec6450d None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:34:19.325030 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5ea611ad-ca8c-4b5e-b34d-8d82bec6450d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:19.334173 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1427/2875] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:34:19.339696 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000e25f-0f84-4c88-af23-be2af1acfdbc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:19.355172 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000e25f-0f84-4c88-af23-be2af1acfdbc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:19.362307 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b8565-928c-4b18-b95f-e49db53b6297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:19.362984 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b8565-928c-4b18-b95f-e49db53b6297 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:19.363270 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b8565-928c-4b18-b95f-e49db53b6297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:19.363569 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b8565-928c-4b18-b95f-e49db53b6297 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:19.364290 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b8565-928c-4b18-b95f-e49db53b6297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:34:19.364606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b8565-928c-4b18-b95f-e49db53b6297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:19.366255 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b8565-928c-4b18-b95f-e49db53b6297 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:19.379070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1449/2876] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:34:19.385821 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea611ad-ca8c-4b5e-b34d-8d82bec6450d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:19.399037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea611ad-ca8c-4b5e-b34d-8d82bec6450d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:19.404562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e55672-f794-4519-b24e-811d22408958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:19.405354 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e55672-f794-4519-b24e-811d22408958 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:19.405535 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e55672-f794-4519-b24e-811d22408958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:19.405791 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e55672-f794-4519-b24e-811d22408958 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:19.406543 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e55672-f794-4519-b24e-811d22408958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:19.408859 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e55672-f794-4519-b24e-811d22408958 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:19.441084 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1428/2877] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:34:19 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:34:19.445841 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b8565-928c-4b18-b95f-e49db53b6297 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:19.456992 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b8565-928c-4b18-b95f-e49db53b6297 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:19.514969 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71a747-18a0-41b2-8b34-8b2bd1536f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:19.515652 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71a747-18a0-41b2-8b34-8b2bd1536f9f admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:19.515939 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71a747-18a0-41b2-8b34-8b2bd1536f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:19.516218 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71a747-18a0-41b2-8b34-8b2bd1536f9f admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:19.516915 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71a747-18a0-41b2-8b34-8b2bd1536f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:19.519145 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71a747-18a0-41b2-8b34-8b2bd1536f9f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:19.542799 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1450/2878] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:34:19 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:34:19.547999 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e55672-f794-4519-b24e-811d22408958 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:19.559339 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e55672-f794-4519-b24e-811d22408958 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:19.565351 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7179aab-dd71-4587-a001-cfce389f098b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:19.566037 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7179aab-dd71-4587-a001-cfce389f098b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:19.566355 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7179aab-dd71-4587-a001-cfce389f098b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:19.566641 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7179aab-dd71-4587-a001-cfce389f098b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:19.567384 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7179aab-dd71-4587-a001-cfce389f098b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:19.569010 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7179aab-dd71-4587-a001-cfce389f098b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:19.580363 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1429/2879] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:34:19.584811 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71a747-18a0-41b2-8b34-8b2bd1536f9f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:19.595006 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71a747-18a0-41b2-8b34-8b2bd1536f9f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:19.599929 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00389dc7-1a3b-413b-b433-7e8f4d6b1836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:19.600606 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389dc7-1a3b-413b-b433-7e8f4d6b1836 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:19.600886 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389dc7-1a3b-413b-b433-7e8f4d6b1836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:19.601165 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389dc7-1a3b-413b-b433-7e8f4d6b1836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:19.601896 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00389dc7-1a3b-413b-b433-7e8f4d6b1836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:19.603546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00389dc7-1a3b-413b-b433-7e8f4d6b1836 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:19.613888 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1451/2880] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:34:19.618198 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7179aab-dd71-4587-a001-cfce389f098b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:19.628654 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7179aab-dd71-4587-a001-cfce389f098b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:19.633752 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e57a1-0c55-46c8-9de6-e6c71754f059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:19.634706 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e57a1-0c55-46c8-9de6-e6c71754f059 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:19.635105 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e57a1-0c55-46c8-9de6-e6c71754f059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:19.635400 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e57a1-0c55-46c8-9de6-e6c71754f059 admin admin] PATH_INFO: `/v3/projects/4853e7a2b88c40c2b1204b679791d55f/users/c962ebbbebd3484d90b5c97ce1021f37/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:19.650544 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e57a1-0c55-46c8-9de6-e6c71754f059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4853e7a2b88c40c2b1204b679791d55f, user_id=c962ebbbebd3484d90b5c97ce1021f37, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:19.653222 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e57a1-0c55-46c8-9de6-e6c71754f059 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:19.670408 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1430/2881] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:34:19 2022] PUT /identity/v3/projects/4853e7a2b88c40c2b1204b679791d55f/users/c962ebbbebd3484d90b5c97ce1021f37/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:34:19.677139 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6e78f-d340-4565-852c-7d73dc815da7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:19.677455 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6e78f-d340-4565-852c-7d73dc815da7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:19.677762 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6e78f-d340-4565-852c-7d73dc815da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:19.696678 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-16d6e78f-d340-4565-852c-7d73dc815da7 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:34:19.697814 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-16d6e78f-d340-4565-852c-7d73dc815da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:19.755282 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:19.765690 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1452/2882] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:34:19.784119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e57a1-0c55-46c8-9de6-e6c71754f059 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:19.784119 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b43e57a1-0c55-46c8-9de6-e6c71754f059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:19.851555 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e57a1-0c55-46c8-9de6-e6c71754f059 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:19.855424 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046fd5-397d-4a8b-bf1e-cb26330b51e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:19.856086 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046fd5-397d-4a8b-bf1e-cb26330b51e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:19.856366 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046fd5-397d-4a8b-bf1e-cb26330b51e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:19.856635 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046fd5-397d-4a8b-bf1e-cb26330b51e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:19.867201 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a046fd5-397d-4a8b-bf1e-cb26330b51e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:19.868652 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a046fd5-397d-4a8b-bf1e-cb26330b51e8 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:19.879063 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1431/2883] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:34:20.571175 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a0906-340e-4808-90e6-870efeb27cb0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:20.571761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a0906-340e-4808-90e6-870efeb27cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:20.571761 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a0906-340e-4808-90e6-870efeb27cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:20.601315 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-715a0906-340e-4808-90e6-870efeb27cb0 None None] MFA Rules not processed for user `c962ebbbebd3484d90b5c97ce1021f37`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:34:20.602569 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-715a0906-340e-4808-90e6-870efeb27cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:20.670499 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1453/2884] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:34:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:34:20.682078 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046fd5-397d-4a8b-bf1e-cb26330b51e8 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:20.683925 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8a046fd5-397d-4a8b-bf1e-cb26330b51e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:20.690267 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:20.756898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046fd5-397d-4a8b-bf1e-cb26330b51e8 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:20.761898 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27238d-f028-4a84-93ae-8b44a605e082 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:20.762606 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27238d-f028-4a84-93ae-8b44a605e082 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:20.762891 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27238d-f028-4a84-93ae-8b44a605e082 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:20.763170 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27238d-f028-4a84-93ae-8b44a605e082 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:20.774717 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27238d-f028-4a84-93ae-8b44a605e082 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:20.776176 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27238d-f028-4a84-93ae-8b44a605e082 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:20.789095 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1432/2885] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:34:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:34:22.189982 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c275f4c-1e04-40d2-a43f-23582152e29b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:22.190626 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c275f4c-1e04-40d2-a43f-23582152e29b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:22.190773 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c275f4c-1e04-40d2-a43f-23582152e29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:22.210491 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6c275f4c-1e04-40d2-a43f-23582152e29b None None] MFA Rules not processed for user `c962ebbbebd3484d90b5c97ce1021f37`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:34:22.211731 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6c275f4c-1e04-40d2-a43f-23582152e29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:22.219060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1454/2886] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:34:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:34:22.469269 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27238d-f028-4a84-93ae-8b44a605e082 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:22.471315 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7b27238d-f028-4a84-93ae-8b44a605e082 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:22.484348 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27238d-f028-4a84-93ae-8b44a605e082 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:22.488639 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ebb75-17e3-49bb-a7aa-4b6476df4728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:22.489319 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ebb75-17e3-49bb-a7aa-4b6476df4728 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:22.489593 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ebb75-17e3-49bb-a7aa-4b6476df4728 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:22.489876 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ebb75-17e3-49bb-a7aa-4b6476df4728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:22.491702 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-eb9ebb75-17e3-49bb-a7aa-4b6476df4728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:22.502646 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ebb75-17e3-49bb-a7aa-4b6476df4728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:22.504290 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ebb75-17e3-49bb-a7aa-4b6476df4728 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:22.513471 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1433/2887] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:34:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:34:32.203656 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=35 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:32.509293 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=31 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:41.247877 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac20694-b067-44f4-859f-be92d1ba8a7d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:41.248472 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac20694-b067-44f4-859f-be92d1ba8a7d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:41.248472 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac20694-b067-44f4-859f-be92d1ba8a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:41.268595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3ac20694-b067-44f4-859f-be92d1ba8a7d None None] MFA Rules not processed for user `c962ebbbebd3484d90b5c97ce1021f37`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:34:41.269832 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3ac20694-b067-44f4-859f-be92d1ba8a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:41.277141 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1455/2888] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:34:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:34:51.262595 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:56.641369 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a28cb3-3a9a-4ebd-a24c-1e37f2235afe None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:56.641894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a28cb3-3a9a-4ebd-a24c-1e37f2235afe None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:56.641894 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a28cb3-3a9a-4ebd-a24c-1e37f2235afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:56.663602 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-06a28cb3-3a9a-4ebd-a24c-1e37f2235afe None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:34:56.665051 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-06a28cb3-3a9a-4ebd-a24c-1e37f2235afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:56.734471 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1434/2889] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 27 15:34:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:34:56.789244 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac20694-b067-44f4-859f-be92d1ba8a7d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:34:56.790809 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3ac20694-b067-44f4-859f-be92d1ba8a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:34:56.873167 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac20694-b067-44f4-859f-be92d1ba8a7d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:34:56.880276 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeddabd-ae60-4afd-ab17-0ca5dcf000e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:34:56.880948 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeddabd-ae60-4afd-ab17-0ca5dcf000e7 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:34:56.881904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeddabd-ae60-4afd-ab17-0ca5dcf000e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:34:56.881904 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeddabd-ae60-4afd-ab17-0ca5dcf000e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:34:56.892140 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeddabd-ae60-4afd-ab17-0ca5dcf000e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:34:56.894825 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeddabd-ae60-4afd-ab17-0ca5dcf000e7 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:34:56.904451 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1456/2890] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:34:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:35:06.726526 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=25 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:06.901106 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=32 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:12.559188 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346abb5f-3af8-44cf-b17e-b2f660847cc9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:12.559807 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346abb5f-3af8-44cf-b17e-b2f660847cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:12.560016 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346abb5f-3af8-44cf-b17e-b2f660847cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:12.584537 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-346abb5f-3af8-44cf-b17e-b2f660847cc9 None None] MFA Rules not processed for user `6f3dfc12a3ac499da540065c03bd2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:35:12.586137 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-346abb5f-3af8-44cf-b17e-b2f660847cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:35:12.594101 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1435/2891] 10.222.0.33 () {58 vars in 967 bytes} [Mon Jun 27 15:35:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:35:12.608257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeddabd-ae60-4afd-ab17-0ca5dcf000e7 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:35:12.621163 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeddabd-ae60-4afd-ab17-0ca5dcf000e7 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:35:12.627070 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86104c-253b-43f0-bec6-248b3aa002f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e419f9caf0a4ccb8108d375f527006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:35:12.627752 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86104c-253b-43f0-bec6-248b3aa002f8 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:12.628034 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86104c-253b-43f0-bec6-248b3aa002f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:12.628306 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86104c-253b-43f0-bec6-248b3aa002f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:12.638573 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86104c-253b-43f0-bec6-248b3aa002f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:35:12.640192 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86104c-253b-43f0-bec6-248b3aa002f8 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:35:12.650878 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1457/2892] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 27 15:35:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:35:14.697912 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346abb5f-3af8-44cf-b17e-b2f660847cc9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:35:14.713064 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346abb5f-3af8-44cf-b17e-b2f660847cc9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:35:14.719321 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cf6e6-537c-4989-a873-6e3b21be2c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:35:14.720258 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cf6e6-537c-4989-a873-6e3b21be2c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:14.720577 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cf6e6-537c-4989-a873-6e3b21be2c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:14.720852 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cf6e6-537c-4989-a873-6e3b21be2c18 admin admin] PATH_INFO: `/v3/users/c962ebbbebd3484d90b5c97ce1021f37` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:14.722299 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cf6e6-537c-4989-a873-6e3b21be2c18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c962ebbbebd3484d90b5c97ce1021f37)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:35:14.724220 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cf6e6-537c-4989-a873-6e3b21be2c18 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:35:14.782660 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b59cf6e6-537c-4989-a873-6e3b21be2c18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c962ebbbebd3484d90b5c97ce1021f37'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:14.791278 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b59cf6e6-537c-4989-a873-6e3b21be2c18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c962ebbbebd3484d90b5c97ce1021f37'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:14.800603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b59cf6e6-537c-4989-a873-6e3b21be2c18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c962ebbbebd3484d90b5c97ce1021f37'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:14.801221 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b59cf6e6-537c-4989-a873-6e3b21be2c18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c962ebbbebd3484d90b5c97ce1021f37'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:14.815640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b59cf6e6-537c-4989-a873-6e3b21be2c18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c962ebbbebd3484d90b5c97ce1021f37'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:14.822893 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1436/2893] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:35:14 2022] DELETE /identity/v3/users/c962ebbbebd3484d90b5c97ce1021f37 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:35:15.027713 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86104c-253b-43f0-bec6-248b3aa002f8 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:35:15.049017 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86104c-253b-43f0-bec6-248b3aa002f8 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:35:15.133869 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9efb0-8964-486b-ab47-f0c14dcd26fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:35:15.134837 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9efb0-8964-486b-ab47-f0c14dcd26fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:15.135111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9efb0-8964-486b-ab47-f0c14dcd26fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:15.135415 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9efb0-8964-486b-ab47-f0c14dcd26fe admin admin] PATH_INFO: `/v3/projects/4853e7a2b88c40c2b1204b679791d55f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:15.137053 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9efb0-8964-486b-ab47-f0c14dcd26fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4853e7a2b88c40c2b1204b679791d55f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:35:15.139035 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9efb0-8964-486b-ab47-f0c14dcd26fe admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:35:15.200105 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-afd9efb0-8964-486b-ab47-f0c14dcd26fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4853e7a2b88c40c2b1204b679791d55f', 'request_id': 'req-afd9efb0-8964-486b-ab47-f0c14dcd26fe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:15.206073 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-afd9efb0-8964-486b-ab47-f0c14dcd26fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4853e7a2b88c40c2b1204b679791d55f', 'request_id': 'req-afd9efb0-8964-486b-ab47-f0c14dcd26fe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:15.213432 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-afd9efb0-8964-486b-ab47-f0c14dcd26fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4853e7a2b88c40c2b1204b679791d55f', 'request_id': 'req-afd9efb0-8964-486b-ab47-f0c14dcd26fe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:15.231487 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-afd9efb0-8964-486b-ab47-f0c14dcd26fe admin admin] The token cache is being invalidate because project 4853e7a2b88c40c2b1204b679791d55f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:35:15.231957 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-afd9efb0-8964-486b-ab47-f0c14dcd26fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:15.232646 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-afd9efb0-8964-486b-ab47-f0c14dcd26fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:15.234297 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1458/2894] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:35:15 2022] DELETE /identity/v3/projects/4853e7a2b88c40c2b1204b679791d55f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:35:15.240564 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651c0c8-9487-41f1-8b43-b6d25c06df18 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:15.240853 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651c0c8-9487-41f1-8b43-b6d25c06df18 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:15.241131 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651c0c8-9487-41f1-8b43-b6d25c06df18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:15.261766 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6651c0c8-9487-41f1-8b43-b6d25c06df18 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:35:15.263053 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6651c0c8-9487-41f1-8b43-b6d25c06df18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:35:15.331603 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1437/2895] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:35:15.340604 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9562a-597e-473a-b4c2-1d422befc962 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:15.340910 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9562a-597e-473a-b4c2-1d422befc962 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:15.341172 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9562a-597e-473a-b4c2-1d422befc962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:15.362078 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-29d9562a-597e-473a-b4c2-1d422befc962 None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:35:15.363344 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-29d9562a-597e-473a-b4c2-1d422befc962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:35:15.371918 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1459/2896] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:35:15.377171 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651c0c8-9487-41f1-8b43-b6d25c06df18 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:35:15.391948 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651c0c8-9487-41f1-8b43-b6d25c06df18 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:35:15.399595 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdba04d-e3b8-449e-86e0-6839b8536730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:35:15.400438 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdba04d-e3b8-449e-86e0-6839b8536730 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:15.400803 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdba04d-e3b8-449e-86e0-6839b8536730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:15.401275 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdba04d-e3b8-449e-86e0-6839b8536730 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:15.402312 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdba04d-e3b8-449e-86e0-6839b8536730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:35:15.402690 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdba04d-e3b8-449e-86e0-6839b8536730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:35:15.405536 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdba04d-e3b8-449e-86e0-6839b8536730 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:35:15.426776 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1438/2897] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 27 15:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:35:15.433323 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9562a-597e-473a-b4c2-1d422befc962 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:35:15.447079 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9562a-597e-473a-b4c2-1d422befc962 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:35:15.455392 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0120-eb95-4070-82ed-fa44e6b56db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:35:15.456714 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0120-eb95-4070-82ed-fa44e6b56db9 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:15.457206 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0120-eb95-4070-82ed-fa44e6b56db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:15.457693 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0120-eb95-4070-82ed-fa44e6b56db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:15.459188 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad0120-eb95-4070-82ed-fa44e6b56db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:35:15.461847 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad0120-eb95-4070-82ed-fa44e6b56db9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:35:15.497787 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1460/2898] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 27 15:35:15 2022] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:35:15.503234 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdba04d-e3b8-449e-86e0-6839b8536730 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:35:15.518253 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdba04d-e3b8-449e-86e0-6839b8536730 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:35:15.586897 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:15.598761 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54cb52-c67e-4111-b436-5251c2a42358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:35:15.599472 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54cb52-c67e-4111-b436-5251c2a42358 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:15.599760 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54cb52-c67e-4111-b436-5251c2a42358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:15.600056 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54cb52-c67e-4111-b436-5251c2a42358 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:15.601304 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54cb52-c67e-4111-b436-5251c2a42358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:35:15.605910 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54cb52-c67e-4111-b436-5251c2a42358 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:35:15.630379 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1439/2899] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 27 15:35:15 2022] POST /identity/v3/users => generated 282 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:35:15.636020 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0120-eb95-4070-82ed-fa44e6b56db9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:35:15.647316 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0120-eb95-4070-82ed-fa44e6b56db9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:35:15.652603 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac867b-61f2-4a98-ae3f-0eb00c59f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:35:15.653544 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac867b-61f2-4a98-ae3f-0eb00c59f22e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:15.653826 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac867b-61f2-4a98-ae3f-0eb00c59f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:15.654099 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac867b-61f2-4a98-ae3f-0eb00c59f22e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:15.655131 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac867b-61f2-4a98-ae3f-0eb00c59f22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:35:15.656779 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac867b-61f2-4a98-ae3f-0eb00c59f22e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:35:15.669739 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1461/2900] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:35:15.674820 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54cb52-c67e-4111-b436-5251c2a42358 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:35:15.692320 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54cb52-c67e-4111-b436-5251c2a42358 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:35:15.699651 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f30dbd-2573-4200-bf24-03b83caaa7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:35:15.700976 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f30dbd-2573-4200-bf24-03b83caaa7bc admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:15.701709 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f30dbd-2573-4200-bf24-03b83caaa7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:15.702197 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f30dbd-2573-4200-bf24-03b83caaa7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:15.703640 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f30dbd-2573-4200-bf24-03b83caaa7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:35:15.706886 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f30dbd-2573-4200-bf24-03b83caaa7bc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:35:15.720795 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1440/2901] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 27 15:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:35:15.725617 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac867b-61f2-4a98-ae3f-0eb00c59f22e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:35:15.737113 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac867b-61f2-4a98-ae3f-0eb00c59f22e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:35:15.743783 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af9484-41f9-427a-a9ef-2ee0d909893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:35:15.744718 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af9484-41f9-427a-a9ef-2ee0d909893e admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:15.744993 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af9484-41f9-427a-a9ef-2ee0d909893e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:15.745262 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af9484-41f9-427a-a9ef-2ee0d909893e admin admin] PATH_INFO: `/v3/projects/15ad2d067c1c41f7be81d2c12c4c1237/users/4b610cf401624abf9dfd854065cb9072/roles/bb946622ce1842cba751c5f862237f14` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:15.762695 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af9484-41f9-427a-a9ef-2ee0d909893e admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ad2d067c1c41f7be81d2c12c4c1237, user_id=4b610cf401624abf9dfd854065cb9072, role_id=bb946622ce1842cba751c5f862237f14)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:35:15.765338 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af9484-41f9-427a-a9ef-2ee0d909893e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:35:15.782640 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1462/2902] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 27 15:35:15 2022] PUT /identity/v3/projects/15ad2d067c1c41f7be81d2c12c4c1237/users/4b610cf401624abf9dfd854065cb9072/roles/bb946622ce1842cba751c5f862237f14 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:35:15.852668 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf8db5-e658-42b2-af32-d4812f57298e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:15.852964 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf8db5-e658-42b2-af32-d4812f57298e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:15.853248 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf8db5-e658-42b2-af32-d4812f57298e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:15.883338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e9bf8db5-e658-42b2-af32-d4812f57298e None None] MFA Rules not processed for user `4b610cf401624abf9dfd854065cb9072`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:35:15.884596 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e9bf8db5-e658-42b2-af32-d4812f57298e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:35:15.956033 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1441/2903] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:35:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:35:15.973312 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af9484-41f9-427a-a9ef-2ee0d909893e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:35:15.975060 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-96af9484-41f9-427a-a9ef-2ee0d909893e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:35:15.990933 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:16.040968 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af9484-41f9-427a-a9ef-2ee0d909893e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:35:16.044714 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf4bc2-174e-41dd-9fd3-e64441e24c0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dccf96088954218a4fb8d7b466f970f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:35:16.045383 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf4bc2-174e-41dd-9fd3-e64441e24c0c service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:16.045656 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf4bc2-174e-41dd-9fd3-e64441e24c0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:16.045943 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf4bc2-174e-41dd-9fd3-e64441e24c0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:16.055795 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf4bc2-174e-41dd-9fd3-e64441e24c0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:35:16.057263 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf4bc2-174e-41dd-9fd3-e64441e24c0c service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:35:16.068111 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1463/2904] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:35:15 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:35:25.952925 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:26.062578 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=20 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:46.689326 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf8db5-e658-42b2-af32-d4812f57298e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:35:46.758746 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf8db5-e658-42b2-af32-d4812f57298e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:35:46.763443 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fa9a3-7248-4192-ad8e-956080b7fbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:35:46.764338 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fa9a3-7248-4192-ad8e-956080b7fbe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:46.764623 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fa9a3-7248-4192-ad8e-956080b7fbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:46.764899 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fa9a3-7248-4192-ad8e-956080b7fbe6 admin admin] PATH_INFO: `/v3/users/4b610cf401624abf9dfd854065cb9072` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:46.766096 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325fa9a3-7248-4192-ad8e-956080b7fbe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b610cf401624abf9dfd854065cb9072)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:35:46.768068 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325fa9a3-7248-4192-ad8e-956080b7fbe6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:35:46.817216 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-325fa9a3-7248-4192-ad8e-956080b7fbe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b610cf401624abf9dfd854065cb9072'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:46.826562 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-325fa9a3-7248-4192-ad8e-956080b7fbe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b610cf401624abf9dfd854065cb9072'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:46.838447 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-325fa9a3-7248-4192-ad8e-956080b7fbe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b610cf401624abf9dfd854065cb9072'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:46.839243 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-325fa9a3-7248-4192-ad8e-956080b7fbe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b610cf401624abf9dfd854065cb9072'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:46.855251 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-325fa9a3-7248-4192-ad8e-956080b7fbe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b610cf401624abf9dfd854065cb9072'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:46.861579 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1442/2905] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 27 15:35:46 2022] DELETE /identity/v3/users/4b610cf401624abf9dfd854065cb9072 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:35:46.867709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102e20a-38ae-4635-95e8-961be66c123f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:46.868347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102e20a-38ae-4635-95e8-961be66c123f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:46.868347 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102e20a-38ae-4635-95e8-961be66c123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:46.888820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0102e20a-38ae-4635-95e8-961be66c123f None None] MFA Rules not processed for user `9a202eb6836d4aa3a8bf60c71995def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:35:46.890153 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0102e20a-38ae-4635-95e8-961be66c123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:35:46.978447 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1464/2906] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 27 15:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:35:46.989605 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fa9a3-7248-4192-ad8e-956080b7fbe6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:35:46.991575 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-325fa9a3-7248-4192-ad8e-956080b7fbe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:35:47.060136 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fa9a3-7248-4192-ad8e-956080b7fbe6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:35:47.064043 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be9ffc-8e41-42b8-beb9-e23dfd5f7fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67dbb53f47ca406c96377408e9f893f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:35:47.064712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be9ffc-8e41-42b8-beb9-e23dfd5f7fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:47.064998 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be9ffc-8e41-42b8-beb9-e23dfd5f7fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:47.065283 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be9ffc-8e41-42b8-beb9-e23dfd5f7fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:47.075955 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be9ffc-8e41-42b8-beb9-e23dfd5f7fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:35:47.077712 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be9ffc-8e41-42b8-beb9-e23dfd5f7fd9 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:35:47.088144 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1443/2907] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:35:47.395517 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102e20a-38ae-4635-95e8-961be66c123f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:35:47.397226 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0102e20a-38ae-4635-95e8-961be66c123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:35:47.411018 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102e20a-38ae-4635-95e8-961be66c123f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:35:47.416374 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffb529-5dae-476e-9396-ed8c46716f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a202eb6836d4aa3a8bf60c71995def9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad42af4f268b41b59ed4e25b5dbf310e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:35:47.417259 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffb529-5dae-476e-9396-ed8c46716f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:35:47.417554 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffb529-5dae-476e-9396-ed8c46716f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:35:47.417820 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffb529-5dae-476e-9396-ed8c46716f89 admin admin] PATH_INFO: `/v3/projects/15ad2d067c1c41f7be81d2c12c4c1237` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:35:47.419057 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffb529-5dae-476e-9396-ed8c46716f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15ad2d067c1c41f7be81d2c12c4c1237)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:35:47.420977 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffb529-5dae-476e-9396-ed8c46716f89 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:35:47.476257 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86ffb529-5dae-476e-9396-ed8c46716f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15ad2d067c1c41f7be81d2c12c4c1237', 'request_id': 'req-86ffb529-5dae-476e-9396-ed8c46716f89'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:47.481709 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86ffb529-5dae-476e-9396-ed8c46716f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15ad2d067c1c41f7be81d2c12c4c1237', 'request_id': 'req-86ffb529-5dae-476e-9396-ed8c46716f89'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:47.488023 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86ffb529-5dae-476e-9396-ed8c46716f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15ad2d067c1c41f7be81d2c12c4c1237', 'request_id': 'req-86ffb529-5dae-476e-9396-ed8c46716f89'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:47.502529 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86ffb529-5dae-476e-9396-ed8c46716f89 admin admin] The token cache is being invalidate because project 15ad2d067c1c41f7be81d2c12c4c1237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:35:47.502819 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86ffb529-5dae-476e-9396-ed8c46716f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:47.503442 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86ffb529-5dae-476e-9396-ed8c46716f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:35:47.505104 dv-cinder-847798-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1465/2908] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 27 15:35:47 2022] DELETE /identity/v3/projects/15ad2d067c1c41f7be81d2c12c4c1237 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:35:57.083548 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:57.499546 dv-cinder-847798-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:39:07.347476 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be9ffc-8e41-42b8-beb9-e23dfd5f7fd9 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:39:07.349231 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-84be9ffc-8e41-42b8-beb9-e23dfd5f7fd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:39:07.522570 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be9ffc-8e41-42b8-beb9-e23dfd5f7fd9 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:39:07.598917 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6097a58-37e4-4c26-8d79-df11e32edd0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b471b5b4ede845c7a9dfbf2a90544591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8ec287061141028659ab504e7707de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:39:07.599612 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6097a58-37e4-4c26-8d79-df11e32edd0c service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:39:07.599900 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6097a58-37e4-4c26-8d79-df11e32edd0c service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:39:07.600223 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6097a58-37e4-4c26-8d79-df11e32edd0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:39:07.602196 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e6097a58-37e4-4c26-8d79-df11e32edd0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:39:07.614064 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6097a58-37e4-4c26-8d79-df11e32edd0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:39:07.615840 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6097a58-37e4-4c26-8d79-df11e32edd0c service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:39:07.625808 dv-cinder-847798-1-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1444/2909] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 27 15:39:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:39:17.621890 dv-cinder-847798-1-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}